Skip to content

Instantly share code, notes, and snippets.

@ruebot

ruebot/10689.scala-run-04-105G-with-persist-storage-level-all-the-options.log Secret

Created April 2, 2019 19:01
Show Gist options
  • Save ruebot/b4da5356495e85ce76887108f28529e6 to your computer and use it in GitHub Desktop.
Save ruebot/b4da5356495e85ce76887108f28529e6 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
10689.scala-run-04-105G-with-persist-storage-level-all-the-options.log
2019-04-02 14:37:15 WARN Utils:66 - Your hostname, tuna resolves to a loopback address: 127.0.1.1; using 129.97.186.18 instead (on interface enp5s0f0)
2019-04-02 14:37:15 WARN Utils:66 - Set SPARK_LOCAL_IP if you need to bind to another address
2019-04-02 14:37:15 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Spark context Web UI available at http://tuna.cs.uwaterloo.ca:4040
Spark context available as 'sc' (master = local[30], app id = local-1554230245370).
Spark session available as 'spark'.
2019-04-02 14:37:28 INFO MemoryStore:54 - Block broadcast_0 stored as values in memory (estimated size 370.6 KB, free 55.8 GB)
2019-04-02 14:37:28 DEBUG BlockManager:58 - Put block broadcast_0 locally took 72 ms
2019-04-02 14:37:28 DEBUG BlockManager:58 - Putting block broadcast_0 without replication took 74 ms
2019-04-02 14:37:28 INFO MemoryStore:54 - Block broadcast_0_piece0 stored as bytes in memory (estimated size 24.9 KB, free 55.8 GB)
2019-04-02 14:37:28 INFO BlockManagerInfo:54 - Added broadcast_0_piece0 in memory on tuna.cs.uwaterloo.ca:46365 (size: 24.9 KB, free: 55.8 GB)
2019-04-02 14:37:28 DEBUG BlockManagerMaster:58 - Updated info of block broadcast_0_piece0
2019-04-02 14:37:28 DEBUG BlockManager:58 - Told master about block broadcast_0_piece0
2019-04-02 14:37:28 DEBUG BlockManager:58 - Put block broadcast_0_piece0 locally took 8 ms
2019-04-02 14:37:28 DEBUG BlockManager:58 - Putting block broadcast_0_piece0 without replication took 8 ms
2019-04-02 14:37:28 INFO SparkContext:54 - Created broadcast 0 from newAPIHadoopFile at package.scala:66
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final boolean io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1.apply(scala.Tuple2)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final io.archivesunleashed.ArchiveRecordImpl io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(scala.Tuple2)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final boolean io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1.apply(io.archivesunleashed.ArchiveRecord)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> ($line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long $line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object $line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.String $line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1.apply(io.archivesunleashed.ArchiveRecord)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> ($line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$4) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$4.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$4.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final scala.Tuple2 io.archivesunleashed.package$CountableRDD$$anonfun$4.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$4) is now cleaned +++
2019-04-02 14:37:28 DEBUG FileInputFormat:280 - Time taken to get FileStatuses: 8
2019-04-02 14:37:28 INFO FileInputFormat:283 - Total input paths to process : 56
2019-04-02 14:37:28 DEBUG FileInputFormat:431 - Total # of splits generated by getSplits: 56, TimeTaken: 16
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$1.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 3
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply$mcIII$sp(int,int)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(int,int)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(java.lang.Object,java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$1.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 3
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply$mcIII$sp(int,int)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(int,int)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(java.lang.Object,java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$5) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$5.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$5.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final int io.archivesunleashed.package$CountableRDD$$anonfun$5.apply(scala.Tuple2)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$5) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - private final scala.Function1 org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.cleanedF$3
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final scala.Tuple2 org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.RangePartitioner$$anonfun$9) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.RangePartitioner$$anonfun$9.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.RangePartitioner$$anonfun$9.apply(java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.RangePartitioner$$anonfun$9.apply(scala.Product2)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.RangePartitioner$$anonfun$9) is now cleaned +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (org.apache.spark.RangePartitioner$$anonfun$13) +++
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared fields: 4
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.RangePartitioner$$anonfun$13.serialVersionUID
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - private final int org.apache.spark.RangePartitioner$$anonfun$13.sampleSizePerPartition$2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - private final scala.reflect.ClassTag org.apache.spark.RangePartitioner$$anonfun$13.evidence$5$1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - private final int org.apache.spark.RangePartitioner$$anonfun$13.shift$1
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.RangePartitioner$$anonfun$13.apply(java.lang.Object,java.lang.Object)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - public final scala.collection.Iterator org.apache.spark.RangePartitioner$$anonfun$13.apply(int,scala.collection.Iterator)
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:28 DEBUG ClosureCleaner:58 - +++ closure <function2> (org.apache.spark.RangePartitioner$$anonfun$13) is now cleaned +++
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13) +++
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.serialVersionUID
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - private final org.apache.spark.rdd.RDD$$anonfun$collect$1 org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.$outer
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(java.lang.Object)
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(scala.collection.Iterator)
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outer classes: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD$$anonfun$collect$1
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outer objects: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - <function0>
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - MapPartitionsRDD[9] at sortBy at package.scala:90
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 4
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class scala.runtime.AbstractFunction0,Set())
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD,Set(org$apache$spark$rdd$RDD$$evidence$1))
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class java.lang.Object,Set())
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD$$anonfun$collect$1,Set($outer))
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outermost object is not a closure or REPL line object,so do not clone it: (class org.apache.spark.rdd.RDD,MapPartitionsRDD[9] at sortBy at package.scala:90)
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + cloning the object <function0> of class org.apache.spark.rdd.RDD$$anonfun$collect$1
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + cleaning cloned closure <function0> recursively (org.apache.spark.rdd.RDD$$anonfun$collect$1)
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function0> (org.apache.spark.rdd.RDD$$anonfun$collect$1) +++
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.RDD$$anonfun$collect$1.serialVersionUID
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - private final org.apache.spark.rdd.RDD org.apache.spark.rdd.RDD$$anonfun$collect$1.$outer
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public org.apache.spark.rdd.RDD org.apache.spark.rdd.RDD$$anonfun$collect$1.org$apache$spark$rdd$RDD$$anonfun$$$outer()
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$collect$1.apply()
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + inner classes: 1
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outer classes: 1
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outer objects: 1
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - MapPartitionsRDD[9] at sortBy at package.scala:90
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 4
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class scala.runtime.AbstractFunction0,Set())
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD,Set(org$apache$spark$rdd$RDD$$evidence$1))
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class java.lang.Object,Set())
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD$$anonfun$collect$1,Set($outer))
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outermost object is not a closure or REPL line object,so do not clone it: (class org.apache.spark.rdd.RDD,MapPartitionsRDD[9] at sortBy at package.scala:90)
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - +++ closure <function0> (org.apache.spark.rdd.RDD$$anonfun$collect$1) is now cleaned +++
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13) is now cleaned +++
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (org.apache.spark.SparkContext$$anonfun$runJob$5) +++
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.SparkContext$$anonfun$runJob$5.serialVersionUID
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - private final scala.Function1 org.apache.spark.SparkContext$$anonfun$runJob$5.cleanedFunc$1
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.SparkContext$$anonfun$runJob$5.apply(java.lang.Object,java.lang.Object)
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.SparkContext$$anonfun$runJob$5.apply(org.apache.spark.TaskContext,scala.collection.Iterator)
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 14:37:29 DEBUG ClosureCleaner:58 - +++ closure <function2> (org.apache.spark.SparkContext$$anonfun$runJob$5) is now cleaned +++
2019-04-02 14:37:29 INFO SparkContext:54 - Starting job: sortBy at package.scala:90
2019-04-02 14:37:29 DEBUG SortShuffleManager:192 - Can't use serialized shuffle for shuffle 0 because we need to do map-side aggregation
2019-04-02 14:37:29 INFO DAGScheduler:54 - Registering RDD 5 (map at package.scala:88)
2019-04-02 14:37:29 INFO DAGScheduler:54 - Got job 0 (sortBy at package.scala:90) with 56 output partitions
2019-04-02 14:37:29 INFO DAGScheduler:54 - Final stage: ResultStage 1 (sortBy at package.scala:90)
2019-04-02 14:37:29 INFO DAGScheduler:54 - Parents of final stage: List(ShuffleMapStage 0)
2019-04-02 14:37:29 INFO DAGScheduler:54 - Missing parents: List(ShuffleMapStage 0)
2019-04-02 14:37:29 DEBUG DAGScheduler:58 - submitStage(ResultStage 1)
2019-04-02 14:37:29 DEBUG DAGScheduler:58 - missing: List(ShuffleMapStage 0)
2019-04-02 14:37:29 DEBUG DAGScheduler:58 - submitStage(ShuffleMapStage 0)
2019-04-02 14:37:29 DEBUG DAGScheduler:58 - missing: List()
2019-04-02 14:37:29 INFO DAGScheduler:54 - Submitting ShuffleMapStage 0 (MapPartitionsRDD[5] at map at package.scala:88), which has no missing parents
2019-04-02 14:37:29 DEBUG DAGScheduler:58 - submitMissingTasks(ShuffleMapStage 0)
2019-04-02 14:37:29 INFO MemoryStore:54 - Block broadcast_1 stored as values in memory (estimated size 4.8 KB, free 55.8 GB)
2019-04-02 14:37:29 DEBUG BlockManager:58 - Put block broadcast_1 locally took 2 ms
2019-04-02 14:37:29 DEBUG BlockManager:58 - Putting block broadcast_1 without replication took 2 ms
2019-04-02 14:37:29 INFO MemoryStore:54 - Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 55.8 GB)
2019-04-02 14:37:29 INFO BlockManagerInfo:54 - Added broadcast_1_piece0 in memory on tuna.cs.uwaterloo.ca:46365 (size: 2.7 KB, free: 55.8 GB)
2019-04-02 14:37:29 DEBUG BlockManagerMaster:58 - Updated info of block broadcast_1_piece0
2019-04-02 14:37:29 DEBUG BlockManager:58 - Told master about block broadcast_1_piece0
2019-04-02 14:37:29 DEBUG BlockManager:58 - Put block broadcast_1_piece0 locally took 2 ms
2019-04-02 14:37:29 DEBUG BlockManager:58 - Putting block broadcast_1_piece0 without replication took 2 ms
2019-04-02 14:37:29 INFO SparkContext:54 - Created broadcast 1 from broadcast at DAGScheduler.scala:1161
2019-04-02 14:37:29 INFO DAGScheduler:54 - Submitting 56 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[5] at map at package.scala:88) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
2019-04-02 14:37:29 INFO TaskSchedulerImpl:54 - Adding task set 0.0 with 56 tasks
2019-04-02 14:37:29 DEBUG TaskSetManager:58 - Epoch for TaskSet 0.0: 0
2019-04-02 14:37:29 DEBUG TaskSetManager:58 - Valid locality levels for TaskSet 0.0: NO_PREF, ANY
2019-04-02 14:37:29 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 0
2019-04-02 14:37:29 DEBUG TaskSetManager:58 - Valid locality levels for TaskSet 0.0: NO_PREF, ANY
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 0.0 in stage 0.0 (TID 0, localhost, executor driver, partition 0, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 1.0 in stage 0.0 (TID 1, localhost, executor driver, partition 1, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 2.0 in stage 0.0 (TID 2, localhost, executor driver, partition 2, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 3.0 in stage 0.0 (TID 3, localhost, executor driver, partition 3, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 4.0 in stage 0.0 (TID 4, localhost, executor driver, partition 4, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 5.0 in stage 0.0 (TID 5, localhost, executor driver, partition 5, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 6.0 in stage 0.0 (TID 6, localhost, executor driver, partition 6, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 7.0 in stage 0.0 (TID 7, localhost, executor driver, partition 7, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 8.0 in stage 0.0 (TID 8, localhost, executor driver, partition 8, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 9.0 in stage 0.0 (TID 9, localhost, executor driver, partition 9, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 10.0 in stage 0.0 (TID 10, localhost, executor driver, partition 10, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 11.0 in stage 0.0 (TID 11, localhost, executor driver, partition 11, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 12.0 in stage 0.0 (TID 12, localhost, executor driver, partition 12, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 13.0 in stage 0.0 (TID 13, localhost, executor driver, partition 13, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 14.0 in stage 0.0 (TID 14, localhost, executor driver, partition 14, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 15.0 in stage 0.0 (TID 15, localhost, executor driver, partition 15, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 16.0 in stage 0.0 (TID 16, localhost, executor driver, partition 16, PROCESS_LOCAL, 8039 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 17.0 in stage 0.0 (TID 17, localhost, executor driver, partition 17, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 18.0 in stage 0.0 (TID 18, localhost, executor driver, partition 18, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 19.0 in stage 0.0 (TID 19, localhost, executor driver, partition 19, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 20.0 in stage 0.0 (TID 20, localhost, executor driver, partition 20, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 21.0 in stage 0.0 (TID 21, localhost, executor driver, partition 21, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 22.0 in stage 0.0 (TID 22, localhost, executor driver, partition 22, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 23.0 in stage 0.0 (TID 23, localhost, executor driver, partition 23, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 24.0 in stage 0.0 (TID 24, localhost, executor driver, partition 24, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 25.0 in stage 0.0 (TID 25, localhost, executor driver, partition 25, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 26.0 in stage 0.0 (TID 26, localhost, executor driver, partition 26, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 27.0 in stage 0.0 (TID 27, localhost, executor driver, partition 27, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 28.0 in stage 0.0 (TID 28, localhost, executor driver, partition 28, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:29 INFO TaskSetManager:54 - Starting task 29.0 in stage 0.0 (TID 29, localhost, executor driver, partition 29, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:29 INFO Executor:54 - Running task 3.0 in stage 0.0 (TID 3)
2019-04-02 14:37:29 INFO Executor:54 - Running task 2.0 in stage 0.0 (TID 2)
2019-04-02 14:37:29 INFO Executor:54 - Running task 1.0 in stage 0.0 (TID 1)
2019-04-02 14:37:29 INFO Executor:54 - Running task 0.0 in stage 0.0 (TID 0)
2019-04-02 14:37:29 INFO Executor:54 - Running task 5.0 in stage 0.0 (TID 5)
2019-04-02 14:37:29 INFO Executor:54 - Running task 4.0 in stage 0.0 (TID 4)
2019-04-02 14:37:29 INFO Executor:54 - Running task 6.0 in stage 0.0 (TID 6)
2019-04-02 14:37:29 INFO Executor:54 - Running task 7.0 in stage 0.0 (TID 7)
2019-04-02 14:37:29 INFO Executor:54 - Running task 8.0 in stage 0.0 (TID 8)
2019-04-02 14:37:29 INFO Executor:54 - Running task 9.0 in stage 0.0 (TID 9)
2019-04-02 14:37:29 INFO Executor:54 - Running task 10.0 in stage 0.0 (TID 10)
2019-04-02 14:37:29 INFO Executor:54 - Running task 11.0 in stage 0.0 (TID 11)
2019-04-02 14:37:29 INFO Executor:54 - Running task 12.0 in stage 0.0 (TID 12)
2019-04-02 14:37:29 INFO Executor:54 - Running task 15.0 in stage 0.0 (TID 15)
2019-04-02 14:37:29 INFO Executor:54 - Running task 13.0 in stage 0.0 (TID 13)
2019-04-02 14:37:29 INFO Executor:54 - Running task 16.0 in stage 0.0 (TID 16)
2019-04-02 14:37:29 INFO Executor:54 - Running task 14.0 in stage 0.0 (TID 14)
2019-04-02 14:37:29 INFO Executor:54 - Running task 17.0 in stage 0.0 (TID 17)
2019-04-02 14:37:29 INFO Executor:54 - Running task 18.0 in stage 0.0 (TID 18)
2019-04-02 14:37:29 INFO Executor:54 - Running task 19.0 in stage 0.0 (TID 19)
2019-04-02 14:37:29 INFO Executor:54 - Running task 20.0 in stage 0.0 (TID 20)
2019-04-02 14:37:29 INFO Executor:54 - Running task 21.0 in stage 0.0 (TID 21)
2019-04-02 14:37:29 INFO Executor:54 - Running task 22.0 in stage 0.0 (TID 22)
2019-04-02 14:37:29 INFO Executor:54 - Running task 23.0 in stage 0.0 (TID 23)
2019-04-02 14:37:29 INFO Executor:54 - Running task 24.0 in stage 0.0 (TID 24)
2019-04-02 14:37:29 INFO Executor:54 - Running task 25.0 in stage 0.0 (TID 25)
2019-04-02 14:37:29 INFO Executor:54 - Running task 26.0 in stage 0.0 (TID 26)
2019-04-02 14:37:29 INFO Executor:54 - Running task 27.0 in stage 0.0 (TID 27)
2019-04-02 14:37:29 INFO Executor:54 - Running task 28.0 in stage 0.0 (TID 28)
2019-04-02 14:37:29 INFO Executor:54 - Running task 29.0 in stage 0.0 (TID 29)
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.jdom_jdom-2.0.2.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClientFactory:207 - Creating new connection to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 DEBUG AbstractByteBuf:81 - -Dio.netty.buffer.bytebuf.checkAccessible: true
2019-04-02 14:37:29 DEBUG ResourceLeakDetectorFactory:76 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@51ac808
2019-04-02 14:37:29 DEBUG TransportClientFactory:254 - Connection to tuna.cs.uwaterloo.ca/129.97.186.18:41497 successful, running bootstraps...
2019-04-02 14:37:29 INFO TransportClientFactory:267 - Successfully created connection to tuna.cs.uwaterloo.ca/129.97.186.18:41497 after 44 ms (0 ms spent in bootstraps)
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.jdom_jdom-2.0.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 DEBUG Recycler:76 - -Dio.netty.recycler.maxCapacityPerThread: 32768
2019-04-02 14:37:29 DEBUG Recycler:76 - -Dio.netty.recycler.maxSharedCapacityFactor: 2
2019-04-02 14:37:29 DEBUG Recycler:76 - -Dio.netty.recycler.linkCapacity: 16
2019-04-02 14:37:29 DEBUG Recycler:76 - -Dio.netty.recycler.ratio: 8
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.jdom_jdom-2.0.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1393061330960705000.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.jdom_jdom-2.0.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.stanford.nlp_stanford-corenlp-3.8.0.jar with timestamp 1554230245331
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/edu.stanford.nlp_stanford-corenlp-3.8.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.stanford.nlp_stanford-corenlp-3.8.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1158855494406267785.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/edu.stanford.nlp_stanford-corenlp-3.8.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.annotation_javax.annotation-api-1.2.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/javax.annotation_javax.annotation-api-1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.annotation_javax.annotation-api-1.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2147687399542780534.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.annotation_javax.annotation-api-1.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-3.13.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-3.13.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6950392885010937220.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.poi_poi-3.13.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-auth-2.6.5.jar with timestamp 1554230245333
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-auth-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-auth-2.6.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6114043423072896008.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.hadoop_hadoop-auth-2.6.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/tomcat_jasper-compiler-5.5.23.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/tomcat_jasper-compiler-5.5.23.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/tomcat_jasper-compiler-5.5.23.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6458513219003866876.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/tomcat_jasper-compiler-5.5.23.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.github.fommil.netlib_core-1.1.2.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.github.fommil.netlib_core-1.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.github.fommil.netlib_core-1.1.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6028126539592184371.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.github.fommil.netlib_core-1.1.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.chuusai_shapeless_2.11-2.3.2.jar with timestamp 1554230245331
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.chuusai_shapeless_2.11-2.3.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.chuusai_shapeless_2.11-2.3.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6872995720082487459.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.chuusai_shapeless_2.11-2.3.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.gagravarr_vorbis-java-core-0.6.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.gagravarr_vorbis-java-core-0.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.gagravarr_vorbis-java-core-0.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2013014448355185746.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.gagravarr_vorbis-java-core-0.6.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp947172606271988939.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sourceforge.jmatio_jmatio-1.0.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/net.sourceforge.jmatio_jmatio-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sourceforge.jmatio_jmatio-1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1090069176964701565.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.sourceforge.jmatio_jmatio-1.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/joda-time_joda-time-2.2.jar with timestamp 1554230245331
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/joda-time_joda-time-2.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/joda-time_joda-time-2.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2843045488804404264.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/joda-time_joda-time-2.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-core-1.9.jar with timestamp 1554230245333
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-core-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-core-1.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4904070435808769741.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.sun.jersey_jersey-core-1.9.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.opennlp_opennlp-tools-1.5.3.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.opennlp_opennlp-tools-1.5.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.opennlp_opennlp-tools-1.5.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8691481920089774366.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.opennlp_opennlp-tools-1.5.3.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.inject_guice-3.0.jar with timestamp 1554230245333
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.inject_guice-3.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.inject_guice-3.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2618649367397974219.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.google.inject_guice-3.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xml-apis_xml-apis-1.4.01.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/xml-apis_xml-apis-1.4.01.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xml-apis_xml-apis-1.4.01.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7089362131284086011.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/xml-apis_xml-apis-1.4.01.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.guava_guava-18.0.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.guava_guava-18.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.guava_guava-18.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6438527166002018619.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.google.guava_guava-18.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-lang3-3.3.1.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-lang3-3.3.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-lang3-3.3.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6423702314949569580.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.commons_commons-lang3-3.3.1.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.bouncycastle_bcmail-jdk15on-1.52.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.bouncycastle_bcmail-jdk15on-1.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.bouncycastle_bcmail-jdk15on-1.52.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5764084120626919656.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.bouncycastle_bcmail-jdk15on-1.52.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/junit_junit-4.8.2.jar with timestamp 1554230245331
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/junit_junit-4.8.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/junit_junit-4.8.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5645462784338024968.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/junit_junit-4.8.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6297886891006214651.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_slf4j-api-1.7.24.jar with timestamp 1554230245332
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_slf4j-api-1.7.24.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_slf4j-api-1.7.24.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7055856013679443186.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.slf4j_slf4j-api-1.7.24.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.tukaani_xz-1.5.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.tukaani_xz-1.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.tukaani_xz-1.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6413685806214942101.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.tukaani_xz-1.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.servlet.jsp_jsp-api-2.1.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/javax.servlet.jsp_jsp-api-2.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.servlet.jsp_jsp-api-2.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7505796129012607165.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.servlet.jsp_jsp-api-2.1.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.james_apache-mime4j-dom-0.7.2.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.james_apache-mime4j-dom-0.7.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.james_apache-mime4j-dom-0.7.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8310614008061292514.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.james_apache-mime4j-dom-0.7.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.xml.bind_jaxb-api-2.2.7.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/javax.xml.bind_jaxb-api-2.2.7.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.xml.bind_jaxb-api-2.2.7.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp9045482704769824739.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.xml.bind_jaxb-api-2.2.7.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.plexus_plexus-utils-1.5.6.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.plexus_plexus-utils-1.5.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.plexus_plexus-utils-1.5.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2475851776076814560.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.plexus_plexus-utils-1.5.6.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xmlenc_xmlenc-0.52.jar with timestamp 1554230245333
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/xmlenc_xmlenc-0.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xmlenc_xmlenc-0.52.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5889241988284713169.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/xmlenc_xmlenc-0.52.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-scratchpad-3.13.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-scratchpad-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-scratchpad-3.13.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3045669789059263607.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.poi_poi-scratchpad-3.13.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.pdfbox_jempbox-1.8.10.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.pdfbox_jempbox-1.8.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.pdfbox_jempbox-1.8.10.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4275219131232049650.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.pdfbox_jempbox-1.8.10.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.storage_sis-storage-0.5.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.storage_sis-storage-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.storage_sis-storage-0.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4940271723840473473.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.sis.storage_sis-storage-0.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar with timestamp 1554230245333
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8878874520765693923.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.objenesis_objenesis-2.6.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.objenesis_objenesis-2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.objenesis_objenesis-2.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7488962265264278218.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.objenesis_objenesis-2.6.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scala-reflect-2.11.8.jar with timestamp 1554230245332
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scala-reflect-2.11.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scala-reflect-2.11.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5389109883224711379.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scala-lang_scala-reflect-2.11.8.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.httpcomponents_httpclient-4.2.6.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.httpcomponents_httpclient-4.2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.httpcomponents_httpclient-4.2.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4361920785173093167.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.httpcomponents_httpclient-4.2.6.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.json-simple_json-simple-1.1.1.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.json-simple_json-simple-1.1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.json-simple_json-simple-1.1.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp531764329481958417.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.googlecode.json-simple_json-simple-1.1.1.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xalan_xalan-2.7.0.jar with timestamp 1554230245335
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/xalan_xalan-2.7.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xalan_xalan-2.7.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7312678560803769919.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/xalan_xalan-2.7.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.api_api-util-1.0.0-M20.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.api_api-util-1.0.0-M20.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.api_api-util-1.0.0-M20.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1232537878637296600.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.directory.api_api-util-1.0.0-M20.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-collections_commons-collections-3.2.2.jar with timestamp 1554230245333
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/commons-collections_commons-collections-3.2.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-collections_commons-collections-3.2.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8320097451601156772.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-collections_commons-collections-3.2.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.jsoup_jsoup-1.7.3.jar with timestamp 1554230245331
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.jsoup_jsoup-1.7.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.jsoup_jsoup-1.7.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8920144348152398472.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.jsoup_jsoup-1.7.3.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xerces_xercesImpl-2.11.0.jar with timestamp 1554230245331
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/xerces_xercesImpl-2.11.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/xerces_xercesImpl-2.11.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7191003712045008215.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/xerces_xercesImpl-2.11.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_slf4j-log4j12-1.7.5.jar with timestamp 1554230245332
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_slf4j-log4j12-1.7.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_slf4j-log4j12-1.7.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp425186030720227379.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.slf4j_slf4j-log4j12-1.7.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/log4j_log4j-1.2.17.jar with timestamp 1554230245333
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/log4j_log4j-1.2.17.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/log4j_log4j-1.2.17.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3111418250512389124.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/log4j_log4j-1.2.17.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.esotericsoftware_minlog-1.3.0.jar with timestamp 1554230245332
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.esotericsoftware_minlog-1.3.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.esotericsoftware_minlog-1.3.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5234514426766106783.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.esotericsoftware_minlog-1.3.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.adobe.xmp_xmpcore-5.1.2.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.adobe.xmp_xmpcore-5.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.adobe.xmp_xmpcore-5.1.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4201709486989100643.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.adobe.xmp_xmpcore-5.1.2.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar with timestamp 1554230245331
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp637407565650731134.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.woodstox_stax2-api-3.1.4.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.woodstox_stax2-api-3.1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.woodstox_stax2-api-3.1.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8666572756731919129.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.woodstox_stax2-api-3.1.4.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-vfs2-2.0.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-vfs2-2.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-vfs2-2.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3063720898430624675.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.commons_commons-vfs2-2.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.spire-math_spire_2.11-0.13.0.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.spire-math_spire_2.11-0.13.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.spire-math_spire_2.11-0.13.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2862345302003386545.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.spire-math_spire_2.11-0.13.0.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.httpcomponents_httpmime-4.2.6.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.httpcomponents_httpmime-4.2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.httpcomponents_httpmime-4.2.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp9003681190364091307.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.httpcomponents_httpmime-4.2.6.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/regexp_regexp-1.3.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/regexp_regexp-1.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/regexp_regexp-1.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8794506286313125471.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/regexp_regexp-1.3.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-annotations-2.6.5.jar with timestamp 1554230245332
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-annotations-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-annotations-2.6.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3897647318314931000.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.hadoop_hadoop-annotations-2.6.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_httpservices-4.5.5.jar with timestamp 1554230245336
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_httpservices-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_httpservices-4.5.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1758291173669430361.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/edu.ucar_httpservices-4.5.5.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.htrace_htrace-core-3.0.4.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.htrace_htrace-core-3.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.htrace_htrace-core-3.0.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6300446378366025623.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.htrace_htrace-core-3.0.4.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.martiansoftware_jsap-2.1.jar with timestamp 1554230245334
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/com.martiansoftware_jsap-2.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.martiansoftware_jsap-2.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4488042120657292346.tmp
2019-04-02 14:37:29 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.martiansoftware_jsap-2.1.jar to class loader
2019-04-02 14:37:29 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.quartz-scheduler_quartz-2.2.0.jar with timestamp 1554230245337
2019-04-02 14:37:29 DEBUG TransportClient:167 - Sending stream request for /jars/org.quartz-scheduler_quartz-2.2.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:29 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.quartz-scheduler_quartz-2.2.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3042955491353529048.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.quartz-scheduler_quartz-2.2.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4745654527337511186.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.servlet_servlet-api-2.5.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/javax.servlet_servlet-api-2.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.servlet_servlet-api-2.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5267146812389327253.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.servlet_servlet-api-2.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.core_jackson-core-2.8.8.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.core_jackson-core-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.core_jackson-core-2.8.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8682201710020455399.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.fasterxml.jackson.core_jackson-core-2.8.8.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-json-1.9.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-json-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-json-1.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7317734131517493482.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.sun.jersey_jersey-json-1.9.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/io.archivesunleashed_aut-0.17.0.jar with timestamp 1554230245330
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/io.archivesunleashed_aut-0.17.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/io.archivesunleashed_aut-0.17.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7061627621738479004.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/io.archivesunleashed_aut-0.17.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.glassfish_javax.json-1.0.4.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.glassfish_javax.json-1.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.glassfish_javax.json-1.0.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3482224520413067315.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.glassfish_javax.json-1.0.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_jcl-over-slf4j-1.7.24.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_jcl-over-slf4j-1.7.24.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_jcl-over-slf4j-1.7.24.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8600312747965868853.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.slf4j_jcl-over-slf4j-1.7.24.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-core-4.10.3.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-core-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-core-4.10.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6196777809944277305.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.lucene_lucene-core-4.10.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/tl.lin_lintools-datatypes-1.0.0.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/tl.lin_lintools-datatypes-1.0.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/tl.lin_lintools-datatypes-1.0.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5102642214131087023.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/tl.lin_lintools-datatypes-1.0.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.opennlp_opennlp-maxent-3.0.3.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.opennlp_opennlp-maxent-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.opennlp_opennlp-maxent-3.0.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4924305468344796583.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.opennlp_opennlp-maxent-3.0.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1583795333121974026.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.inject.extensions_guice-servlet-3.0.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.inject.extensions_guice-servlet-3.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.inject.extensions_guice-servlet-3.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6564552665179794887.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.google.inject.extensions_guice-servlet-3.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3406418619542709958.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5497099069016916799.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-logging_commons-logging-api-1.1.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/commons-logging_commons-logging-api-1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-logging_commons-logging-api-1.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2146246917942612625.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-logging_commons-logging-api-1.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-server-1.9.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-server-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-server-1.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7796665070513111414.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.sun.jersey_jersey-server-1.9.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.twitter_chill-java-0.8.4.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.twitter_chill-java-0.8.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.twitter_chill-java-0.8.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1132689801944461853.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.twitter_chill-java-0.8.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-lang_commons-lang-2.6.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/commons-lang_commons-lang-2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-lang_commons-lang-2.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4721582546184221610.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-lang_commons-lang-2.6.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp250830122107834164.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.java.dev.jna_jna-4.1.0.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/net.java.dev.jna_jna-4.1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.java.dev.jna_jna-4.1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4089491861527999794.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.java.dev.jna_jna-4.1.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.zookeeper_zookeeper-3.4.6.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.zookeeper_zookeeper-3.4.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.zookeeper_zookeeper-3.4.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp135597780512163040.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.zookeeper_zookeeper-3.4.6.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5083291126040915178.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codelibs_jhighlight-1.0.2.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.codelibs_jhighlight-1.0.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codelibs_jhighlight-1.0.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3520116690031168036.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codelibs_jhighlight-1.0.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scala-compiler-2.11.0.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scala-compiler-2.11.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scala-compiler-2.11.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp59195639260124477.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scala-lang_scala-compiler-2.11.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.core_sis-metadata-0.5.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.core_sis-metadata-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.core_sis-metadata-0.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7931195600694268386.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.sis.core_sis-metadata-0.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json4s_json4s-jackson_2.11-3.2.11.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.json4s_json4s-jackson_2.11-3.2.11.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json4s_json4s-jackson_2.11-3.2.11.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1767789817311723609.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.json4s_json4s-jackson_2.11-3.2.11.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey.contribs_jersey-guice-1.9.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey.contribs_jersey-guice-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey.contribs_jersey-guice-1.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8506609908820585809.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.sun.jersey.contribs_jersey-guice-1.9.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-ooxml-3.13.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-ooxml-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-ooxml-3.13.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4938681816638217416.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.poi_poi-ooxml-3.13.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.james_apache-mime4j-core-0.7.2.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.james_apache-mime4j-core-0.7.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.james_apache-mime4j-core-0.7.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5095048810225643960.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.james_apache-mime4j-core-0.7.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.beust_jcommander-1.35.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.beust_jcommander-1.35.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.beust_jcommander-1.35.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2520415210183203020.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.beust_jcommander-1.35.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.twitter_chill_2.11-0.8.4.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.twitter_chill_2.11-0.8.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.twitter_chill_2.11-0.8.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3480363133727940168.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.twitter_chill_2.11-0.8.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_grib-4.5.5.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_grib-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_grib-4.5.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5131889544790791635.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/edu.ucar_grib-4.5.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.thoughtworks.paranamer_paranamer-2.8.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.thoughtworks.paranamer_paranamer-2.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.thoughtworks.paranamer_paranamer-2.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4512442785111371360.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.thoughtworks.paranamer_paranamer-2.8.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.jcip_jcip-annotations-1.0.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/net.jcip_jcip-annotations-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.jcip_jcip-annotations-1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4873446349206813655.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.jcip_jcip-annotations-1.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-csv-1.0.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-csv-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-csv-1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6395345838663971937.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.commons_commons-csv-1.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp175276060662406467.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.github.junrar_junrar-0.7.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.github.junrar_junrar-0.7.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.github.junrar_junrar-0.7.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6399093594329048571.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.github.junrar_junrar-0.7.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scalap-2.11.0.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scalap-2.11.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scalap-2.11.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8179533729881734066.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scala-lang_scalap-2.11.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/io.netty_netty-3.6.2.Final.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/io.netty_netty-3.6.2.Final.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/io.netty_netty-3.6.2.Final.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8881549775487467786.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/io.netty_netty-3.6.2.Final.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-math3-3.2.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-math3-3.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-math3-3.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4530347887194057128.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.commons_commons-math3-3.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-analyzers-common-4.10.3.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-analyzers-common-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-analyzers-common-4.10.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8957702380099306367.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.lucene_lucene-analyzers-common-4.10.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/c3p0_c3p0-0.9.1.1.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/c3p0_c3p0-0.9.1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/c3p0_c3p0-0.9.1.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2372597564543224133.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/c3p0_c3p0-0.9.1.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.java.dev.jets3t_jets3t-0.6.1.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/net.java.dev.jets3t_jets3t-0.6.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.java.dev.jets3t_jets3t-0.6.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5546069827555989331.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.java.dev.jets3t_jets3t-0.6.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-common-2.6.5.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-common-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.hadoop_hadoop-common-2.6.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp9105510298083311709.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.hadoop_hadoop-common-2.6.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.tika_tika-core-1.12.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.tika_tika-core-1.12.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.tika_tika-core-1.12.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5821261653627402829.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.tika_tika-core-1.12.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.maven.scm_maven-scm-api-1.4.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.maven.scm_maven-scm-api-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.maven.scm_maven-scm-api-1.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8224398303301229123.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.maven.scm_maven-scm-api-1.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-queryparser-4.10.3.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-queryparser-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-queryparser-4.10.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp502729056483590186.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.lucene_lucene-queryparser-4.10.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.itadaki_bzip2-0.9.1.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.itadaki_bzip2-0.9.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.itadaki_bzip2-0.9.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5401444646138440196.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.itadaki_bzip2-0.9.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7423409466087596457.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.rometools_rome-utils-1.5.1.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.rometools_rome-utils-1.5.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.rometools_rome-utils-1.5.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6678597935258934497.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.rometools_rome-utils-1.5.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-compress-1.16.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-compress-1.16.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-compress-1.16.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8561423273486717202.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.commons_commons-compress-1.16.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-configuration_commons-configuration-1.8.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/commons-configuration_commons-configuration-1.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-configuration_commons-configuration-1.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5064171969699074112.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-configuration_commons-configuration-1.8.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2995136971863500486.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.ws.rs_javax.ws.rs-api-2.0.1.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/javax.ws.rs_javax.ws.rs-api-2.0.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.ws.rs_javax.ws.rs-api-2.0.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2688167162485528043.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.ws.rs_javax.ws.rs-api-2.0.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp9163043133279599649.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5628876067430368497.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.xerial.snappy_snappy-java-1.1.4.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.xerial.snappy_snappy-java-1.1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.xerial.snappy_snappy-java-1.1.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8633747949523463980.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.xerial.snappy_snappy-java-1.1.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/de.jollyday_jollyday-0.4.9.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/de.jollyday_jollyday-0.4.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/de.jollyday_jollyday-0.4.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp9151648697888641462.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/de.jollyday_jollyday-0.4.9.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1456154245971211576.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.github.rwl_jtransforms-2.4.0.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.github.rwl_jtransforms-2.4.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.github.rwl_jtransforms-2.4.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3601906107867270654.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.github.rwl_jtransforms-2.4.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2704804305111685509.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jettison_jettison-1.1.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jettison_jettison-1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jettison_jettison-1.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6076651421249915943.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.jettison_jettison-1.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.core_sis-referencing-0.5.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.core_sis-referencing-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.core_sis-referencing-0.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8759219444076890320.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.sis.core_sis-referencing-0.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.storage_sis-netcdf-0.5.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.storage_sis-netcdf-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.storage_sis-netcdf-0.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1897354116225077605.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.sis.storage_sis-netcdf-0.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.code.findbugs_jsr305-1.3.9.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.code.findbugs_jsr305-1.3.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.code.findbugs_jsr305-1.3.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3146679813728555974.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.google.code.findbugs_jsr305-1.3.9.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/aopalliance_aopalliance-1.0.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/aopalliance_aopalliance-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/aopalliance_aopalliance-1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp149349909363763542.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/aopalliance_aopalliance-1.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-queries-4.10.3.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-queries-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-queries-4.10.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4065291762749848258.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.lucene_lucene-queries-4.10.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json4s_json4s-ast_2.11-3.2.11.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.json4s_json4s-ast_2.11-3.2.11.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json4s_json4s-ast_2.11-3.2.11.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp781089938955362918.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.json4s_json4s-ast_2.11-3.2.11.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.bouncycastle_bcpkix-jdk15on-1.52.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.bouncycastle_bcpkix-jdk15on-1.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.bouncycastle_bcpkix-jdk15on-1.52.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8904417908486205710.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.bouncycastle_bcpkix-jdk15on-1.52.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3691930173853549891.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp350509378825562385.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-cli_commons-cli-1.2.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/commons-cli_commons-cli-1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-cli_commons-cli-1.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8863145384128192805.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-cli_commons-cli-1.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2186534901701990754.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.spire-math_spire-macros_2.11-0.13.0.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.spire-math_spire-macros_2.11-0.13.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.spire-math_spire-macros_2.11-0.13.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp185026757480501743.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.spire-math_spire-macros_2.11-0.13.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_jul-to-slf4j-1.7.24.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_jul-to-slf4j-1.7.24.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.slf4j_jul-to-slf4j-1.7.24.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp888076485497849770.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.slf4j_jul-to-slf4j-1.7.24.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3959466179931323327.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.httpcomponents_httpcore-4.3.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.httpcomponents_httpcore-4.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.httpcomponents_httpcore-4.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4826856456729107376.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.httpcomponents_httpcore-4.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scalanlp_breeze_2.11-0.13.1.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.scalanlp_breeze_2.11-0.13.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scalanlp_breeze_2.11-0.13.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6652096970418546557.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scalanlp_breeze_2.11-0.13.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.jdom_jdom2-2.0.4.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.jdom_jdom2-2.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.jdom_jdom2-2.0.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6482188787919798254.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.jdom_jdom2-2.0.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-core-asl-1.9.13.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-core-asl-1.9.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-core-asl-1.9.13.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp134778698106281384.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.jackson_jackson-core-asl-1.9.13.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.jcraft_jsch-0.1.42.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.jcraft_jsch-0.1.42.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.jcraft_jsch-0.1.42.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7795215563658787416.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.jcraft_jsch-0.1.42.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.rogach_scallop_2.11-3.1.2.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.rogach_scallop_2.11-3.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.rogach_scallop_2.11-3.1.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5909517372531761477.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.rogach_scallop_2.11-3.1.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.gnu.inet_libidn-1.15.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.gnu.inet_libidn-1.15.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.gnu.inet_libidn-1.15.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7079551021139480115.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.gnu.inet_libidn-1.15.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-xc-1.9.13.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-xc-1.9.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-xc-1.9.13.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8031069708097697500.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.jackson_jackson-xc-1.9.13.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/jline_jline-0.9.94.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/jline_jline-0.9.94.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/jline_jline-0.9.94.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp473732733632435698.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/jline_jline-0.9.94.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.servlet_javax.servlet-api-3.0.1.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/javax.servlet_javax.servlet-api-3.0.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.servlet_javax.servlet-api-3.0.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3868009917268592519.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.servlet_javax.servlet-api-3.0.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.curator_curator-client-2.6.0.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.curator_curator-client-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.curator_curator-client-2.6.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6409500154602461617.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.curator_curator-client-2.6.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.curator_curator-recipes-2.6.0.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.curator_curator-recipes-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.curator_curator-recipes-2.6.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7377578662346210658.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.curator_curator-recipes-2.6.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-exec-1.3.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-exec-1.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.commons_commons-exec-1.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4682223395806573723.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.commons_commons-exec-1.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/tomcat_jasper-runtime-5.5.23.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/tomcat_jasper-runtime-5.5.23.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/tomcat_jasper-runtime-5.5.23.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6545739182462049840.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/tomcat_jasper-runtime-5.5.23.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.pff_java-libpst-0.8.1.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.pff_java-libpst-0.8.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.pff_java-libpst-0.8.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp9038871538807220167.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.pff_java-libpst-0.8.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_udunits-4.5.5.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_udunits-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_udunits-4.5.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3660847769269677821.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/edu.ucar_udunits-4.5.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/it.unimi.dsi_dsiutils-2.0.12.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/it.unimi.dsi_dsiutils-2.0.12.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/it.unimi.dsi_dsiutils-2.0.12.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6251993084745519857.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/it.unimi.dsi_dsiutils-2.0.12.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.measure_jsr-275-0.9.3.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/javax.measure_jsr-275-0.9.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.measure_jsr-275-0.9.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6881517264629263182.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.measure_jsr-275-0.9.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.inject_javax.inject-1.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/javax.inject_javax.inject-1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/javax.inject_javax.inject-1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp445324368782936496.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/javax.inject_javax.inject-1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sf.jwordnet_jwnl-1.3.3.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/net.sf.jwordnet_jwnl-1.3.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sf.jwordnet_jwnl-1.3.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4439883598936221607.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.sf.jwordnet_jwnl-1.3.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json_json-20140107.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.json_json-20140107.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json_json-20140107.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4530294136401773586.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.json_json-20140107.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-net_commons-net-1.4.1.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/commons-net_commons-net-1.4.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-net_commons-net-1.4.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3080961895767359873.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-net_commons-net-1.4.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-io_commons-io-2.4.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/commons-io_commons-io-2.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-io_commons-io-2.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3400445044091769924.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-io_commons-io-2.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.pdfbox_fontbox-1.8.10.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.pdfbox_fontbox-1.8.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.pdfbox_fontbox-1.8.10.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2023756714247449190.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.pdfbox_fontbox-1.8.10.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-core-3.0.3.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-core-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.cxf_cxf-core-3.0.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2751727158171555104.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.cxf_cxf-core-3.0.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.protobuf_protobuf-java-3.2.0.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.protobuf_protobuf-java-3.2.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.protobuf_protobuf-java-3.2.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5397118027836694257.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.google.protobuf_protobuf-java-3.2.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.io7m.xom_xom-1.2.10.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.io7m.xom_xom-1.2.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.io7m.xom_xom-1.2.10.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1456173142083730969.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.io7m.xom_xom-1.2.10.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7131509542007124352.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/asm_asm-3.2.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/asm_asm-3.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/asm_asm-3.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6752901790432931201.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/asm_asm-3.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.gagravarr_vorbis-java-tika-0.6.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.gagravarr_vorbis-java-tika-0.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.gagravarr_vorbis-java-tika-0.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp3502761664922042226.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.gagravarr_vorbis-java-tika-0.6.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5464335012975415293.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/oro_oro-2.0.8.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/oro_oro-2.0.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/oro_oro-2.0.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1453902408749589226.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/oro_oro-2.0.8.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.curator_curator-framework-2.6.0.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.curator_curator-framework-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.curator_curator-framework-2.6.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp418973925834948698.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.curator_curator-framework-2.6.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sf.ehcache_ehcache-core-2.6.2.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/net.sf.ehcache_ehcache-core-2.6.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sf.ehcache_ehcache-core-2.6.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4016112326430818733.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.sf.ehcache_ehcache-core-2.6.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sf.opencsv_opencsv-2.3.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/net.sf.opencsv_opencsv-2.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sf.opencsv_opencsv-2.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7371458137311182790.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.sf.opencsv_opencsv-2.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_jj2000-5.2.jar with timestamp 1554230245337
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_jj2000-5.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_jj2000-5.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6087400604369040507.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/edu.ucar_jj2000-5.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-ooxml-schemas-3.13.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-ooxml-schemas-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.poi_poi-ooxml-schemas-3.13.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8552721558680847965.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.poi_poi-ooxml-schemas-3.13.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.htmlparser_htmlparser-1.6.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.htmlparser_htmlparser-1.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.htmlparser_htmlparser-1.6.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1823846873174856240.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.htmlparser_htmlparser-1.6.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5946344846176015743.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_netcdf4-4.5.5.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_netcdf4-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_netcdf4-4.5.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2539960639547980025.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/edu.ucar_netcdf4-4.5.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-logging_commons-logging-1.1.3.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/commons-logging_commons-logging-1.1.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-logging_commons-logging-1.1.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp134024189819819958.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-logging_commons-logging-1.1.3.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.pdfbox_pdfbox-1.8.10.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.pdfbox_pdfbox-1.8.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.pdfbox_pdfbox-1.8.10.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5184613841637292832.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.pdfbox_pdfbox-1.8.10.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.bouncycastle_bcprov-jdk15on-1.52.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.bouncycastle_bcprov-jdk15on-1.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.bouncycastle_bcprov-jdk15on-1.52.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1210537449597244091.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.bouncycastle_bcprov-jdk15on-1.52.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.xmlbeans_xmlbeans-2.6.0.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.xmlbeans_xmlbeans-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.xmlbeans_xmlbeans-2.6.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6453710998013293551.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.xmlbeans_xmlbeans-2.6.0.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.healthmarketscience.jackcess_jackcess-2.1.2.jar with timestamp 1554230245335
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.healthmarketscience.jackcess_jackcess-2.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.healthmarketscience.jackcess_jackcess-2.1.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp5315823357750634350.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.healthmarketscience.jackcess_jackcess-2.1.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json4s_json4s-core_2.11-3.2.11.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.json4s_json4s-core_2.11-3.2.11.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.json4s_json4s-core_2.11-3.2.11.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp4716431632873836910.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.json4s_json4s-core_2.11-3.2.11.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scalanlp_breeze-macros_2.11-0.13.1.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.scalanlp_breeze-macros_2.11-0.13.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scalanlp_breeze-macros_2.11-0.13.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8794977482142767207.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scalanlp_breeze-macros_2.11-0.13.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_cdm-4.5.5.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_cdm-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/edu.ucar_cdm-4.5.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7710343068635969608.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/edu.ucar_cdm-4.5.5.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.code.gson_gson-2.3.1.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.code.gson_gson-2.3.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.google.code.gson_gson-2.3.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6580977508896423116.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.google.code.gson_gson-2.3.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.netpreserve.commons_webarchive-commons-1.1.8.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.netpreserve.commons_webarchive-commons-1.1.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.netpreserve.commons_webarchive-commons-1.1.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2408092325363709757.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.netpreserve.commons_webarchive-commons-1.1.8.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.mortbay.jetty_jetty-6.1.26.jar with timestamp 1554230245333
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.mortbay.jetty_jetty-6.1.26.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.mortbay.jetty_jetty-6.1.26.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1392421869791642065.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.mortbay.jetty_jetty-6.1.26.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.syncthemall_boilerpipe-1.2.2.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/com.syncthemall_boilerpipe-1.2.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.syncthemall_boilerpipe-1.2.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2285925852333522529.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.syncthemall_boilerpipe-1.2.2.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.tika_tika-parsers-1.12.jar with timestamp 1554230245331
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.tika_tika-parsers-1.12.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.tika_tika-parsers-1.12.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2042750013217508929.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.tika_tika-parsers-1.12.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.avro_avro-1.7.4.jar with timestamp 1554230245332
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.avro_avro-1.7.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.avro_avro-1.7.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7397017421276612014.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.avro_avro-1.7.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.ow2.asm_asm-5.0.4.jar with timestamp 1554230245336
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.ow2.asm_asm-5.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.ow2.asm_asm-5.0.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8156847450720715264.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.ow2.asm_asm-5.0.4.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.typelevel_machinist_2.11-0.6.1.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/org.typelevel_machinist_2.11-0.6.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.typelevel_machinist_2.11-0.6.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7524118328636178725.tmp
2019-04-02 14:37:30 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.typelevel_machinist_2.11-0.6.1.jar to class loader
2019-04-02 14:37:30 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/it.unimi.dsi_fastutil-6.5.2.jar with timestamp 1554230245334
2019-04-02 14:37:30 DEBUG TransportClient:167 - Sending stream request for /jars/it.unimi.dsi_fastutil-6.5.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:30 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/it.unimi.dsi_fastutil-6.5.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp924632983644956699.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/it.unimi.dsi_fastutil-6.5.2.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.aspectj_aspectjrt-1.8.0.jar with timestamp 1554230245336
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/org.aspectj_aspectjrt-1.8.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.aspectj_aspectjrt-1.8.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1627531345486670409.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.aspectj_aspectjrt-1.8.0.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-el_commons-el-1.0.jar with timestamp 1554230245334
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/commons-el_commons-el-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-el_commons-el-1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7747089667130586618.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-el_commons-el-1.0.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar with timestamp 1554230245332
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp6357614309566572734.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar with timestamp 1554230245331
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7927657642449443539.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-httpclient_commons-httpclient-3.1.jar with timestamp 1554230245333
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/commons-httpclient_commons-httpclient-3.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-httpclient_commons-httpclient-3.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2754739533370138939.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-httpclient_commons-httpclient-3.1.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.rometools_rome-1.5.1.jar with timestamp 1554230245336
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.rometools_rome-1.5.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.rometools_rome-1.5.1.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8906506813695598691.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.rometools_rome-1.5.1.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.mp4parser_isoparser-1.0.2.jar with timestamp 1554230245336
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.mp4parser_isoparser-1.0.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.googlecode.mp4parser_isoparser-1.0.2.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7024013872891225912.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.googlecode.mp4parser_isoparser-1.0.2.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.drewnoakes_metadata-extractor-2.8.0.jar with timestamp 1554230245336
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.drewnoakes_metadata-extractor-2.8.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.drewnoakes_metadata-extractor-2.8.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2677201886934307657.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.drewnoakes_metadata-extractor-2.8.0.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-client-1.9.jar with timestamp 1554230245333
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-client-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.sun.jersey_jersey-client-1.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7450208496022214610.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.sun.jersey_jersey-client-1.9.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.mortbay.jetty_jetty-util-6.1.26.jar with timestamp 1554230245333
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/org.mortbay.jetty_jetty-util-6.1.26.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.mortbay.jetty_jetty-util-6.1.26.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp773555409727428824.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.mortbay.jetty_jetty-util-6.1.26.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.apple_AppleJavaExtensions-1.4.jar with timestamp 1554230245334
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.apple_AppleJavaExtensions-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.apple_AppleJavaExtensions-1.4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1966248648327424661.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.apple_AppleJavaExtensions-1.4.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.core_sis-utility-0.5.jar with timestamp 1554230245336
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.core_sis-utility-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.sis.core_sis-utility-0.5.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7468434010297081762.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.sis.core_sis-utility-0.5.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-codec_commons-codec-1.9.jar with timestamp 1554230245335
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/commons-codec_commons-codec-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/commons-codec_commons-codec-1.9.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp698539289215982047.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/commons-codec_commons-codec-1.9.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/de.l3s.boilerpipe_boilerpipe-1.1.0.jar with timestamp 1554230245336
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/de.l3s.boilerpipe_boilerpipe-1.1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/de.l3s.boilerpipe_boilerpipe-1.1.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp8234697371720730093.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/de.l3s.boilerpipe_boilerpipe-1.1.0.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.opengis_geoapi-3.0.0.jar with timestamp 1554230245336
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/org.opengis_geoapi-3.0.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.opengis_geoapi-3.0.0.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp841366007108622518.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.opengis_geoapi-3.0.0.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-sandbox-4.10.3.jar with timestamp 1554230245335
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-sandbox-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.apache.lucene_lucene-sandbox-4.10.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp1448371005016060683.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.apache.lucene_lucene-sandbox-4.10.3.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar with timestamp 1554230245332
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7505529488884293887.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sourceforge.nekohtml_nekohtml-1.9.20.jar with timestamp 1554230245337
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/net.sourceforge.nekohtml_nekohtml-1.9.20.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/net.sourceforge.nekohtml_nekohtml-1.9.20.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2853344524708779807.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/net.sourceforge.nekohtml_nekohtml-1.9.20.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.esotericsoftware_kryo-shaded-3.0.3.jar with timestamp 1554230245332
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/com.esotericsoftware_kryo-shaded-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/com.esotericsoftware_kryo-shaded-3.0.3.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp7284079755753955879.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/com.esotericsoftware_kryo-shaded-3.0.3.jar to class loader
2019-04-02 14:37:31 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar with timestamp 1554230245331
2019-04-02 14:37:31 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:41497
2019-04-02 14:37:31 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:41497/jars/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar to /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/fetchFileTemp2753722416113579675.tmp
2019-04-02 14:37:31 INFO Executor:54 - Adding file:/tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/userFiles-272845ba-1d62-4c07-a968-9ab0a95ee1be/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar to class loader
2019-04-02 14:37:31 DEBUG BlockManager:58 - Getting local block broadcast_1
2019-04-02 14:37:31 DEBUG BlockManager:58 - Level for block broadcast_1 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB687252-20181005200930364-00000-h3.warc.gz:0+5328721
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB681002-20180914130714940-00000.warc.gz:0+11103439
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB735843-20190208133412633-00000-h3.warc.gz:0+827547
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799567-20190110143800722-00000-h3.warc.gz:0+9782
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828213808501-00016.warc.gz:0+1802220796
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB686465-20181002195728459-00000-h3.warc.gz:0+4888809
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB736590-20190211125528746-00000-h3.warc.gz:0+486861
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799561-20190110143759762-00000-h3.warc.gz:0+1199526476
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB681536-20180917155801439-00001.warc.gz:0+942310743
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828213423418-00015.warc.gz:0+1704174998
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828214311760-00017.warc.gz:0+2691532705
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB731325-20190123215103588-00000-h3.warc.gz:0+3489865
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB736980-20190212171926565-00000-h3.warc.gz:0+65799
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828192900124-00001.warc.gz:0+1000119953
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB686320-20181002171615063-00000-h3.warc.gz:0+6944873
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799564-20190110143759592-00000-h3.warc.gz:0+1000093057
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828212809324-00013.warc.gz:0+1283388473
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828194521735-00003.warc.gz:0+1225897961
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB735381-20190207122151467-00000-h3.warc.gz:0+2544947
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828212452798-00012.warc.gz:0+1202615318
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828195153288-00005.warc.gz:0+1029672488
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB708304-20181106184510611-00000-h3.warc.gz:0+4299269
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828212222750-00011.warc.gz:0+1149972113
2019-04-02 14:37:31 DEBUG BlockManager:58 - Getting local block broadcast_0
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828223017199-00020.warc.gz:0+1337641180
2019-04-02 14:37:31 DEBUG BlockManager:58 - Level for block broadcast_0 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799568-20190110164617521-00001-h3.warc.gz:0+594609693
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828202533622-00007.warc.gz:0+3047861372
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828211602861-00009.warc.gz:0+1392155257
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828191514724-00000.warc.gz:0+1025178052
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799568-20190110143759680-00000-h3.warc.gz:0+1008432521
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799564-20190110161932917-00001-h3.warc.gz:0+417902048
2019-04-02 14:37:31 DEBUG TaskMemoryManager:233 - Task 27 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@55a12b2a
2019-04-02 14:37:31 DEBUG TaskMemoryManager:233 - Task 28 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@733b32b7
2019-04-02 14:37:31 INFO Executor:54 - Finished task 27.0 in stage 0.0 (TID 27). 1104 bytes result sent to driver
2019-04-02 14:37:31 INFO Executor:54 - Finished task 28.0 in stage 0.0 (TID 28). 1104 bytes result sent to driver
2019-04-02 14:37:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:31 INFO TaskSetManager:54 - Starting task 30.0 in stage 0.0 (TID 30, localhost, executor driver, partition 30, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:31 INFO Executor:54 - Running task 30.0 in stage 0.0 (TID 30)
2019-04-02 14:37:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:31 INFO TaskSetManager:54 - Starting task 31.0 in stage 0.0 (TID 31, localhost, executor driver, partition 31, PROCESS_LOCAL, 8039 bytes)
2019-04-02 14:37:31 INFO Executor:54 - Running task 31.0 in stage 0.0 (TID 31)
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828193814594-00002.warc.gz:0+1375687319
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB681660-20180917193617860-00000.warc.gz:0+160990920
2019-04-02 14:37:31 INFO TaskSetManager:54 - Finished task 27.0 in stage 0.0 (TID 27) in 2288 ms on localhost (executor driver) (1/56)
2019-04-02 14:37:31 INFO TaskSetManager:54 - Finished task 28.0 in stage 0.0 (TID 28) in 2293 ms on localhost (executor driver) (2/56)
2019-04-02 14:37:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:31 DEBUG TaskMemoryManager:233 - Task 4 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@dff89d4
2019-04-02 14:37:31 INFO Executor:54 - Finished task 4.0 in stage 0.0 (TID 4). 1147 bytes result sent to driver
2019-04-02 14:37:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:31 INFO TaskSetManager:54 - Starting task 32.0 in stage 0.0 (TID 32, localhost, executor driver, partition 32, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:31 INFO Executor:54 - Running task 32.0 in stage 0.0 (TID 32)
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB696752-20181101172748207-00000-h3.warc.gz:0+16870810
2019-04-02 14:37:31 INFO TaskSetManager:54 - Finished task 4.0 in stage 0.0 (TID 4) in 2327 ms on localhost (executor driver) (3/56)
2019-04-02 14:37:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:31 DEBUG TaskMemoryManager:233 - Task 5 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@3ed3c6d2
2019-04-02 14:37:31 INFO Executor:54 - Finished task 5.0 in stage 0.0 (TID 5). 1147 bytes result sent to driver
2019-04-02 14:37:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:31 INFO TaskSetManager:54 - Starting task 33.0 in stage 0.0 (TID 33, localhost, executor driver, partition 33, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:31 INFO Executor:54 - Running task 33.0 in stage 0.0 (TID 33)
2019-04-02 14:37:31 INFO TaskSetManager:54 - Finished task 5.0 in stage 0.0 (TID 5) in 2556 ms on localhost (executor driver) (4/56)
2019-04-02 14:37:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799561-20190110150036185-00002-h3.warc.gz:0+12328
2019-04-02 14:37:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:31 DEBUG TaskMemoryManager:233 - Task 33 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@315bfc48
2019-04-02 14:37:31 INFO Executor:54 - Finished task 33.0 in stage 0.0 (TID 33). 1018 bytes result sent to driver
2019-04-02 14:37:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:31 INFO TaskSetManager:54 - Starting task 34.0 in stage 0.0 (TID 34, localhost, executor driver, partition 34, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:32 INFO Executor:54 - Running task 34.0 in stage 0.0 (TID 34)
2019-04-02 14:37:32 INFO TaskSetManager:54 - Finished task 33.0 in stage 0.0 (TID 33) in 204 ms on localhost (executor driver) (5/56)
2019-04-02 14:37:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828194835985-00004.warc.gz:0+1225892508
2019-04-02 14:37:32 DEBUG TaskMemoryManager:233 - Task 12 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@7e0fc456
2019-04-02 14:37:32 INFO Executor:54 - Finished task 12.0 in stage 0.0 (TID 12). 1147 bytes result sent to driver
2019-04-02 14:37:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:32 INFO TaskSetManager:54 - Starting task 35.0 in stage 0.0 (TID 35, localhost, executor driver, partition 35, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:32 INFO Executor:54 - Running task 35.0 in stage 0.0 (TID 35)
2019-04-02 14:37:32 INFO TaskSetManager:54 - Finished task 12.0 in stage 0.0 (TID 12) in 3087 ms on localhost (executor driver) (6/56)
2019-04-02 14:37:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB732496-SEED1799567-20190128183347593-00000-h3.warc.gz:0+187753
2019-04-02 14:37:32 DEBUG TaskMemoryManager:233 - Task 35 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@1667ba1e
2019-04-02 14:37:32 INFO Executor:54 - Finished task 35.0 in stage 0.0 (TID 35). 1104 bytes result sent to driver
2019-04-02 14:37:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:32 INFO TaskSetManager:54 - Starting task 36.0 in stage 0.0 (TID 36, localhost, executor driver, partition 36, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:32 INFO Executor:54 - Running task 36.0 in stage 0.0 (TID 36)
2019-04-02 14:37:32 INFO TaskSetManager:54 - Finished task 35.0 in stage 0.0 (TID 35) in 159 ms on localhost (executor driver) (7/56)
2019-04-02 14:37:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1855311-20190110143803510-00000-h3.warc.gz:0+544105
2019-04-02 14:37:32 DEBUG TaskMemoryManager:233 - Task 19 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@18ad053f
2019-04-02 14:37:32 INFO Executor:54 - Finished task 19.0 in stage 0.0 (TID 19). 1147 bytes result sent to driver
2019-04-02 14:37:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:32 INFO TaskSetManager:54 - Starting task 37.0 in stage 0.0 (TID 37, localhost, executor driver, partition 37, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:32 INFO Executor:54 - Running task 37.0 in stage 0.0 (TID 37)
2019-04-02 14:37:32 INFO TaskSetManager:54 - Finished task 19.0 in stage 0.0 (TID 19) in 3324 ms on localhost (executor driver) (8/56)
2019-04-02 14:37:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799566-20190110143759686-00000-h3.warc.gz:0+23467416
2019-04-02 14:37:32 DEBUG TaskMemoryManager:233 - Task 7 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@bd5ca85
2019-04-02 14:37:32 INFO Executor:54 - Finished task 7.0 in stage 0.0 (TID 7). 1147 bytes result sent to driver
2019-04-02 14:37:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:32 INFO TaskSetManager:54 - Starting task 38.0 in stage 0.0 (TID 38, localhost, executor driver, partition 38, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:32 INFO Executor:54 - Running task 38.0 in stage 0.0 (TID 38)
2019-04-02 14:37:32 INFO TaskSetManager:54 - Finished task 7.0 in stage 0.0 (TID 7) in 3431 ms on localhost (executor driver) (9/56)
2019-04-02 14:37:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799565-20190110143759559-00000-h3.warc.gz:0+717999
2019-04-02 14:37:32 DEBUG TaskMemoryManager:233 - Task 36 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@3ee0b745
2019-04-02 14:37:32 INFO Executor:54 - Finished task 36.0 in stage 0.0 (TID 36). 1104 bytes result sent to driver
2019-04-02 14:37:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:32 INFO TaskSetManager:54 - Starting task 39.0 in stage 0.0 (TID 39, localhost, executor driver, partition 39, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:32 INFO Executor:54 - Running task 39.0 in stage 0.0 (TID 39)
2019-04-02 14:37:32 INFO TaskSetManager:54 - Finished task 36.0 in stage 0.0 (TID 36) in 225 ms on localhost (executor driver) (10/56)
2019-04-02 14:37:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828211946243-00010.warc.gz:0+1105587835
2019-04-02 14:37:32 DEBUG TaskMemoryManager:233 - Task 10 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@140367f0
2019-04-02 14:37:32 INFO Executor:54 - Finished task 10.0 in stage 0.0 (TID 10). 1147 bytes result sent to driver
2019-04-02 14:37:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:32 INFO TaskSetManager:54 - Starting task 40.0 in stage 0.0 (TID 40, localhost, executor driver, partition 40, PROCESS_LOCAL, 8040 bytes)
2019-04-02 14:37:32 INFO Executor:54 - Running task 40.0 in stage 0.0 (TID 40)
2019-04-02 14:37:32 INFO TaskSetManager:54 - Finished task 10.0 in stage 0.0 (TID 10) in 3666 ms on localhost (executor driver) (11/56)
2019-04-02 14:37:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB696655-SEED1855311-20181101150538679-00000-jqlwpa42.warc.gz:0+3274004
2019-04-02 14:37:33 DEBUG TaskMemoryManager:233 - Task 15 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@74459169
2019-04-02 14:37:33 INFO Executor:54 - Finished task 15.0 in stage 0.0 (TID 15). 1147 bytes result sent to driver
2019-04-02 14:37:33 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:33 INFO TaskSetManager:54 - Starting task 41.0 in stage 0.0 (TID 41, localhost, executor driver, partition 41, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:33 INFO Executor:54 - Running task 41.0 in stage 0.0 (TID 41)
2019-04-02 14:37:33 INFO TaskSetManager:54 - Finished task 15.0 in stage 0.0 (TID 15) in 3843 ms on localhost (executor driver) (12/56)
2019-04-02 14:37:33 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:33 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828230433994-00021.warc.gz:0+748633570
2019-04-02 14:37:33 DEBUG TaskMemoryManager:233 - Task 38 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@6bc0dc2
2019-04-02 14:37:33 INFO Executor:54 - Finished task 38.0 in stage 0.0 (TID 38). 1147 bytes result sent to driver
2019-04-02 14:37:33 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:33 INFO TaskSetManager:54 - Starting task 42.0 in stage 0.0 (TID 42, localhost, executor driver, partition 42, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:33 INFO Executor:54 - Running task 42.0 in stage 0.0 (TID 42)
2019-04-02 14:37:33 INFO TaskSetManager:54 - Finished task 38.0 in stage 0.0 (TID 38) in 480 ms on localhost (executor driver) (13/56)
2019-04-02 14:37:33 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:33 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828220801526-00019.warc.gz:0+1000100089
2019-04-02 14:37:33 DEBUG TaskMemoryManager:233 - Task 24 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@dd4b802
2019-04-02 14:37:33 INFO Executor:54 - Finished task 24.0 in stage 0.0 (TID 24). 1147 bytes result sent to driver
2019-04-02 14:37:33 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:33 INFO TaskSetManager:54 - Starting task 43.0 in stage 0.0 (TID 43, localhost, executor driver, partition 43, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:33 INFO Executor:54 - Running task 43.0 in stage 0.0 (TID 43)
2019-04-02 14:37:33 INFO TaskSetManager:54 - Finished task 24.0 in stage 0.0 (TID 24) in 4116 ms on localhost (executor driver) (14/56)
2019-04-02 14:37:33 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:33 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799561-20190110145814212-00001-h3.warc.gz:0+1166454239
2019-04-02 14:37:38 DEBUG TaskMemoryManager:233 - Task 40 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@863ef9f
2019-04-02 14:37:38 INFO Executor:54 - Finished task 40.0 in stage 0.0 (TID 40). 1147 bytes result sent to driver
2019-04-02 14:37:38 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:38 INFO TaskSetManager:54 - Starting task 44.0 in stage 0.0 (TID 44, localhost, executor driver, partition 44, PROCESS_LOCAL, 8039 bytes)
2019-04-02 14:37:38 INFO Executor:54 - Running task 44.0 in stage 0.0 (TID 44)
2019-04-02 14:37:38 INFO TaskSetManager:54 - Finished task 40.0 in stage 0.0 (TID 40) in 5648 ms on localhost (executor driver) (15/56)
2019-04-02 14:37:38 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:38 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB681820-20180918145931833-00000.warc.gz:0+2056664
2019-04-02 14:37:39 DEBUG TaskMemoryManager:233 - Task 44 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@77297b9a
2019-04-02 14:37:39 INFO Executor:54 - Finished task 44.0 in stage 0.0 (TID 44). 1104 bytes result sent to driver
2019-04-02 14:37:39 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:39 INFO TaskSetManager:54 - Starting task 45.0 in stage 0.0 (TID 45, localhost, executor driver, partition 45, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:39 INFO Executor:54 - Running task 45.0 in stage 0.0 (TID 45)
2019-04-02 14:37:39 INFO TaskSetManager:54 - Finished task 44.0 in stage 0.0 (TID 44) in 595 ms on localhost (executor driver) (16/56)
2019-04-02 14:37:39 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:39 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB685188-20180928193923608-00000-h3.warc.gz:0+5233345
2019-04-02 14:37:41 DEBUG TaskMemoryManager:233 - Task 16 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@3d98e94d
2019-04-02 14:37:41 INFO Executor:54 - Finished task 16.0 in stage 0.0 (TID 16). 1147 bytes result sent to driver
2019-04-02 14:37:41 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:41 INFO TaskSetManager:54 - Starting task 46.0 in stage 0.0 (TID 46, localhost, executor driver, partition 46, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:41 INFO Executor:54 - Running task 46.0 in stage 0.0 (TID 46)
2019-04-02 14:37:41 INFO TaskSetManager:54 - Finished task 16.0 in stage 0.0 (TID 16) in 12740 ms on localhost (executor driver) (17/56)
2019-04-02 14:37:41 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:41 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB681536-20180917154003987-00000.warc.gz:0+1020548813
2019-04-02 14:37:42 DEBUG TaskMemoryManager:233 - Task 32 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@143e7266
2019-04-02 14:37:42 INFO Executor:54 - Finished task 32.0 in stage 0.0 (TID 32). 1147 bytes result sent to driver
2019-04-02 14:37:42 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:42 INFO TaskSetManager:54 - Starting task 47.0 in stage 0.0 (TID 47, localhost, executor driver, partition 47, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:42 INFO Executor:54 - Running task 47.0 in stage 0.0 (TID 47)
2019-04-02 14:37:42 INFO TaskSetManager:54 - Finished task 32.0 in stage 0.0 (TID 32) in 11321 ms on localhost (executor driver) (18/56)
2019-04-02 14:37:42 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:42 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828203721238-00008.warc.gz:0+1754240023
2019-04-02 14:37:44 DEBUG TaskMemoryManager:233 - Task 45 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@2488fcd
2019-04-02 14:37:44 INFO Executor:54 - Finished task 45.0 in stage 0.0 (TID 45). 1147 bytes result sent to driver
2019-04-02 14:37:44 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:44 INFO TaskSetManager:54 - Starting task 48.0 in stage 0.0 (TID 48, localhost, executor driver, partition 48, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:44 INFO Executor:54 - Running task 48.0 in stage 0.0 (TID 48)
2019-04-02 14:37:44 INFO TaskSetManager:54 - Finished task 45.0 in stage 0.0 (TID 45) in 5481 ms on localhost (executor driver) (19/56)
2019-04-02 14:37:44 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:44 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB734431-20190204173020907-00000-h3.warc.gz:0+10868086
2019-04-02 14:37:48 DEBUG TaskMemoryManager:233 - Task 48 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@9cabc22
2019-04-02 14:37:48 INFO Executor:54 - Finished task 48.0 in stage 0.0 (TID 48). 1147 bytes result sent to driver
2019-04-02 14:37:48 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:48 INFO TaskSetManager:54 - Starting task 49.0 in stage 0.0 (TID 49, localhost, executor driver, partition 49, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:37:48 INFO Executor:54 - Running task 49.0 in stage 0.0 (TID 49)
2019-04-02 14:37:48 INFO TaskSetManager:54 - Finished task 48.0 in stage 0.0 (TID 48) in 3913 ms on localhost (executor driver) (20/56)
2019-04-02 14:37:48 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:48 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB708893-20181108195047898-00000-h3.warc.gz:0+902945
2019-04-02 14:37:48 DEBUG TaskMemoryManager:233 - Task 49 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@b9f1b1c
2019-04-02 14:37:48 INFO Executor:54 - Finished task 49.0 in stage 0.0 (TID 49). 1104 bytes result sent to driver
2019-04-02 14:37:48 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:48 INFO TaskSetManager:54 - Starting task 50.0 in stage 0.0 (TID 50, localhost, executor driver, partition 50, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:37:48 INFO Executor:54 - Running task 50.0 in stage 0.0 (TID 50)
2019-04-02 14:37:48 INFO TaskSetManager:54 - Finished task 49.0 in stage 0.0 (TID 49) in 343 ms on localhost (executor driver) (21/56)
2019-04-02 14:37:48 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:48 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799563-20190110143759785-00000-h3.warc.gz:0+985116090
2019-04-02 14:37:53 DEBUG TaskMemoryManager:233 - Task 37 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@32658538
2019-04-02 14:37:53 INFO Executor:54 - Finished task 37.0 in stage 0.0 (TID 37). 1147 bytes result sent to driver
2019-04-02 14:37:53 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:37:53 INFO TaskSetManager:54 - Starting task 51.0 in stage 0.0 (TID 51, localhost, executor driver, partition 51, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:37:53 INFO Executor:54 - Running task 51.0 in stage 0.0 (TID 51)
2019-04-02 14:37:53 INFO TaskSetManager:54 - Finished task 37.0 in stage 0.0 (TID 37) in 20524 ms on localhost (executor driver) (22/56)
2019-04-02 14:37:53 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:37:53 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828201750185-00006.warc.gz:0+1140663408
2019-04-02 14:41:39 DEBUG TaskMemoryManager:233 - Task 31 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@5ad192d6
2019-04-02 14:41:39 INFO Executor:54 - Finished task 31.0 in stage 0.0 (TID 31). 1147 bytes result sent to driver
2019-04-02 14:41:39 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:41:39 INFO TaskSetManager:54 - Starting task 52.0 in stage 0.0 (TID 52, localhost, executor driver, partition 52, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:41:39 INFO Executor:54 - Running task 52.0 in stage 0.0 (TID 52)
2019-04-02 14:41:39 INFO TaskSetManager:54 - Finished task 31.0 in stage 0.0 (TID 31) in 247893 ms on localhost (executor driver) (23/56)
2019-04-02 14:41:39 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:41:39 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828220229658-00018.warc.gz:0+2235305772
2019-04-02 14:42:30 DEBUG TaskMemoryManager:233 - Task 52 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@6f45616e
2019-04-02 14:42:30 INFO Executor:54 - Finished task 52.0 in stage 0.0 (TID 52). 1147 bytes result sent to driver
2019-04-02 14:42:30 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:42:30 INFO TaskSetManager:54 - Starting task 53.0 in stage 0.0 (TID 53, localhost, executor driver, partition 53, PROCESS_LOCAL, 8042 bytes)
2019-04-02 14:42:30 INFO Executor:54 - Running task 53.0 in stage 0.0 (TID 53)
2019-04-02 14:42:30 INFO TaskSetManager:54 - Finished task 52.0 in stage 0.0 (TID 52) in 51275 ms on localhost (executor driver) (24/56)
2019-04-02 14:42:30 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:42:30 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB732833-20190129184629136-00000-h3.warc.gz:0+4083327
2019-04-02 14:42:31 DEBUG TaskMemoryManager:233 - Task 26 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@1ca0a77
2019-04-02 14:42:31 INFO Executor:54 - Finished task 26.0 in stage 0.0 (TID 26). 1147 bytes result sent to driver
2019-04-02 14:42:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:42:31 INFO TaskSetManager:54 - Starting task 54.0 in stage 0.0 (TID 54, localhost, executor driver, partition 54, PROCESS_LOCAL, 8015 bytes)
2019-04-02 14:42:31 INFO Executor:54 - Running task 54.0 in stage 0.0 (TID 54)
2019-04-02 14:42:31 INFO TaskSetManager:54 - Finished task 26.0 in stage 0.0 (TID 26) in 301784 ms on localhost (executor driver) (25/56)
2019-04-02 14:42:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:42:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828213131476-00014.warc.gz:0+1042060933
2019-04-02 14:42:31 DEBUG TaskMemoryManager:233 - Task 53 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@17172191
2019-04-02 14:42:31 INFO Executor:54 - Finished task 53.0 in stage 0.0 (TID 53). 1104 bytes result sent to driver
2019-04-02 14:42:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:42:31 INFO TaskSetManager:54 - Starting task 55.0 in stage 0.0 (TID 55, localhost, executor driver, partition 55, PROCESS_LOCAL, 8031 bytes)
2019-04-02 14:42:31 INFO Executor:54 - Running task 55.0 in stage 0.0 (TID 55)
2019-04-02 14:42:31 INFO TaskSetManager:54 - Finished task 53.0 in stage 0.0 (TID 53) in 1015 ms on localhost (executor driver) (26/56)
2019-04-02 14:42:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:42:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799562-20190110143814510-00000-h3.warc.gz:0+835642506
2019-04-02 14:45:37 DEBUG TaskMemoryManager:233 - Task 0 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@3d314b40
2019-04-02 14:45:37 INFO Executor:54 - Finished task 0.0 in stage 0.0 (TID 0). 1147 bytes result sent to driver
2019-04-02 14:45:37 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 14:45:37 DEBUG TaskSetManager:58 - No tasks for locality level NO_PREF, so moving to locality level ANY
2019-04-02 14:45:37 INFO TaskSetManager:54 - Finished task 0.0 in stage 0.0 (TID 0) in 488069 ms on localhost (executor driver) (27/56)
2019-04-02 14:45:37 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:49:17 DEBUG TaskMemoryManager:233 - Task 17 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@453d9996
2019-04-02 14:49:17 INFO Executor:54 - Finished task 17.0 in stage 0.0 (TID 17). 1147 bytes result sent to driver
2019-04-02 14:49:17 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 28
2019-04-02 14:49:17 INFO TaskSetManager:54 - Finished task 17.0 in stage 0.0 (TID 17) in 708441 ms on localhost (executor driver) (28/56)
2019-04-02 14:49:17 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:51:06 DEBUG TaskMemoryManager:233 - Task 2 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@5ea10b52
2019-04-02 14:51:06 INFO Executor:54 - Finished task 2.0 in stage 0.0 (TID 2). 1147 bytes result sent to driver
2019-04-02 14:51:06 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 27
2019-04-02 14:51:06 INFO TaskSetManager:54 - Finished task 2.0 in stage 0.0 (TID 2) in 817100 ms on localhost (executor driver) (29/56)
2019-04-02 14:51:06 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:52:43 DEBUG TaskMemoryManager:233 - Task 23 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@35dc03bb
2019-04-02 14:52:43 INFO Executor:54 - Finished task 23.0 in stage 0.0 (TID 23). 1190 bytes result sent to driver
2019-04-02 14:52:43 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 26
2019-04-02 14:52:43 INFO TaskSetManager:54 - Finished task 23.0 in stage 0.0 (TID 23) in 914041 ms on localhost (executor driver) (30/56)
2019-04-02 14:52:43 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:55:43 DEBUG TaskMemoryManager:233 - Task 41 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@4a46de55
2019-04-02 14:55:43 INFO Executor:54 - Finished task 41.0 in stage 0.0 (TID 41). 1147 bytes result sent to driver
2019-04-02 14:55:43 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 25
2019-04-02 14:55:43 INFO TaskSetManager:54 - Finished task 41.0 in stage 0.0 (TID 41) in 1090480 ms on localhost (executor driver) (31/56)
2019-04-02 14:55:43 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 14:57:39 ERROR Executor:91 - Exception in task 3.0 in stage 0.0 (TID 3)
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:3332)
at java.lang.StringCoding.safeTrim(StringCoding.java:89)
at java.lang.StringCoding.access$100(StringCoding.java:50)
at java.lang.StringCoding$StringDecoder.decode(StringCoding.java:154)
at java.lang.StringCoding.decode(StringCoding.java:193)
at java.lang.StringCoding.decode(StringCoding.java:254)
at java.lang.String.<init>(String.java:546)
at java.lang.String.<init>(String.java:566)
at io.archivesunleashed.ArchiveRecordImpl.<init>(ArchiveRecord.scala:105)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:463)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:191)
at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:62)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
at org.apache.spark.scheduler.Task.run(Task.scala:121)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:402)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:408)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2019-04-02 14:57:39 ERROR SparkUncaughtExceptionHandler:91 - Uncaught exception in thread Thread[Executor task launch worker for task 3,5,main]
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:3332)
at java.lang.StringCoding.safeTrim(StringCoding.java:89)
at java.lang.StringCoding.access$100(StringCoding.java:50)
at java.lang.StringCoding$StringDecoder.decode(StringCoding.java:154)
at java.lang.StringCoding.decode(StringCoding.java:193)
at java.lang.StringCoding.decode(StringCoding.java:254)
at java.lang.String.<init>(String.java:546)
at java.lang.String.<init>(String.java:566)
at io.archivesunleashed.ArchiveRecordImpl.<init>(ArchiveRecord.scala:105)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:463)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:191)
at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:62)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
at org.apache.spark.scheduler.Task.run(Task.scala:121)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:402)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:408)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2019-04-02 14:57:39 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 24
2019-04-02 14:57:39 WARN TaskSetManager:66 - Lost task 3.0 in stage 0.0 (TID 3, localhost, executor driver): java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:3332)
at java.lang.StringCoding.safeTrim(StringCoding.java:89)
at java.lang.StringCoding.access$100(StringCoding.java:50)
at java.lang.StringCoding$StringDecoder.decode(StringCoding.java:154)
at java.lang.StringCoding.decode(StringCoding.java:193)
at java.lang.StringCoding.decode(StringCoding.java:254)
at java.lang.String.<init>(String.java:546)
at java.lang.String.<init>(String.java:566)
at io.archivesunleashed.ArchiveRecordImpl.<init>(ArchiveRecord.scala:105)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:463)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:191)
at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:62)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
at org.apache.spark.scheduler.Task.run(Task.scala:121)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:402)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:408)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2019-04-02 14:57:39 INFO SparkContext:54 - Invoking stop() from shutdown hook
2019-04-02 14:57:39 ERROR TaskSetManager:70 - Task 3 in stage 0.0 failed 1 times; aborting job
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.server.Server@4ac1544f
2019-04-02 14:57:39 DEBUG Server:438 - doStop org.spark_project.jetty.server.Server@4ac1544f
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran SparkUI-77-acceptor-0@29edd63c-Spark@49e66de7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran SparkUI-78-acceptor-1@47218b73-Spark@49e66de7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran SparkUI-80-acceptor-3@232a41d8-Spark@49e66de7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran SparkUI-79-acceptor-2@231b84fb-Spark@49e66de7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2019-04-02 14:57:39 DEBUG Server:460 - Graceful shutdown org.spark_project.jetty.server.Server@4ac1544f by
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping Spark@49e66de7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@56fbc315
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=0 selected=0
2019-04-02 14:57:39 INFO TaskSchedulerImpl:54 - Cancelling stage 0
2019-04-02 14:57:39 DEBUG ManagedSelector:111 - Stopping org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=0 selected=0
2019-04-02 14:57:39 INFO TaskSchedulerImpl:54 - Killing all running tasks in stage 0: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@60358970 on org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@60358970
2019-04-02 14:57:39 DEBUG ManagedSelector:698 - Closing 0 endPoints on org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:707 - Closed 0 endPoints on org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:242 - Selector loop waiting on select
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseSelector@235482a7 on org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseSelector@235482a7
2019-04-02 14:57:39 DEBUG ManagedSelector:121 - Stopped org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:252 - EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@2c6bfa2b produced null
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:318 - EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@2c6bfa2b produce exit
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=0 selected=0
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran org.spark_project.jetty.io.ManagedSelector@55562e3d id=3 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG ManagedSelector:111 - Stopping org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@580332c9 on org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@580332c9
2019-04-02 14:57:39 DEBUG ManagedSelector:698 - Closing 0 endPoints on org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:707 - Closed 0 endPoints on org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseSelector@7325eb6e on org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:242 - Selector loop waiting on select
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 51.0 in stage 0.0 (TID 51), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 30.0 in stage 0.0 (TID 30), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseSelector@7325eb6e
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 9.0 in stage 0.0 (TID 9), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:252 - EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@1495da54 produced null
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:318 - EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@1495da54 produce exit
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=-1 selected=-1
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 1.0 in stage 0.0 (TID 1), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:121 - Stopped org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=-1 selected=-1
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 54.0 in stage 0.0 (TID 54), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.io.ManagedSelector@6fe6f1b4 id=2 keys=-1 selected=-1
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 25.0 in stage 0.0 (TID 25), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=0 selected=0
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 55.0 in stage 0.0 (TID 55), reason: Stage cancelled
2019-04-02 14:57:39 INFO TaskSchedulerImpl:54 - Stage 0 was cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:111 - Stopping org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=0 selected=0
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 47.0 in stage 0.0 (TID 47), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@2c503a6e on org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=0 selected=0
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 20.0 in stage 0.0 (TID 20), reason: Stage cancelled
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 50.0 in stage 0.0 (TID 50), reason: Stage cancelled
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 42.0 in stage 0.0 (TID 42), reason: Stage cancelled
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 21.0 in stage 0.0 (TID 21), reason: Stage cancelled
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 43.0 in stage 0.0 (TID 43), reason: Stage cancelled
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 22.0 in stage 0.0 (TID 22), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 14.0 in stage 0.0 (TID 14), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@2c503a6e
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 46.0 in stage 0.0 (TID 46), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:698 - Closing 0 endPoints on org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=0 selected=0
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 39.0 in stage 0.0 (TID 39), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:707 - Closed 0 endPoints on org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseSelector@6d04d057 on org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=0 selected=0
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 18.0 in stage 0.0 (TID 18), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:242 - Selector loop waiting on select
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 11.0 in stage 0.0 (TID 11), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 34.0 in stage 0.0 (TID 34), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseSelector@6d04d057
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 13.0 in stage 0.0 (TID 13), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:252 - EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@3ac3b8d7 produced null
2019-04-02 14:57:39 DEBUG ManagedSelector:121 - Stopped org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=-1 selected=-1
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 6.0 in stage 0.0 (TID 6), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:318 - EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@3ac3b8d7 produce exit
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=0 selected=0
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 29.0 in stage 0.0 (TID 29), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:111 - Stopping org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=0 selected=0
2019-04-02 14:57:39 INFO DAGScheduler:54 - ShuffleMapStage 0 (map at package.scala:88) failed in 1210.517 s due to Job aborted due to stage failure: Task 3 in stage 0.0 failed 1 times, most recent failure: Lost task 3.0 in stage 0.0 (TID 3, localhost, executor driver): java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:3332)
at java.lang.StringCoding.safeTrim(StringCoding.java:89)
at java.lang.StringCoding.access$100(StringCoding.java:50)
at java.lang.StringCoding$StringDecoder.decode(StringCoding.java:154)
at java.lang.StringCoding.decode(StringCoding.java:193)
at java.lang.StringCoding.decode(StringCoding.java:254)
at java.lang.String.<init>(String.java:546)
at java.lang.String.<init>(String.java:566)
at io.archivesunleashed.ArchiveRecordImpl.<init>(ArchiveRecord.scala:105)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(package.scala:69)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:463)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:191)
at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:62)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
at org.apache.spark.scheduler.Task.run(Task.scala:121)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:402)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:408)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Driver stacktrace:
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran org.spark_project.jetty.io.ManagedSelector@74e31e17 id=1 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@5dd98b97 on org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=0 selected=0
2019-04-02 14:57:39 INFO Executor:54 - Executor is trying to kill task 8.0 in stage 0.0 (TID 8), reason: Stage cancelled
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseEndPoints@5dd98b97
2019-04-02 14:57:39 DEBUG ManagedSelector:698 - Closing 0 endPoints on org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:707 - Closed 0 endPoints on org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:127 - Queued change org.spark_project.jetty.io.ManagedSelector$CloseSelector@70f74908 on org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=0 selected=0
2019-04-02 14:57:39 DEBUG ManagedSelector:242 - Selector loop waiting on select
2019-04-02 14:57:39 DEBUG ManagedSelector:245 - Selector loop woken up from select, 0/0 selected
2019-04-02 14:57:39 DEBUG ManagedSelector:225 - Running change org.spark_project.jetty.io.ManagedSelector$CloseSelector@70f74908
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:252 - EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@23f15e93 produced null
2019-04-02 14:57:39 DEBUG ManagedSelector:121 - Stopped org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG ExecuteProduceConsume:318 - EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@23f15e93 produce exit
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG QueuedThreadPool:591 - ran org.spark_project.jetty.io.ManagedSelector@31262802 id=0 keys=-1 selected=-1
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@56fbc315
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping HttpConnectionFactory@cfe881a[HTTP/1.1]
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED HttpConnectionFactory@cfe881a[HTTP/1.1]
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.util.thread.ScheduledExecutorScheduler@3bbab929
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.util.thread.ScheduledExecutorScheduler@3bbab929
2019-04-02 14:57:39 INFO AbstractConnector:318 - Stopped Spark@49e66de7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED Spark@49e66de7{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2019-04-02 14:57:39 DEBUG AbstractHandler:72 - stopping org.spark_project.jetty.server.Server@4ac1544f
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.server.handler.ContextHandlerCollection@3b5ce064[org.spark_project.jetty.server.handler.gzip.GzipHandler@2a4841ab, org.spark_project.jetty.server.handler.gzip.GzipHandler@60bdf2e3, org.spark_project.jetty.server.handler.gzip.GzipHandler@e207c2c, org.spark_project.jetty.server.handler.gzip.GzipHandler@5223f24c, org.spark_project.jetty.server.handler.gzip.GzipHandler@3a0eb4ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@35ab63f2, org.spark_project.jetty.server.handler.gzip.GzipHandler@38e7b877, org.spark_project.jetty.server.handler.gzip.GzipHandler@759b8cb5, org.spark_project.jetty.server.handler.gzip.GzipHandler@3aff4dd8, org.spark_project.jetty.server.handler.gzip.GzipHandler@54251d86, org.spark_project.jetty.server.handler.gzip.GzipHandler@51842375, org.spark_project.jetty.server.handler.gzip.GzipHandler@78d3f3d4, org.spark_project.jetty.server.handler.gzip.GzipHandler@3802f09b, org.spark_project.jetty.server.handler.gzip.GzipHandler@44370330, org.spark_project.jetty.server.handler.gzip.GzipHandler@34d81f48, org.spark_project.jetty.server.handler.gzip.GzipHandler@53f20754, org.spark_project.jetty.server.handler.gzip.GzipHandler@7cdba399, org.spark_project.jetty.server.handler.gzip.GzipHandler@911b1, org.spark_project.jetty.server.handler.gzip.GzipHandler@74df6ca7, org.spark_project.jetty.server.handler.gzip.GzipHandler@37d41dcf, org.spark_project.jetty.server.handler.gzip.GzipHandler@1632b7c7, org.spark_project.jetty.server.handler.gzip.GzipHandler@5efea829, org.spark_project.jetty.server.handler.gzip.GzipHandler@514b4d05, org.spark_project.jetty.server.handler.gzip.GzipHandler@46e61886, org.spark_project.jetty.server.handler.gzip.GzipHandler@45e90312, o.s.j.s.ServletContextHandler@795ce9b5{/metrics/json,null,SHUTDOWN,@Spark}]
2019-04-02 14:57:39 DEBUG AbstractHandler:72 - stopping org.spark_project.jetty.server.handler.ContextHandlerCollection@3b5ce064[org.spark_project.jetty.server.handler.gzip.GzipHandler@2a4841ab, org.spark_project.jetty.server.handler.gzip.GzipHandler@60bdf2e3, org.spark_project.jetty.server.handler.gzip.GzipHandler@e207c2c, org.spark_project.jetty.server.handler.gzip.GzipHandler@5223f24c, org.spark_project.jetty.server.handler.gzip.GzipHandler@3a0eb4ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@35ab63f2, org.spark_project.jetty.server.handler.gzip.GzipHandler@38e7b877, org.spark_project.jetty.server.handler.gzip.GzipHandler@759b8cb5, org.spark_project.jetty.server.handler.gzip.GzipHandler@3aff4dd8, org.spark_project.jetty.server.handler.gzip.GzipHandler@54251d86, org.spark_project.jetty.server.handler.gzip.GzipHandler@51842375, org.spark_project.jetty.server.handler.gzip.GzipHandler@78d3f3d4, org.spark_project.jetty.server.handler.gzip.GzipHandler@3802f09b, org.spark_project.jetty.server.handler.gzip.GzipHandler@44370330, org.spark_project.jetty.server.handler.gzip.GzipHandler@34d81f48, org.spark_project.jetty.server.handler.gzip.GzipHandler@53f20754, org.spark_project.jetty.server.handler.gzip.GzipHandler@7cdba399, org.spark_project.jetty.server.handler.gzip.GzipHandler@911b1, org.spark_project.jetty.server.handler.gzip.GzipHandler@74df6ca7, org.spark_project.jetty.server.handler.gzip.GzipHandler@37d41dcf, org.spark_project.jetty.server.handler.gzip.GzipHandler@1632b7c7, org.spark_project.jetty.server.handler.gzip.GzipHandler@5efea829, org.spark_project.jetty.server.handler.gzip.GzipHandler@514b4d05, org.spark_project.jetty.server.handler.gzip.GzipHandler@46e61886, org.spark_project.jetty.server.handler.gzip.GzipHandler@45e90312, o.s.j.s.ServletContextHandler@795ce9b5{/metrics/json,null,SHUTDOWN,@Spark}]
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.server.handler.ContextHandlerCollection@3b5ce064[org.spark_project.jetty.server.handler.gzip.GzipHandler@2a4841ab, org.spark_project.jetty.server.handler.gzip.GzipHandler@60bdf2e3, org.spark_project.jetty.server.handler.gzip.GzipHandler@e207c2c, org.spark_project.jetty.server.handler.gzip.GzipHandler@5223f24c, org.spark_project.jetty.server.handler.gzip.GzipHandler@3a0eb4ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@35ab63f2, org.spark_project.jetty.server.handler.gzip.GzipHandler@38e7b877, org.spark_project.jetty.server.handler.gzip.GzipHandler@759b8cb5, org.spark_project.jetty.server.handler.gzip.GzipHandler@3aff4dd8, org.spark_project.jetty.server.handler.gzip.GzipHandler@54251d86, org.spark_project.jetty.server.handler.gzip.GzipHandler@51842375, org.spark_project.jetty.server.handler.gzip.GzipHandler@78d3f3d4, org.spark_project.jetty.server.handler.gzip.GzipHandler@3802f09b, org.spark_project.jetty.server.handler.gzip.GzipHandler@44370330, org.spark_project.jetty.server.handler.gzip.GzipHandler@34d81f48, org.spark_project.jetty.server.handler.gzip.GzipHandler@53f20754, org.spark_project.jetty.server.handler.gzip.GzipHandler@7cdba399, org.spark_project.jetty.server.handler.gzip.GzipHandler@911b1, org.spark_project.jetty.server.handler.gzip.GzipHandler@74df6ca7, org.spark_project.jetty.server.handler.gzip.GzipHandler@37d41dcf, org.spark_project.jetty.server.handler.gzip.GzipHandler@1632b7c7, org.spark_project.jetty.server.handler.gzip.GzipHandler@5efea829, org.spark_project.jetty.server.handler.gzip.GzipHandler@514b4d05, org.spark_project.jetty.server.handler.gzip.GzipHandler@46e61886, org.spark_project.jetty.server.handler.gzip.GzipHandler@45e90312, o.s.j.s.ServletContextHandler@795ce9b5{/metrics/json,null,SHUTDOWN,@Spark}]
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping org.spark_project.jetty.server.handler.ErrorHandler@6efd5466
2019-04-02 14:57:39 DEBUG AbstractHandler:72 - stopping org.spark_project.jetty.server.handler.ErrorHandler@6efd5466
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.server.handler.ErrorHandler@6efd5466
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:194 - stopping SparkUI{STARTED,8<=9<=200,i=9,q=0}
2019-04-02 14:57:39 DEBUG DAGScheduler:58 - Removing stage 1 from waiting set.
2019-04-02 14:57:39 DEBUG DAGScheduler:58 - After removal of stage 1, remaining stages = 1
2019-04-02 14:57:39 DEBUG DAGScheduler:58 - After removal of stage 0, remaining stages = 0
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED SparkUI{STOPPED,8<=9<=200,i=0,q=0}
2019-04-02 14:57:39 DEBUG AbstractLifeCycle:204 - STOPPED org.spark_project.jetty.server.Server@4ac1544f
2019-04-02 14:57:39 INFO SparkUI:54 - Stopped Spark web UI at http://tuna.cs.uwaterloo.ca:4040
2019-04-02 14:57:39 INFO DAGScheduler:54 - Job 0 failed: sortBy at package.scala:90, took 1210.609162 s
2019-04-02 14:57:39 INFO MapOutputTrackerMasterEndpoint:54 - MapOutputTrackerMasterEndpoint stopped!
2019-04-02 14:57:39 INFO MemoryStore:54 - MemoryStore cleared
2019-04-02 14:57:39 INFO BlockManager:54 - BlockManager stopped
2019-04-02 14:57:39 INFO BlockManagerMaster:54 - BlockManagerMaster stopped
2019-04-02 14:57:39 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:54 - OutputCommitCoordinator stopped!
2019-04-02 14:57:39 INFO SparkContext:54 - Successfully stopped SparkContext
2019-04-02 14:57:39 INFO ShutdownHookManager:54 - Shutdown hook called
2019-04-02 14:57:39 INFO ShutdownHookManager:54 - Deleting directory /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5/repl-e79fcc12-8aa9-4903-aceb-936965eaf191
2019-04-02 14:57:39 INFO ShutdownHookManager:54 - Deleting directory /tmp/spark-6053f511-b951-4405-9f69-d75c87f52190
2019-04-02 14:57:39 INFO ShutdownHookManager:54 - Deleting directory /tmp/spark-8fc37439-f849-42ed-aee2-03451d837af5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment