Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save ruebot/24854fc2812f6a8f931ea65d0b592ab8 to your computer and use it in GitHub Desktop.
Save ruebot/24854fc2812f6a8f931ea65d0b592ab8 to your computer and use it in GitHub Desktop.
2019-04-02 17:51:13 WARN Utils:66 - Your hostname, tuna resolves to a loopback address: 127.0.1.1; using 129.97.186.18 instead (on interface enp5s0f0)
2019-04-02 17:51:13 WARN Utils:66 - Set SPARK_LOCAL_IP if you need to bind to another address
2019-04-02 17:51:13 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Spark context Web UI available at http://tuna.cs.uwaterloo.ca:4040
Spark context available as 'sc' (master = local[30], app id = local-1554241881971).
Spark session available as 'spark'.
2019-04-02 17:51:24 INFO MemoryStore:54 - Block broadcast_0 stored as values in memory (estimated size 370.6 KB, free 55.8 GB)
2019-04-02 17:51:24 DEBUG BlockManager:58 - Put block broadcast_0 locally took 66 ms
2019-04-02 17:51:25 DEBUG BlockManager:58 - Putting block broadcast_0 without replication took 68 ms
2019-04-02 17:51:25 INFO MemoryStore:54 - Block broadcast_0_piece0 stored as bytes in memory (estimated size 24.9 KB, free 55.8 GB)
2019-04-02 17:51:25 INFO BlockManagerInfo:54 - Added broadcast_0_piece0 in memory on tuna.cs.uwaterloo.ca:36364 (size: 24.9 KB, free: 55.8 GB)
2019-04-02 17:51:25 DEBUG BlockManagerMaster:58 - Updated info of block broadcast_0_piece0
2019-04-02 17:51:25 DEBUG BlockManager:58 - Told master about block broadcast_0_piece0
2019-04-02 17:51:25 DEBUG BlockManager:58 - Put block broadcast_0_piece0 locally took 8 ms
2019-04-02 17:51:25 DEBUG BlockManager:58 - Putting block broadcast_0_piece0 without replication took 9 ms
2019-04-02 17:51:25 INFO SparkContext:54 - Created broadcast 0 from newAPIHadoopFile at package.scala:66
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final boolean io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1.apply(scala.Tuple2)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$1) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final io.archivesunleashed.ArchiveRecordImpl io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2.apply(scala.Tuple2)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$RecordLoader$$anonfun$loadArchives$2) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final boolean io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1.apply(io.archivesunleashed.ArchiveRecord)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$WARecordRDD$$anonfun$keepValidPages$1) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> ($line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long $line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object $line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.String $line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1.apply(io.archivesunleashed.ArchiveRecord)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> ($line14.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$anonfun$1) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$4) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$4.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$4.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final scala.Tuple2 io.archivesunleashed.package$CountableRDD$$anonfun$4.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$4) is now cleaned +++
2019-04-02 17:51:25 DEBUG FileInputFormat:280 - Time taken to get FileStatuses: 10
2019-04-02 17:51:25 INFO FileInputFormat:283 - Total input paths to process : 56
2019-04-02 17:51:25 DEBUG FileInputFormat:431 - Total # of splits generated by getSplits: 56, TimeTaken: 19
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.rdd.PairRDDFunctions$$anonfun$reduceByKey$1$$anonfun$apply$10) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$1.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 3
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply$mcIII$sp(int,int)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(int,int)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(java.lang.Object,java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$1.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 3
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply$mcIII$sp(int,int)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final int io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(int,int)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$1.apply(java.lang.Object,java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function2> (io.archivesunleashed.package$CountableRDD$$anonfun$1) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$5) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long io.archivesunleashed.package$CountableRDD$$anonfun$5.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object io.archivesunleashed.package$CountableRDD$$anonfun$5.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final int io.archivesunleashed.package$CountableRDD$$anonfun$5.apply(scala.Tuple2)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (io.archivesunleashed.package$CountableRDD$$anonfun$5) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - private final scala.Function1 org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.cleanedF$3
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final scala.Tuple2 org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.rdd.RDD$$anonfun$keyBy$1$$anonfun$apply$55) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.RangePartitioner$$anonfun$9) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.RangePartitioner$$anonfun$9.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.RangePartitioner$$anonfun$9.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.RangePartitioner$$anonfun$9.apply(scala.Product2)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.RangePartitioner$$anonfun$9) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (org.apache.spark.RangePartitioner$$anonfun$13) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 4
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.RangePartitioner$$anonfun$13.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - private final int org.apache.spark.RangePartitioner$$anonfun$13.sampleSizePerPartition$2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - private final scala.reflect.ClassTag org.apache.spark.RangePartitioner$$anonfun$13.evidence$5$1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - private final int org.apache.spark.RangePartitioner$$anonfun$13.shift$1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.RangePartitioner$$anonfun$13.apply(java.lang.Object,java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final scala.collection.Iterator org.apache.spark.RangePartitioner$$anonfun$13.apply(int,scala.collection.Iterator)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function2> (org.apache.spark.RangePartitioner$$anonfun$13) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function1> (org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - private final org.apache.spark.rdd.RDD$$anonfun$collect$1 org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.$outer
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(scala.collection.Iterator)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD$$anonfun$collect$1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - <function0>
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - MapPartitionsRDD[9] at sortBy at package.scala:90
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 4
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class scala.runtime.AbstractFunction0,Set())
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD,Set(org$apache$spark$rdd$RDD$$evidence$1))
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD$$anonfun$collect$1,Set($outer))
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class java.lang.Object,Set())
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outermost object is not a closure or REPL line object,so do not clone it: (class org.apache.spark.rdd.RDD,MapPartitionsRDD[9] at sortBy at package.scala:90)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + cloning the object <function0> of class org.apache.spark.rdd.RDD$$anonfun$collect$1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + cleaning cloned closure <function0> recursively (org.apache.spark.rdd.RDD$$anonfun$collect$1)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function0> (org.apache.spark.rdd.RDD$$anonfun$collect$1) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.rdd.RDD$$anonfun$collect$1.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - private final org.apache.spark.rdd.RDD org.apache.spark.rdd.RDD$$anonfun$collect$1.$outer
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public org.apache.spark.rdd.RDD org.apache.spark.rdd.RDD$$anonfun$collect$1.org$apache$spark$rdd$RDD$$anonfun$$$outer()
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.rdd.RDD$$anonfun$collect$1.apply()
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - org.apache.spark.rdd.RDD
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - MapPartitionsRDD[9] at sortBy at package.scala:90
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 4
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class scala.runtime.AbstractFunction0,Set())
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD,Set(org$apache$spark$rdd$RDD$$evidence$1))
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class org.apache.spark.rdd.RDD$$anonfun$collect$1,Set($outer))
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - (class java.lang.Object,Set())
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outermost object is not a closure or REPL line object,so do not clone it: (class org.apache.spark.rdd.RDD,MapPartitionsRDD[9] at sortBy at package.scala:90)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function0> (org.apache.spark.rdd.RDD$$anonfun$collect$1) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function1> (org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13) is now cleaned +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ Cleaning closure <function2> (org.apache.spark.SparkContext$$anonfun$runJob$5) +++
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared fields: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public static final long org.apache.spark.SparkContext$$anonfun$runJob$5.serialVersionUID
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - private final scala.Function1 org.apache.spark.SparkContext$$anonfun$runJob$5.cleanedFunc$1
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + declared methods: 2
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.SparkContext$$anonfun$runJob$5.apply(java.lang.Object,java.lang.Object)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - public final java.lang.Object org.apache.spark.SparkContext$$anonfun$runJob$5.apply(org.apache.spark.TaskContext,scala.collection.Iterator)
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + inner classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer classes: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + outer objects: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + populating accessed fields because this is the starting closure
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + fields accessed by starting closure: 0
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - + there are no enclosing objects!
2019-04-02 17:51:25 DEBUG ClosureCleaner:58 - +++ closure <function2> (org.apache.spark.SparkContext$$anonfun$runJob$5) is now cleaned +++
2019-04-02 17:51:25 INFO SparkContext:54 - Starting job: sortBy at package.scala:90
2019-04-02 17:51:25 DEBUG SortShuffleManager:192 - Can't use serialized shuffle for shuffle 0 because we need to do map-side aggregation
2019-04-02 17:51:25 INFO DAGScheduler:54 - Registering RDD 5 (map at package.scala:88)
2019-04-02 17:51:25 INFO DAGScheduler:54 - Got job 0 (sortBy at package.scala:90) with 56 output partitions
2019-04-02 17:51:25 INFO DAGScheduler:54 - Final stage: ResultStage 1 (sortBy at package.scala:90)
2019-04-02 17:51:25 INFO DAGScheduler:54 - Parents of final stage: List(ShuffleMapStage 0)
2019-04-02 17:51:25 INFO DAGScheduler:54 - Missing parents: List(ShuffleMapStage 0)
2019-04-02 17:51:25 DEBUG DAGScheduler:58 - submitStage(ResultStage 1)
2019-04-02 17:51:25 DEBUG DAGScheduler:58 - missing: List(ShuffleMapStage 0)
2019-04-02 17:51:25 DEBUG DAGScheduler:58 - submitStage(ShuffleMapStage 0)
2019-04-02 17:51:25 DEBUG DAGScheduler:58 - missing: List()
2019-04-02 17:51:25 INFO DAGScheduler:54 - Submitting ShuffleMapStage 0 (MapPartitionsRDD[5] at map at package.scala:88), which has no missing parents
2019-04-02 17:51:25 DEBUG DAGScheduler:58 - submitMissingTasks(ShuffleMapStage 0)
2019-04-02 17:51:25 INFO MemoryStore:54 - Block broadcast_1 stored as values in memory (estimated size 4.8 KB, free 55.8 GB)
2019-04-02 17:51:25 DEBUG BlockManager:58 - Put block broadcast_1 locally took 2 ms
2019-04-02 17:51:25 DEBUG BlockManager:58 - Putting block broadcast_1 without replication took 2 ms
2019-04-02 17:51:25 INFO MemoryStore:54 - Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 55.8 GB)
2019-04-02 17:51:25 INFO BlockManagerInfo:54 - Added broadcast_1_piece0 in memory on tuna.cs.uwaterloo.ca:36364 (size: 2.7 KB, free: 55.8 GB)
2019-04-02 17:51:25 DEBUG BlockManagerMaster:58 - Updated info of block broadcast_1_piece0
2019-04-02 17:51:25 DEBUG BlockManager:58 - Told master about block broadcast_1_piece0
2019-04-02 17:51:25 DEBUG BlockManager:58 - Put block broadcast_1_piece0 locally took 3 ms
2019-04-02 17:51:25 DEBUG BlockManager:58 - Putting block broadcast_1_piece0 without replication took 4 ms
2019-04-02 17:51:25 INFO SparkContext:54 - Created broadcast 1 from broadcast at DAGScheduler.scala:1161
2019-04-02 17:51:25 INFO DAGScheduler:54 - Submitting 56 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[5] at map at package.scala:88) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
2019-04-02 17:51:25 INFO TaskSchedulerImpl:54 - Adding task set 0.0 with 56 tasks
2019-04-02 17:51:25 DEBUG TaskSetManager:58 - Epoch for TaskSet 0.0: 0
2019-04-02 17:51:25 DEBUG TaskSetManager:58 - Valid locality levels for TaskSet 0.0: NO_PREF, ANY
2019-04-02 17:51:25 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 0
2019-04-02 17:51:25 DEBUG TaskSetManager:58 - Valid locality levels for TaskSet 0.0: NO_PREF, ANY
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 0.0 in stage 0.0 (TID 0, localhost, executor driver, partition 0, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 1.0 in stage 0.0 (TID 1, localhost, executor driver, partition 1, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 2.0 in stage 0.0 (TID 2, localhost, executor driver, partition 2, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 3.0 in stage 0.0 (TID 3, localhost, executor driver, partition 3, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 4.0 in stage 0.0 (TID 4, localhost, executor driver, partition 4, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 5.0 in stage 0.0 (TID 5, localhost, executor driver, partition 5, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 6.0 in stage 0.0 (TID 6, localhost, executor driver, partition 6, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 7.0 in stage 0.0 (TID 7, localhost, executor driver, partition 7, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 8.0 in stage 0.0 (TID 8, localhost, executor driver, partition 8, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 9.0 in stage 0.0 (TID 9, localhost, executor driver, partition 9, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 10.0 in stage 0.0 (TID 10, localhost, executor driver, partition 10, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 11.0 in stage 0.0 (TID 11, localhost, executor driver, partition 11, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 12.0 in stage 0.0 (TID 12, localhost, executor driver, partition 12, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 13.0 in stage 0.0 (TID 13, localhost, executor driver, partition 13, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 14.0 in stage 0.0 (TID 14, localhost, executor driver, partition 14, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 15.0 in stage 0.0 (TID 15, localhost, executor driver, partition 15, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 16.0 in stage 0.0 (TID 16, localhost, executor driver, partition 16, PROCESS_LOCAL, 8039 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 17.0 in stage 0.0 (TID 17, localhost, executor driver, partition 17, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 18.0 in stage 0.0 (TID 18, localhost, executor driver, partition 18, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 19.0 in stage 0.0 (TID 19, localhost, executor driver, partition 19, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 20.0 in stage 0.0 (TID 20, localhost, executor driver, partition 20, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 21.0 in stage 0.0 (TID 21, localhost, executor driver, partition 21, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 22.0 in stage 0.0 (TID 22, localhost, executor driver, partition 22, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 23.0 in stage 0.0 (TID 23, localhost, executor driver, partition 23, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 24.0 in stage 0.0 (TID 24, localhost, executor driver, partition 24, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 25.0 in stage 0.0 (TID 25, localhost, executor driver, partition 25, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 26.0 in stage 0.0 (TID 26, localhost, executor driver, partition 26, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 27.0 in stage 0.0 (TID 27, localhost, executor driver, partition 27, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 28.0 in stage 0.0 (TID 28, localhost, executor driver, partition 28, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:26 INFO TaskSetManager:54 - Starting task 29.0 in stage 0.0 (TID 29, localhost, executor driver, partition 29, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:26 INFO Executor:54 - Running task 15.0 in stage 0.0 (TID 15)
2019-04-02 17:51:26 INFO Executor:54 - Running task 13.0 in stage 0.0 (TID 13)
2019-04-02 17:51:26 INFO Executor:54 - Running task 22.0 in stage 0.0 (TID 22)
2019-04-02 17:51:26 INFO Executor:54 - Running task 26.0 in stage 0.0 (TID 26)
2019-04-02 17:51:26 INFO Executor:54 - Running task 25.0 in stage 0.0 (TID 25)
2019-04-02 17:51:26 INFO Executor:54 - Running task 11.0 in stage 0.0 (TID 11)
2019-04-02 17:51:26 INFO Executor:54 - Running task 17.0 in stage 0.0 (TID 17)
2019-04-02 17:51:26 INFO Executor:54 - Running task 7.0 in stage 0.0 (TID 7)
2019-04-02 17:51:26 INFO Executor:54 - Running task 6.0 in stage 0.0 (TID 6)
2019-04-02 17:51:26 INFO Executor:54 - Running task 29.0 in stage 0.0 (TID 29)
2019-04-02 17:51:26 INFO Executor:54 - Running task 14.0 in stage 0.0 (TID 14)
2019-04-02 17:51:26 INFO Executor:54 - Running task 2.0 in stage 0.0 (TID 2)
2019-04-02 17:51:26 INFO Executor:54 - Running task 24.0 in stage 0.0 (TID 24)
2019-04-02 17:51:26 INFO Executor:54 - Running task 10.0 in stage 0.0 (TID 10)
2019-04-02 17:51:26 INFO Executor:54 - Running task 16.0 in stage 0.0 (TID 16)
2019-04-02 17:51:26 INFO Executor:54 - Running task 19.0 in stage 0.0 (TID 19)
2019-04-02 17:51:26 INFO Executor:54 - Running task 21.0 in stage 0.0 (TID 21)
2019-04-02 17:51:26 INFO Executor:54 - Running task 3.0 in stage 0.0 (TID 3)
2019-04-02 17:51:26 INFO Executor:54 - Running task 0.0 in stage 0.0 (TID 0)
2019-04-02 17:51:26 INFO Executor:54 - Running task 5.0 in stage 0.0 (TID 5)
2019-04-02 17:51:26 INFO Executor:54 - Running task 18.0 in stage 0.0 (TID 18)
2019-04-02 17:51:26 INFO Executor:54 - Running task 1.0 in stage 0.0 (TID 1)
2019-04-02 17:51:26 INFO Executor:54 - Running task 23.0 in stage 0.0 (TID 23)
2019-04-02 17:51:26 INFO Executor:54 - Running task 12.0 in stage 0.0 (TID 12)
2019-04-02 17:51:26 INFO Executor:54 - Running task 20.0 in stage 0.0 (TID 20)
2019-04-02 17:51:26 INFO Executor:54 - Running task 4.0 in stage 0.0 (TID 4)
2019-04-02 17:51:26 INFO Executor:54 - Running task 28.0 in stage 0.0 (TID 28)
2019-04-02 17:51:26 INFO Executor:54 - Running task 27.0 in stage 0.0 (TID 27)
2019-04-02 17:51:26 INFO Executor:54 - Running task 8.0 in stage 0.0 (TID 8)
2019-04-02 17:51:26 INFO Executor:54 - Running task 9.0 in stage 0.0 (TID 9)
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.api_api-util-1.0.0-M20.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClientFactory:207 - Creating new connection to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 DEBUG AbstractByteBuf:81 - -Dio.netty.buffer.bytebuf.checkAccessible: true
2019-04-02 17:51:26 DEBUG ResourceLeakDetectorFactory:76 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@b68b3e0
2019-04-02 17:51:26 DEBUG TransportClientFactory:254 - Connection to tuna.cs.uwaterloo.ca/129.97.186.18:40540 successful, running bootstraps...
2019-04-02 17:51:26 INFO TransportClientFactory:267 - Successfully created connection to tuna.cs.uwaterloo.ca/129.97.186.18:40540 after 42 ms (0 ms spent in bootstraps)
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.api_api-util-1.0.0-M20.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 DEBUG Recycler:76 - -Dio.netty.recycler.maxCapacityPerThread: 32768
2019-04-02 17:51:26 DEBUG Recycler:76 - -Dio.netty.recycler.maxSharedCapacityFactor: 2
2019-04-02 17:51:26 DEBUG Recycler:76 - -Dio.netty.recycler.linkCapacity: 16
2019-04-02 17:51:26 DEBUG Recycler:76 - -Dio.netty.recycler.ratio: 8
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.api_api-util-1.0.0-M20.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp374542050286268097.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.directory.api_api-util-1.0.0-M20.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-auth-2.6.5.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-auth-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-auth-2.6.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4078665761648322356.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.hadoop_hadoop-auth-2.6.5.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_slf4j-api-1.7.24.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_slf4j-api-1.7.24.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_slf4j-api-1.7.24.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6316429666646158018.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.slf4j_slf4j-api-1.7.24.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4612695160946536576.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.directory.api_api-asn1-api-1.0.0-M20.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.github.fommil.netlib_core-1.1.2.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.github.fommil.netlib_core-1.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.github.fommil.netlib_core-1.1.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1848943569013782038.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.github.fommil.netlib_core-1.1.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-configuration_commons-configuration-1.8.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-configuration_commons-configuration-1.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-configuration_commons-configuration-1.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8450906884001954361.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-configuration_commons-configuration-1.8.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/log4j_log4j-1.2.17.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/log4j_log4j-1.2.17.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/log4j_log4j-1.2.17.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2570280853750041393.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/log4j_log4j-1.2.17.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2279156500553435536.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.woodstox_woodstox-core-asl-4.4.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.martiansoftware_jsap-2.1.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.martiansoftware_jsap-2.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.martiansoftware_jsap-2.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4737254206980344818.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.martiansoftware_jsap-2.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-csv-1.0.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-csv-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-csv-1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1798194705796206552.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.commons_commons-csv-1.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.tika_tika-core-1.12.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.tika_tika-core-1.12.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.tika_tika-core-1.12.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7798703299894055827.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.tika_tika-core-1.12.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_slf4j-log4j12-1.7.5.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_slf4j-log4j12-1.7.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_slf4j-log4j12-1.7.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1518564829592008983.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.slf4j_slf4j-log4j12-1.7.5.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1067694168323952743.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.jackson_jackson-jaxrs-1.9.13.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-collections_commons-collections-3.2.2.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-collections_commons-collections-3.2.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-collections_commons-collections-3.2.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp899110556681390138.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-collections_commons-collections-3.2.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-codec_commons-codec-1.9.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-codec_commons-codec-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-codec_commons-codec-1.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3637744141386126939.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-codec_commons-codec-1.9.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.mortbay.jetty_jetty-util-6.1.26.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.mortbay.jetty_jetty-util-6.1.26.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.mortbay.jetty_jetty-util-6.1.26.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6125879317571068660.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.mortbay.jetty_jetty-util-6.1.26.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.servlet_servlet-api-2.5.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/javax.servlet_servlet-api-2.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.servlet_servlet-api-2.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1329400914062899128.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.servlet_servlet-api-2.5.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/asm_asm-3.2.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/asm_asm-3.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/asm_asm-3.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5178772713496389586.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/asm_asm-3.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.twitter_chill-java-0.8.4.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.twitter_chill-java-0.8.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.twitter_chill-java-0.8.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp985452218900716707.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.twitter_chill-java-0.8.4.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/aopalliance_aopalliance-1.0.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/aopalliance_aopalliance-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/aopalliance_aopalliance-1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp799831793514641272.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/aopalliance_aopalliance-1.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.servlet_javax.servlet-api-3.0.1.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/javax.servlet_javax.servlet-api-3.0.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.servlet_javax.servlet-api-3.0.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3694676113428991255.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.servlet_javax.servlet-api-3.0.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-xc-1.9.13.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-xc-1.9.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-xc-1.9.13.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp665189248402860121.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.jackson_jackson-xc-1.9.13.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.pff_java-libpst-0.8.1.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.pff_java-libpst-0.8.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.pff_java-libpst-0.8.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp9012442633929353802.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.pff_java-libpst-0.8.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.opennlp_opennlp-maxent-3.0.3.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.opennlp_opennlp-maxent-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.opennlp_opennlp-maxent-3.0.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp165458428886562915.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.opennlp_opennlp-maxent-3.0.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp9078769315554431283.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.fasterxml.jackson.module_jackson-module-paranamer-2.8.8.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jettison_jettison-1.1.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jettison_jettison-1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jettison_jettison-1.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5257883040423548347.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.jettison_jettison-1.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-cli_commons-cli-1.2.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-cli_commons-cli-1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-cli_commons-cli-1.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2993653396432747870.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-cli_commons-cli-1.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-ooxml-schemas-3.13.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-ooxml-schemas-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-ooxml-schemas-3.13.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1124106605418518846.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.poi_poi-ooxml-schemas-3.13.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.pdfbox_fontbox-1.8.10.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.pdfbox_fontbox-1.8.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.pdfbox_fontbox-1.8.10.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6647213871474892006.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.pdfbox_fontbox-1.8.10.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-lang_commons-lang-2.6.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-lang_commons-lang-2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-lang_commons-lang-2.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8473870818784826286.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-lang_commons-lang-2.6.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.twitter_chill_2.11-0.8.4.jar with timestamp 1554241881936
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.twitter_chill_2.11-0.8.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.twitter_chill_2.11-0.8.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2116318484875331913.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.twitter_chill_2.11-0.8.4.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codelibs_jhighlight-1.0.2.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.codelibs_jhighlight-1.0.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codelibs_jhighlight-1.0.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2239690206910528318.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codelibs_jhighlight-1.0.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp978227250860049368.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scala-lang.modules_scala-xml_2.11-1.0.6.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4703384408819634033.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.fasterxml.jackson.core_jackson-databind-2.8.8.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar with timestamp 1554241881941
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1124703273094639953.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.healthmarketscience.jackcess_jackcess-encrypt-2.1.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5030738056434857172.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.directory.server_apacheds-i18n-2.0.0-M15.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.itadaki_bzip2-0.9.1.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.itadaki_bzip2-0.9.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.itadaki_bzip2-0.9.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3501755330873439511.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.itadaki_bzip2-0.9.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-logging_commons-logging-api-1.1.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-logging_commons-logging-api-1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-logging_commons-logging-api-1.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6391812078766968753.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-logging_commons-logging-api-1.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8165409834612153054.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.maven.scm_maven-scm-provider-svnexe-1.4.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.syncthemall_boilerpipe-1.2.2.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.syncthemall_boilerpipe-1.2.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.syncthemall_boilerpipe-1.2.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5281689814950988642.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.syncthemall_boilerpipe-1.2.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.inject_javax.inject-1.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/javax.inject_javax.inject-1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.inject_javax.inject-1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7655101715854602290.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.inject_javax.inject-1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-ooxml-3.13.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-ooxml-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-ooxml-3.13.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3478569567729060605.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.poi_poi-ooxml-3.13.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.core_jackson-core-2.8.8.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.core_jackson-core-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.core_jackson-core-2.8.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7660744244733409756.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.fasterxml.jackson.core_jackson-core-2.8.8.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-logging_commons-logging-1.1.3.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-logging_commons-logging-1.1.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-logging_commons-logging-1.1.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3844977656658615113.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-logging_commons-logging-1.1.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sf.ehcache_ehcache-core-2.6.2.jar with timestamp 1554241881944
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/net.sf.ehcache_ehcache-core-2.6.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sf.ehcache_ehcache-core-2.6.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5235048501514846524.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.sf.ehcache_ehcache-core-2.6.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.esotericsoftware_kryo-shaded-3.0.3.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.esotericsoftware_kryo-shaded-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.esotericsoftware_kryo-shaded-3.0.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1620412707896180668.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.esotericsoftware_kryo-shaded-3.0.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.mp4parser_isoparser-1.0.2.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.mp4parser_isoparser-1.0.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.mp4parser_isoparser-1.0.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp299912933827894076.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.googlecode.mp4parser_isoparser-1.0.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_grib-4.5.5.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_grib-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_grib-4.5.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4045832537995413493.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/edu.ucar_grib-4.5.5.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.measure_jsr-275-0.9.3.jar with timestamp 1554241881944
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/javax.measure_jsr-275-0.9.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.measure_jsr-275-0.9.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2407560460821479784.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.measure_jsr-275-0.9.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.curator_curator-recipes-2.6.0.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.curator_curator-recipes-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.curator_curator-recipes-2.6.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5657245059549552513.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.curator_curator-recipes-2.6.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.bouncycastle_bcmail-jdk15on-1.52.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.bouncycastle_bcmail-jdk15on-1.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.bouncycastle_bcmail-jdk15on-1.52.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2790642963173010939.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.bouncycastle_bcmail-jdk15on-1.52.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scalap-2.11.0.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scalap-2.11.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scalap-2.11.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4387326867734437178.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scala-lang_scalap-2.11.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-el_commons-el-1.0.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-el_commons-el-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-el_commons-el-1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6609087253964394825.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-el_commons-el-1.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.jcip_jcip-annotations-1.0.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/net.jcip_jcip-annotations-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.jcip_jcip-annotations-1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1511162489750903653.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.jcip_jcip-annotations-1.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.java.dev.jna_jna-4.1.0.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/net.java.dev.jna_jna-4.1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.java.dev.jna_jna-4.1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp110940464817390725.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.java.dev.jna_jna-4.1.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scalanlp_breeze-macros_2.11-0.13.1.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.scalanlp_breeze-macros_2.11-0.13.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scalanlp_breeze-macros_2.11-0.13.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2168294217152762454.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scalanlp_breeze-macros_2.11-0.13.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sourceforge.nekohtml_nekohtml-1.9.20.jar with timestamp 1554241881944
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/net.sourceforge.nekohtml_nekohtml-1.9.20.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sourceforge.nekohtml_nekohtml-1.9.20.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp858269749609176131.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.sourceforge.nekohtml_nekohtml-1.9.20.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.typelevel_machinist_2.11-0.6.1.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.typelevel_machinist_2.11-0.6.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.typelevel_machinist_2.11-0.6.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8802203977543944391.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.typelevel_machinist_2.11-0.6.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-client-1.9.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-client-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-client-1.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp220823566184430455.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.sun.jersey_jersey-client-1.9.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.curator_curator-framework-2.6.0.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.curator_curator-framework-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.curator_curator-framework-2.6.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7228448655496390635.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.curator_curator-framework-2.6.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.zookeeper_zookeeper-3.4.6.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.zookeeper_zookeeper-3.4.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.zookeeper_zookeeper-3.4.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2461372373953513755.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.zookeeper_zookeeper-3.4.6.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/de.l3s.boilerpipe_boilerpipe-1.1.0.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/de.l3s.boilerpipe_boilerpipe-1.1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/de.l3s.boilerpipe_boilerpipe-1.1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp9000441488943016454.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/de.l3s.boilerpipe_boilerpipe-1.1.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.gagravarr_vorbis-java-tika-0.6.jar with timestamp 1554241881941
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.gagravarr_vorbis-java-tika-0.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.gagravarr_vorbis-java-tika-0.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp908453194919986075.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.gagravarr_vorbis-java-tika-0.6.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.ow2.asm_asm-5.0.4.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.ow2.asm_asm-5.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.ow2.asm_asm-5.0.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4052589405445136134.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.ow2.asm_asm-5.0.4.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.healthmarketscience.jackcess_jackcess-2.1.2.jar with timestamp 1554241881941
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.healthmarketscience.jackcess_jackcess-2.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.healthmarketscience.jackcess_jackcess-2.1.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6289958674950303325.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.healthmarketscience.jackcess_jackcess-2.1.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scala-reflect-2.11.8.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scala-reflect-2.11.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scala-reflect-2.11.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1025259823643349823.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scala-lang_scala-reflect-2.11.8.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.annotation_javax.annotation-api-1.2.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/javax.annotation_javax.annotation-api-1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.annotation_javax.annotation-api-1.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp9213723653828591088.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.annotation_javax.annotation-api-1.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-lang3-3.3.1.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-lang3-3.3.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-lang3-3.3.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5771840575634490878.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.commons_commons-lang3-3.3.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.opennlp_opennlp-tools-1.5.3.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.opennlp_opennlp-tools-1.5.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.opennlp_opennlp-tools-1.5.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7516630415570137067.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.opennlp_opennlp-tools-1.5.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.tika_tika-parsers-1.12.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.tika_tika-parsers-1.12.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.tika_tika-parsers-1.12.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6011349283510826336.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.tika_tika-parsers-1.12.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-queries-4.10.3.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-queries-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-queries-4.10.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2318883505700221655.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.lucene_lucene-queries-4.10.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.core_sis-referencing-0.5.jar with timestamp 1554241881944
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.core_sis-referencing-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.core_sis-referencing-0.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6850641062262943722.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.sis.core_sis-referencing-0.5.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/io.netty_netty-3.6.2.Final.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/io.netty_netty-3.6.2.Final.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/io.netty_netty-3.6.2.Final.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8325981301529519412.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/io.netty_netty-3.6.2.Final.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-vfs2-2.0.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-vfs2-2.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-vfs2-2.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8065346048153203476.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.commons_commons-vfs2-2.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/it.unimi.dsi_fastutil-6.5.2.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/it.unimi.dsi_fastutil-6.5.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/it.unimi.dsi_fastutil-6.5.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3658936323309357766.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/it.unimi.dsi_fastutil-6.5.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/junit_junit-4.8.2.jar with timestamp 1554241881936
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/junit_junit-4.8.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/junit_junit-4.8.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8386238076697357840.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/junit_junit-4.8.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.aspectj_aspectjrt-1.8.0.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.aspectj_aspectjrt-1.8.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.aspectj_aspectjrt-1.8.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1058756609128710969.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.aspectj_aspectjrt-1.8.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_jcl-over-slf4j-1.7.24.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_jcl-over-slf4j-1.7.24.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_jcl-over-slf4j-1.7.24.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4347889077881524154.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.slf4j_jcl-over-slf4j-1.7.24.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-httpclient_commons-httpclient-3.1.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/commons-httpclient_commons-httpclient-3.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-httpclient_commons-httpclient-3.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1644928880964197152.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-httpclient_commons-httpclient-3.1.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.io7m.xom_xom-1.2.10.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.io7m.xom_xom-1.2.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.io7m.xom_xom-1.2.10.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6328617322509981252.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.io7m.xom_xom-1.2.10.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json4s_json4s-core_2.11-3.2.11.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.json4s_json4s-core_2.11-3.2.11.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json4s_json4s-core_2.11-3.2.11.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6368298471788072285.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.json4s_json4s-core_2.11-3.2.11.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.chuusai_shapeless_2.11-2.3.2.jar with timestamp 1554241881936
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.chuusai_shapeless_2.11-2.3.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.chuusai_shapeless_2.11-2.3.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7403004297883203745.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.chuusai_shapeless_2.11-2.3.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5737297664064466955.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.hadoop_hadoop-mapreduce-client-core-2.6.5.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-math3-3.2.jar with timestamp 1554241881938
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-math3-3.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-math3-3.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3339266147022906976.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.commons_commons-math3-3.2.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/io.archivesunleashed_aut-0.17.0.jar with timestamp 1554241881936
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/io.archivesunleashed_aut-0.17.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/io.archivesunleashed_aut-0.17.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6940836922875990571.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/io.archivesunleashed_aut-0.17.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.xmlbeans_xmlbeans-2.6.0.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.xmlbeans_xmlbeans-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.xmlbeans_xmlbeans-2.6.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2047509539940533877.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.xmlbeans_xmlbeans-2.6.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.github.junrar_junrar-0.7.jar with timestamp 1554241881942
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.github.junrar_junrar-0.7.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.github.junrar_junrar-0.7.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5220023442460136455.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.github.junrar_junrar-0.7.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-core-4.10.3.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-core-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-core-4.10.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6520185507033766603.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.lucene_lucene-core-4.10.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar with timestamp 1554241881943
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4873314031346622701.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.cxf_cxf-rt-transports-http-3.0.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-queryparser-4.10.3.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-queryparser-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-queryparser-4.10.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5698400642552798329.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.lucene_lucene-queryparser-4.10.3.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.gnu.inet_libidn-1.15.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.gnu.inet_libidn-1.15.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.gnu.inet_libidn-1.15.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6265766998752666825.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.gnu.inet_libidn-1.15.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.apple_AppleJavaExtensions-1.4.jar with timestamp 1554241881940
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/com.apple_AppleJavaExtensions-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.apple_AppleJavaExtensions-1.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp472684868832584028.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.apple_AppleJavaExtensions-1.4.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/tl.lin_lintools-datatypes-1.0.0.jar with timestamp 1554241881937
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/tl.lin_lintools-datatypes-1.0.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/tl.lin_lintools-datatypes-1.0.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8653540153520270427.tmp
2019-04-02 17:51:26 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/tl.lin_lintools-datatypes-1.0.0.jar to class loader
2019-04-02 17:51:26 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.mortbay.jetty_jetty-6.1.26.jar with timestamp 1554241881939
2019-04-02 17:51:26 DEBUG TransportClient:167 - Sending stream request for /jars/org.mortbay.jetty_jetty-6.1.26.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:26 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.mortbay.jetty_jetty-6.1.26.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3536970046292533377.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.mortbay.jetty_jetty-6.1.26.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-analyzers-common-4.10.3.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-analyzers-common-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-analyzers-common-4.10.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp897166119833725451.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.lucene_lucene-analyzers-common-4.10.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/de.jollyday_jollyday-0.4.9.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/de.jollyday_jollyday-0.4.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/de.jollyday_jollyday-0.4.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp147964201172995929.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/de.jollyday_jollyday-0.4.9.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/it.unimi.dsi_dsiutils-2.0.12.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/it.unimi.dsi_dsiutils-2.0.12.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/it.unimi.dsi_dsiutils-2.0.12.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5665822390189454543.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/it.unimi.dsi_dsiutils-2.0.12.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/jline_jline-0.9.94.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/jline_jline-0.9.94.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/jline_jline-0.9.94.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2724359975965866206.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/jline_jline-0.9.94.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.spire-math_spire-macros_2.11-0.13.0.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.spire-math_spire-macros_2.11-0.13.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.spire-math_spire-macros_2.11-0.13.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5284986588293557148.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.spire-math_spire-macros_2.11-0.13.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5225591455445688584.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.fasterxml.jackson.module_jackson-module-scala_2.11-2.8.8.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8612132187658473755.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.ccil.cowan.tagsoup_tagsoup-1.2.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xalan_xalan-2.7.0.jar with timestamp 1554241881941
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/xalan_xalan-2.7.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xalan_xalan-2.7.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6445335053135250946.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/xalan_xalan-2.7.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sourceforge.jmatio_jmatio-1.0.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/net.sourceforge.jmatio_jmatio-1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sourceforge.jmatio_jmatio-1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6078117940349118978.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.sourceforge.jmatio_jmatio-1.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-core-asl-1.9.13.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-core-asl-1.9.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-core-asl-1.9.13.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp511330874242346928.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.jackson_jackson-core-asl-1.9.13.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.jsoup_jsoup-1.7.3.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.jsoup_jsoup-1.7.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.jsoup_jsoup-1.7.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5815182624486173784.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.jsoup_jsoup-1.7.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/tomcat_jasper-runtime-5.5.23.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/tomcat_jasper-runtime-5.5.23.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/tomcat_jasper-runtime-5.5.23.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1002181053629123293.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/tomcat_jasper-runtime-5.5.23.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-core-1.9.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-core-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-core-1.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1383772076501867312.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.sun.jersey_jersey-core-1.9.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.rogach_scallop_2.11-3.1.2.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.rogach_scallop_2.11-3.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.rogach_scallop_2.11-3.1.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8625228951825186466.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.rogach_scallop_2.11-3.1.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp515228326706959975.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.ws.xmlschema_xmlschema-core-2.1.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.core_sis-metadata-0.5.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.core_sis-metadata-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.core_sis-metadata-0.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8321716999011191060.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.sis.core_sis-metadata-0.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scala-compiler-2.11.0.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scala-compiler-2.11.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scala-compiler-2.11.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7962170494704204473.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scala-lang_scala-compiler-2.11.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.esotericsoftware_minlog-1.3.0.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.esotericsoftware_minlog-1.3.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.esotericsoftware_minlog-1.3.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7223401892787856086.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.esotericsoftware_minlog-1.3.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_jul-to-slf4j-1.7.24.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.slf4j_jul-to-slf4j-1.7.24.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.slf4j_jul-to-slf4j-1.7.24.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8278868607450731153.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.slf4j_jul-to-slf4j-1.7.24.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.pdfbox_jempbox-1.8.10.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.pdfbox_jempbox-1.8.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.pdfbox_jempbox-1.8.10.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7531569699161665654.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.pdfbox_jempbox-1.8.10.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.curator_curator-client-2.6.0.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.curator_curator-client-2.6.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.curator_curator-client-2.6.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3951698651882430641.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.curator_curator-client-2.6.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-scratchpad-3.13.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-scratchpad-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-scratchpad-3.13.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5547902715149645802.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.poi_poi-scratchpad-3.13.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar with timestamp 1554241881936
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1999542621965128935.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scala-lang_scala-parser-combinators-2.11.0-M4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.xerial.snappy_snappy-java-1.1.4.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.xerial.snappy_snappy-java-1.1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.xerial.snappy_snappy-java-1.1.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3941315100044653595.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.xerial.snappy_snappy-java-1.1.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/joda-time_joda-time-2.2.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/joda-time_joda-time-2.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/joda-time_joda-time-2.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5783355886613465344.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/joda-time_joda-time-2.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.quartz-scheduler_quartz-2.2.0.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.quartz-scheduler_quartz-2.2.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.quartz-scheduler_quartz-2.2.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp500969542104374564.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.quartz-scheduler_quartz-2.2.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7466466843801458564.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.cxf_cxf-rt-frontend-jaxrs-3.0.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/regexp_regexp-1.3.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/regexp_regexp-1.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/regexp_regexp-1.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3825318394724027984.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/regexp_regexp-1.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.httpcomponents_httpmime-4.2.6.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.httpcomponents_httpmime-4.2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.httpcomponents_httpmime-4.2.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8051959742249252173.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.httpcomponents_httpmime-4.2.6.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-net_commons-net-1.4.1.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/commons-net_commons-net-1.4.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-net_commons-net-1.4.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5910023793109246362.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-net_commons-net-1.4.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.guava_guava-18.0.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.guava_guava-18.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.guava_guava-18.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5891128478033275789.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.google.guava_guava-18.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.james_apache-mime4j-dom-0.7.2.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.james_apache-mime4j-dom-0.7.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.james_apache-mime4j-dom-0.7.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1632591260589354937.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.james_apache-mime4j-dom-0.7.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.woodstox_stax2-api-3.1.4.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.woodstox_stax2-api-3.1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.woodstox_stax2-api-3.1.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5132451003727589477.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.woodstox_stax2-api-3.1.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.beust_jcommander-1.35.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.beust_jcommander-1.35.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.beust_jcommander-1.35.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3554683917382280949.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.beust_jcommander-1.35.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-core-3.0.3.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-core-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-core-3.0.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4218175176969204467.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.cxf_cxf-core-3.0.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.htmlparser_htmlparser-1.6.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.htmlparser_htmlparser-1.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.htmlparser_htmlparser-1.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2286687158469747203.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.htmlparser_htmlparser-1.6.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.plexus_plexus-utils-1.5.6.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.plexus_plexus-utils-1.5.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.plexus_plexus-utils-1.5.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8737050056377171778.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.plexus_plexus-utils-1.5.6.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.spire-math_spire_2.11-0.13.0.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.spire-math_spire_2.11-0.13.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.spire-math_spire_2.11-0.13.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6553175685812538276.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.spire-math_spire_2.11-0.13.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.inject_guice-3.0.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.inject_guice-3.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.inject_guice-3.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4125619241295699899.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.google.inject_guice-3.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.storage_sis-storage-0.5.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.storage_sis-storage-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.storage_sis-storage-0.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7653922388243095840.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.sis.storage_sis-storage-0.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_jj2000-5.2.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_jj2000-5.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_jj2000-5.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4855149774736164857.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/edu.ucar_jj2000-5.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.protobuf_protobuf-java-3.2.0.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.protobuf_protobuf-java-3.2.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.protobuf_protobuf-java-3.2.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2517090487247077871.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.google.protobuf_protobuf-java-3.2.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.gagravarr_vorbis-java-core-0.6.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.gagravarr_vorbis-java-core-0.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.gagravarr_vorbis-java-core-0.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1917555633856355680.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.gagravarr_vorbis-java-core-0.6.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-3.13.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.poi_poi-3.13.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.poi_poi-3.13.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1536603223158607637.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.poi_poi-3.13.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.rometools_rome-1.5.1.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.rometools_rome-1.5.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.rometools_rome-1.5.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6739975103344015450.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.rometools_rome-1.5.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/oro_oro-2.0.8.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/oro_oro-2.0.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/oro_oro-2.0.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp642635691371531930.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/oro_oro-2.0.8.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_cdm-4.5.5.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_cdm-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_cdm-4.5.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8806831472959285377.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/edu.ucar_cdm-4.5.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sf.jwordnet_jwnl-1.3.3.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/net.sf.jwordnet_jwnl-1.3.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sf.jwordnet_jwnl-1.3.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2952910488272900070.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.sf.jwordnet_jwnl-1.3.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.httpcomponents_httpclient-4.2.6.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.httpcomponents_httpclient-4.2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.httpcomponents_httpclient-4.2.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4189623437220854172.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.httpcomponents_httpclient-4.2.6.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp463741650978166107.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scala-lang.modules_scala-parser-combinators_2.11-1.0.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.objenesis_objenesis-2.6.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.objenesis_objenesis-2.6.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.objenesis_objenesis-2.6.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4671289972817168294.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.objenesis_objenesis-2.6.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.james_apache-mime4j-core-0.7.2.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.james_apache-mime4j-core-0.7.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.james_apache-mime4j-core-0.7.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2019951694806791610.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.james_apache-mime4j-core-0.7.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sf.opencsv_opencsv-2.3.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/net.sf.opencsv_opencsv-2.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.sf.opencsv_opencsv-2.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3386772957675695367.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.sf.opencsv_opencsv-2.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.jdom_jdom2-2.0.4.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.jdom_jdom2-2.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.jdom_jdom2-2.0.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7278737032460427032.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.jdom_jdom2-2.0.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.adobe.xmp_xmpcore-5.1.2.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.adobe.xmp_xmpcore-5.1.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.adobe.xmp_xmpcore-5.1.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4404850069874088995.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.adobe.xmp_xmpcore-5.1.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.drewnoakes_metadata-extractor-2.8.0.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.drewnoakes_metadata-extractor-2.8.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.drewnoakes_metadata-extractor-2.8.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8894449605032658993.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.drewnoakes_metadata-extractor-2.8.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.opengis_geoapi-3.0.0.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.opengis_geoapi-3.0.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.opengis_geoapi-3.0.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3733682847432294564.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.opengis_geoapi-3.0.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-server-1.9.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-server-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-server-1.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7616970554277947387.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.sun.jersey_jersey-server-1.9.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_httpservices-4.5.5.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_httpservices-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_httpservices-4.5.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5379871421062519772.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/edu.ucar_httpservices-4.5.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.bouncycastle_bcpkix-jdk15on-1.52.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.bouncycastle_bcpkix-jdk15on-1.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.bouncycastle_bcpkix-jdk15on-1.52.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3571772055958594984.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.bouncycastle_bcpkix-jdk15on-1.52.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.tukaani_xz-1.5.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.tukaani_xz-1.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.tukaani_xz-1.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp185651109603082875.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.tukaani_xz-1.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey.contribs_jersey-guice-1.9.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey.contribs_jersey-guice-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey.contribs_jersey-guice-1.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6819066129716752077.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.sun.jersey.contribs_jersey-guice-1.9.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/c3p0_c3p0-0.9.1.1.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/c3p0_c3p0-0.9.1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/c3p0_c3p0-0.9.1.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp816885956772545195.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/c3p0_c3p0-0.9.1.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.code.findbugs_jsr305-1.3.9.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.code.findbugs_jsr305-1.3.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.code.findbugs_jsr305-1.3.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5653727463318606403.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.google.code.findbugs_jsr305-1.3.9.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.netpreserve.commons_webarchive-commons-1.1.8.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.netpreserve.commons_webarchive-commons-1.1.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.netpreserve.commons_webarchive-commons-1.1.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4488642439318477368.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.netpreserve.commons_webarchive-commons-1.1.8.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scalanlp_breeze_2.11-0.13.1.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.scalanlp_breeze_2.11-0.13.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.scalanlp_breeze_2.11-0.13.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4594553996322517179.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.scalanlp_breeze_2.11-0.13.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json4s_json4s-jackson_2.11-3.2.11.jar with timestamp 1554241881936
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.json4s_json4s-jackson_2.11-3.2.11.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json4s_json4s-jackson_2.11-3.2.11.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2712811451745959267.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.json4s_json4s-jackson_2.11-3.2.11.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-common-2.6.5.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-common-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-common-2.6.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1432173576960168526.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.hadoop_hadoop-common-2.6.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-json-1.9.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.jersey_jersey-json-1.9.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.jersey_jersey-json-1.9.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6309809669149458382.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.sun.jersey_jersey-json-1.9.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.jdom_jdom-2.0.2.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.jdom_jdom-2.0.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.jdom_jdom-2.0.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp634006638056140355.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.jdom_jdom-2.0.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.stanford.nlp_stanford-corenlp-3.8.0.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/edu.stanford.nlp_stanford-corenlp-3.8.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.stanford.nlp_stanford-corenlp-3.8.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3074632601337463946.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/edu.stanford.nlp_stanford-corenlp-3.8.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3071234912518925495.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.hadoop_hadoop-yarn-common-2.6.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-compress-1.16.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-compress-1.16.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-compress-1.16.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5881655593060223783.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.commons_commons-compress-1.16.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.jcraft_jsch-0.1.42.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.jcraft_jsch-0.1.42.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.jcraft_jsch-0.1.42.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5835970285459010853.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.jcraft_jsch-0.1.42.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.java.dev.jets3t_jets3t-0.6.1.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/net.java.dev.jets3t_jets3t-0.6.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/net.java.dev.jets3t_jets3t-0.6.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4714673705916518214.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/net.java.dev.jets3t_jets3t-0.6.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.avro_avro-1.7.4.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.avro_avro-1.7.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.avro_avro-1.7.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2659178645285254049.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.avro_avro-1.7.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4947441244424132543.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.directory.server_apacheds-kerberos-codec-2.0.0-M15.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/tomcat_jasper-compiler-5.5.23.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/tomcat_jasper-compiler-5.5.23.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/tomcat_jasper-compiler-5.5.23.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4681546109007986237.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/tomcat_jasper-compiler-5.5.23.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2073104010090254983.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.codehaus.jackson_jackson-mapper-asl-1.5.2.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json4s_json4s-ast_2.11-3.2.11.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.json4s_json4s-ast_2.11-3.2.11.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json4s_json4s-ast_2.11-3.2.11.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4916302642017598834.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.json4s_json4s-ast_2.11-3.2.11.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.glassfish_javax.json-1.0.4.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.glassfish_javax.json-1.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.glassfish_javax.json-1.0.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4387599576183712803.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.glassfish_javax.json-1.0.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xml-apis_xml-apis-1.4.01.jar with timestamp 1554241881944
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/xml-apis_xml-apis-1.4.01.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xml-apis_xml-apis-1.4.01.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5772708369619891659.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/xml-apis_xml-apis-1.4.01.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_udunits-4.5.5.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_udunits-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_udunits-4.5.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6497178195448007352.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/edu.ucar_udunits-4.5.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.thoughtworks.paranamer_paranamer-2.8.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.thoughtworks.paranamer_paranamer-2.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.thoughtworks.paranamer_paranamer-2.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5834063058419484184.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.thoughtworks.paranamer_paranamer-2.8.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.servlet.jsp_jsp-api-2.1.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/javax.servlet.jsp_jsp-api-2.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.servlet.jsp_jsp-api-2.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4043412808003131454.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.servlet.jsp_jsp-api-2.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8579406245756549044.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.sun.xml.bind_jaxb-impl-2.2.3-1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8533531998817406268.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.cxf_cxf-rt-rs-client-3.0.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.httpcomponents_httpcore-4.3.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.httpcomponents_httpcore-4.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.httpcomponents_httpcore-4.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5014677873532471117.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.httpcomponents_httpcore-4.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-annotations-2.6.5.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-annotations-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-annotations-2.6.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2299738507839454647.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.hadoop_hadoop-annotations-2.6.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.xml.bind_jaxb-api-2.2.7.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/javax.xml.bind_jaxb-api-2.2.7.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.xml.bind_jaxb-api-2.2.7.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp758900541521010844.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.xml.bind_jaxb-api-2.2.7.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.rometools_rome-utils-1.5.1.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.rometools_rome-utils-1.5.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.rometools_rome-utils-1.5.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7538416980210334585.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.rometools_rome-utils-1.5.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-exec-1.3.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.commons_commons-exec-1.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.commons_commons-exec-1.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1043918817822900139.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.commons_commons-exec-1.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json_json-20140107.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.json_json-20140107.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.json_json-20140107.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2776036223831492802.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.json_json-20140107.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.htrace_htrace-core-3.0.4.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.htrace_htrace-core-3.0.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.htrace_htrace-core-3.0.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3928274455776509936.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.htrace_htrace-core-3.0.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5268127529661181761.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.fasterxml.jackson.core_jackson-annotations-2.8.8.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.json-simple_json-simple-1.1.1.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.json-simple_json-simple-1.1.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.json-simple_json-simple-1.1.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2310915702990498904.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.googlecode.json-simple_json-simple-1.1.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp2217149327090953543.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.googlecode.efficient-java-matrix-library_ejml-0.23.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-sandbox-4.10.3.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.lucene_lucene-sandbox-4.10.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.lucene_lucene-sandbox-4.10.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3169668110750203256.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.lucene_lucene-sandbox-4.10.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7770424321324568040.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.hadoop_hadoop-yarn-api-2.6.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-io_commons-io-2.4.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/commons-io_commons-io-2.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/commons-io_commons-io-2.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6612958692940941794.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/commons-io_commons-io-2.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.code.gson_gson-2.3.1.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.code.gson_gson-2.3.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.code.gson_gson-2.3.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8784708711476006935.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.google.code.gson_gson-2.3.1.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.core_sis-utility-0.5.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.core_sis-utility-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.core_sis-utility-0.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp7419931634960842009.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.sis.core_sis-utility-0.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.pdfbox_pdfbox-1.8.10.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.pdfbox_pdfbox-1.8.10.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.pdfbox_pdfbox-1.8.10.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp6168702114502769527.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.pdfbox_pdfbox-1.8.10.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5570866267454872158.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.sonatype.sisu.inject_cglib-2.2.1-v20090111.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_netcdf4-4.5.5.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/edu.ucar_netcdf4-4.5.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/edu.ucar_netcdf4-4.5.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp793248184895099292.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/edu.ucar_netcdf4-4.5.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.maven.scm_maven-scm-api-1.4.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.maven.scm_maven-scm-api-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.maven.scm_maven-scm-api-1.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4160884413434477014.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.maven.scm_maven-scm-api-1.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.inject.extensions_guice-servlet-3.0.jar with timestamp 1554241881938
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.google.inject.extensions_guice-servlet-3.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.google.inject.extensions_guice-servlet-3.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3832680362131174750.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.google.inject.extensions_guice-servlet-3.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5212514464193563237.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.googlecode.juniversalchardet_juniversalchardet-1.0.3.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.storage_sis-netcdf-0.5.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.sis.storage_sis-netcdf-0.5.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.sis.storage_sis-netcdf-0.5.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp4408001568124932485.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.sis.storage_sis-netcdf-0.5.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp8229744942812527798.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.apache.maven.scm_maven-scm-provider-svn-commons-1.4.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xerces_xercesImpl-2.11.0.jar with timestamp 1554241881937
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/xerces_xercesImpl-2.11.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xerces_xercesImpl-2.11.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp3316693944718737557.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/xerces_xercesImpl-2.11.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.github.rwl_jtransforms-2.4.0.jar with timestamp 1554241881940
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/com.github.rwl_jtransforms-2.4.0.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/com.github.rwl_jtransforms-2.4.0.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp315333589425500150.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/com.github.rwl_jtransforms-2.4.0.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.bouncycastle_bcprov-jdk15on-1.52.jar with timestamp 1554241881942
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/org.bouncycastle_bcprov-jdk15on-1.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/org.bouncycastle_bcprov-jdk15on-1.52.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1742713682592010796.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/org.bouncycastle_bcprov-jdk15on-1.52.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xmlenc_xmlenc-0.52.jar with timestamp 1554241881939
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/xmlenc_xmlenc-0.52.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/xmlenc_xmlenc-0.52.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp1431599347737440908.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/xmlenc_xmlenc-0.52.jar to class loader
2019-04-02 17:51:27 INFO Executor:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.ws.rs_javax.ws.rs-api-2.0.1.jar with timestamp 1554241881943
2019-04-02 17:51:27 DEBUG TransportClient:167 - Sending stream request for /jars/javax.ws.rs_javax.ws.rs-api-2.0.1.jar to tuna.cs.uwaterloo.ca/129.97.186.18:40540
2019-04-02 17:51:27 INFO Utils:54 - Fetching spark://tuna.cs.uwaterloo.ca:40540/jars/javax.ws.rs_javax.ws.rs-api-2.0.1.jar to /tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/fetchFileTemp5832680813566115041.tmp
2019-04-02 17:51:27 INFO Executor:54 - Adding file:/tmp/spark-6a0cd4ff-9742-4779-9548-6a3a18acb2fe/userFiles-2a5633ce-9ad7-4330-9345-510cc9079573/javax.ws.rs_javax.ws.rs-api-2.0.1.jar to class loader
2019-04-02 17:51:27 DEBUG BlockManager:58 - Getting local block broadcast_1
2019-04-02 17:51:27 DEBUG BlockManager:58 - Level for block broadcast_1 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_21
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_4
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_4 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_20
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_29
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_18
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_21 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_27
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_18 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_6
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_11
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_23
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_29 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_3
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_20 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_15
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_13
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_9
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_0
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_24
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_0 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_9 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_13 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_15 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_20
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_3 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_29
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_23 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_11 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_17
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_28
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_2
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_6 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_5
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_19
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_18
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_8
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_27 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_21
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_4
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_27
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_6
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_28 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_17 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_11
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_23
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_3
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_15
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_13
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_9
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_0
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_24 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_17
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_28
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_24
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_29 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_18 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_21 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_6 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_11 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_15 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_3 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_23 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_17 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_24 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_0 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_9 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_13 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_7
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_27 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_2 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_5 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_5
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_19 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_20 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_4 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_28 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_5 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_19
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_2
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_22
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_10
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_2 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_19 not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB687252-20181005200930364-00000-h3.warc.gz:0+5328721
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_8 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_10 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_8
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_22 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_22
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block broadcast_0
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_10
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_8 not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828192900124-00001.warc.gz:0+1000119953
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB686320-20181002171615063-00000-h3.warc.gz:0+6944873
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB736980-20190212171926565-00000-h3.warc.gz:0+65799
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799564-20190110143759592-00000-h3.warc.gz:0+1000093057
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB735843-20190208133412633-00000-h3.warc.gz:0+827547
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB731325-20190123215103588-00000-h3.warc.gz:0+3489865
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799568-20190110164617521-00001-h3.warc.gz:0+594609693
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828194521735-00003.warc.gz:0+1225897961
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828213423418-00015.warc.gz:0+1704174998
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828214311760-00017.warc.gz:0+2691532705
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828211602861-00009.warc.gz:0+1392155257
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828213808501-00016.warc.gz:0+1802220796
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_26
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799564-20190110161932917-00001-h3.warc.gz:0+417902048
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828212222750-00011.warc.gz:0+1149972113
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_7 was not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799567-20190110143800722-00000-h3.warc.gz:0+9782
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828223017199-00020.warc.gz:0+1337641180
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB681536-20180917155801439-00001.warc.gz:0+942310743
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB736590-20190211125528746-00000-h3.warc.gz:0+486861
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799561-20190110143759762-00000-h3.warc.gz:0+1199526476
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_22 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_10 not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828195153288-00005.warc.gz:0+1029672488
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_7
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_26 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Level for block broadcast_0 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_7 not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB708304-20181106184510611-00000-h3.warc.gz:0+4299269
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_14
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_14 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_14
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828191514724-00000.warc.gz:0+1025178052
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_14 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_16
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_12
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_12 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_12
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_26
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB686465-20181002195728459-00000-h3.warc.gz:0+4888809
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_25
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_16 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_16
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828212452798-00012.warc.gz:0+1202615318
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_1
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_26 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_12 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_25 was not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB735381-20190207122151467-00000-h3.warc.gz:0+2544947
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828202533622-00007.warc.gz:0+3047861372
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_1 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_25
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_1
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_25 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_1 not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_16 not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828212809324-00013.warc.gz:0+1283388473
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799568-20190110143759680-00000-h3.warc.gz:0+1008432521
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB681002-20180914130714940-00000.warc.gz:0+11103439
2019-04-02 17:51:28 INFO MemoryStore:54 - Block rdd_3_28 stored as values in memory (estimated size 24.0 B, free 55.8 GB)
2019-04-02 17:51:28 INFO BlockManagerInfo:54 - Added rdd_3_28 in memory on tuna.cs.uwaterloo.ca:36364 (size: 24.0 B, free: 55.8 GB)
2019-04-02 17:51:28 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_28
2019-04-02 17:51:28 DEBUG BlockManager:58 - Told master about block rdd_3_28
2019-04-02 17:51:28 DEBUG BlockManager:58 - Put block rdd_3_28 locally took 224 ms
2019-04-02 17:51:28 DEBUG BlockManager:58 - Putting block rdd_3_28 without replication took 227 ms
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_28
2019-04-02 17:51:28 INFO MemoryStore:54 - Block rdd_3_27 stored as values in memory (estimated size 24.0 B, free 55.8 GB)
2019-04-02 17:51:28 DEBUG BlockManager:58 - Level for block rdd_3_28 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:28 INFO BlockManagerInfo:54 - Added rdd_3_27 in memory on tuna.cs.uwaterloo.ca:36364 (size: 24.0 B, free: 55.8 GB)
2019-04-02 17:51:28 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_27
2019-04-02 17:51:28 DEBUG BlockManager:58 - Told master about block rdd_3_27
2019-04-02 17:51:28 DEBUG BlockManager:58 - Put block rdd_3_27 locally took 225 ms
2019-04-02 17:51:28 DEBUG BlockManager:58 - Putting block rdd_3_27 without replication took 225 ms
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_27
2019-04-02 17:51:28 DEBUG BlockManager:58 - Level for block rdd_3_27 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:28 DEBUG TaskMemoryManager:233 - Task 27 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@150add9f
2019-04-02 17:51:28 DEBUG TaskMemoryManager:233 - Task 28 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@f28fb0
2019-04-02 17:51:28 INFO Executor:54 - Finished task 28.0 in stage 0.0 (TID 28). 1173 bytes result sent to driver
2019-04-02 17:51:28 INFO Executor:54 - Finished task 27.0 in stage 0.0 (TID 27). 1173 bytes result sent to driver
2019-04-02 17:51:28 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:28 INFO TaskSetManager:54 - Starting task 30.0 in stage 0.0 (TID 30, localhost, executor driver, partition 30, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:28 INFO Executor:54 - Running task 30.0 in stage 0.0 (TID 30)
2019-04-02 17:51:28 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:28 INFO TaskSetManager:54 - Starting task 31.0 in stage 0.0 (TID 31, localhost, executor driver, partition 31, PROCESS_LOCAL, 8039 bytes)
2019-04-02 17:51:28 INFO Executor:54 - Running task 31.0 in stage 0.0 (TID 31)
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_30
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_30 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_30
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_30 not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828193814594-00002.warc.gz:0+1375687319
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting local block rdd_3_31
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_31 was not found
2019-04-02 17:51:28 DEBUG BlockManager:58 - Getting remote block rdd_3_31
2019-04-02 17:51:28 DEBUG BlockManager:58 - Block rdd_3_31 not found
2019-04-02 17:51:28 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB681660-20180917193617860-00000.warc.gz:0+160990920
2019-04-02 17:51:28 INFO TaskSetManager:54 - Finished task 28.0 in stage 0.0 (TID 28) in 2427 ms on localhost (executor driver) (1/56)
2019-04-02 17:51:28 INFO TaskSetManager:54 - Finished task 27.0 in stage 0.0 (TID 27) in 2432 ms on localhost (executor driver) (2/56)
2019-04-02 17:51:28 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:28 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:30 INFO MemoryStore:54 - Block rdd_3_4 stored as values in memory (estimated size 290.6 KB, free 55.8 GB)
2019-04-02 17:51:30 INFO BlockManagerInfo:54 - Added rdd_3_4 in memory on tuna.cs.uwaterloo.ca:36364 (size: 290.6 KB, free: 55.8 GB)
2019-04-02 17:51:30 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_4
2019-04-02 17:51:30 DEBUG BlockManager:58 - Told master about block rdd_3_4
2019-04-02 17:51:30 DEBUG BlockManager:58 - Put block rdd_3_4 locally took 1993 ms
2019-04-02 17:51:30 DEBUG BlockManager:58 - Putting block rdd_3_4 without replication took 1993 ms
2019-04-02 17:51:30 DEBUG BlockManager:58 - Getting local block rdd_3_4
2019-04-02 17:51:30 DEBUG BlockManager:58 - Level for block rdd_3_4 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:30 DEBUG TaskMemoryManager:233 - Task 4 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@48670830
2019-04-02 17:51:30 INFO Executor:54 - Finished task 4.0 in stage 0.0 (TID 4). 1216 bytes result sent to driver
2019-04-02 17:51:30 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:30 INFO TaskSetManager:54 - Starting task 32.0 in stage 0.0 (TID 32, localhost, executor driver, partition 32, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:30 INFO Executor:54 - Running task 32.0 in stage 0.0 (TID 32)
2019-04-02 17:51:30 INFO TaskSetManager:54 - Finished task 4.0 in stage 0.0 (TID 4) in 4040 ms on localhost (executor driver) (3/56)
2019-04-02 17:51:30 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:30 DEBUG BlockManager:58 - Getting local block rdd_3_32
2019-04-02 17:51:30 DEBUG BlockManager:58 - Block rdd_3_32 was not found
2019-04-02 17:51:30 DEBUG BlockManager:58 - Getting remote block rdd_3_32
2019-04-02 17:51:30 DEBUG BlockManager:58 - Block rdd_3_32 not found
2019-04-02 17:51:30 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB696752-20181101172748207-00000-h3.warc.gz:0+16870810
2019-04-02 17:51:31 INFO MemoryStore:54 - Block rdd_3_5 stored as values in memory (estimated size 7.7 MB, free 55.8 GB)
2019-04-02 17:51:31 INFO BlockManagerInfo:54 - Added rdd_3_5 in memory on tuna.cs.uwaterloo.ca:36364 (size: 7.7 MB, free: 55.8 GB)
2019-04-02 17:51:31 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_5
2019-04-02 17:51:31 DEBUG BlockManager:58 - Told master about block rdd_3_5
2019-04-02 17:51:31 DEBUG BlockManager:58 - Put block rdd_3_5 locally took 3493 ms
2019-04-02 17:51:31 DEBUG BlockManager:58 - Putting block rdd_3_5 without replication took 3493 ms
2019-04-02 17:51:31 DEBUG BlockManager:58 - Getting local block rdd_3_5
2019-04-02 17:51:31 DEBUG BlockManager:58 - Level for block rdd_3_5 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:31 DEBUG TaskMemoryManager:233 - Task 5 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@2851d477
2019-04-02 17:51:31 INFO Executor:54 - Finished task 5.0 in stage 0.0 (TID 5). 1259 bytes result sent to driver
2019-04-02 17:51:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:31 INFO TaskSetManager:54 - Starting task 33.0 in stage 0.0 (TID 33, localhost, executor driver, partition 33, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:31 INFO Executor:54 - Running task 33.0 in stage 0.0 (TID 33)
2019-04-02 17:51:31 INFO TaskSetManager:54 - Finished task 5.0 in stage 0.0 (TID 5) in 5523 ms on localhost (executor driver) (4/56)
2019-04-02 17:51:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:31 DEBUG BlockManager:58 - Getting local block rdd_3_33
2019-04-02 17:51:31 DEBUG BlockManager:58 - Block rdd_3_33 was not found
2019-04-02 17:51:31 DEBUG BlockManager:58 - Getting remote block rdd_3_33
2019-04-02 17:51:31 DEBUG BlockManager:58 - Block rdd_3_33 not found
2019-04-02 17:51:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799561-20190110150036185-00002-h3.warc.gz:0+12328
2019-04-02 17:51:31 INFO MemoryStore:54 - Block rdd_3_33 stored as values in memory (estimated size 24.0 B, free 55.8 GB)
2019-04-02 17:51:31 INFO BlockManagerInfo:54 - Added rdd_3_33 in memory on tuna.cs.uwaterloo.ca:36364 (size: 24.0 B, free: 55.8 GB)
2019-04-02 17:51:31 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_33
2019-04-02 17:51:31 DEBUG BlockManager:58 - Told master about block rdd_3_33
2019-04-02 17:51:31 DEBUG BlockManager:58 - Put block rdd_3_33 locally took 403 ms
2019-04-02 17:51:31 DEBUG BlockManager:58 - Putting block rdd_3_33 without replication took 403 ms
2019-04-02 17:51:31 DEBUG BlockManager:58 - Getting local block rdd_3_33
2019-04-02 17:51:31 DEBUG BlockManager:58 - Level for block rdd_3_33 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:31 DEBUG TaskMemoryManager:233 - Task 33 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@ed4ed1a
2019-04-02 17:51:31 INFO Executor:54 - Finished task 33.0 in stage 0.0 (TID 33). 1130 bytes result sent to driver
2019-04-02 17:51:31 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:31 INFO TaskSetManager:54 - Starting task 34.0 in stage 0.0 (TID 34, localhost, executor driver, partition 34, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:31 INFO Executor:54 - Running task 34.0 in stage 0.0 (TID 34)
2019-04-02 17:51:31 INFO TaskSetManager:54 - Finished task 33.0 in stage 0.0 (TID 33) in 449 ms on localhost (executor driver) (5/56)
2019-04-02 17:51:31 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:31 DEBUG BlockManager:58 - Getting local block rdd_3_34
2019-04-02 17:51:31 DEBUG BlockManager:58 - Block rdd_3_34 was not found
2019-04-02 17:51:31 DEBUG BlockManager:58 - Getting remote block rdd_3_34
2019-04-02 17:51:31 DEBUG BlockManager:58 - Block rdd_3_34 not found
2019-04-02 17:51:31 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828194835985-00004.warc.gz:0+1225892508
2019-04-02 17:51:32 INFO MemoryStore:54 - Block rdd_3_12 stored as values in memory (estimated size 2.3 MB, free 55.8 GB)
2019-04-02 17:51:32 INFO BlockManagerInfo:54 - Added rdd_3_12 in memory on tuna.cs.uwaterloo.ca:36364 (size: 2.3 MB, free: 55.8 GB)
2019-04-02 17:51:32 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_12
2019-04-02 17:51:32 DEBUG BlockManager:58 - Told master about block rdd_3_12
2019-04-02 17:51:32 DEBUG BlockManager:58 - Put block rdd_3_12 locally took 4342 ms
2019-04-02 17:51:32 DEBUG BlockManager:58 - Putting block rdd_3_12 without replication took 4342 ms
2019-04-02 17:51:32 DEBUG BlockManager:58 - Getting local block rdd_3_12
2019-04-02 17:51:32 DEBUG BlockManager:58 - Level for block rdd_3_12 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:32 DEBUG TaskMemoryManager:233 - Task 12 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@305ccc71
2019-04-02 17:51:32 INFO Executor:54 - Finished task 12.0 in stage 0.0 (TID 12). 1216 bytes result sent to driver
2019-04-02 17:51:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:32 INFO TaskSetManager:54 - Starting task 35.0 in stage 0.0 (TID 35, localhost, executor driver, partition 35, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:32 INFO Executor:54 - Running task 35.0 in stage 0.0 (TID 35)
2019-04-02 17:51:32 INFO TaskSetManager:54 - Finished task 12.0 in stage 0.0 (TID 12) in 6378 ms on localhost (executor driver) (6/56)
2019-04-02 17:51:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:32 DEBUG BlockManager:58 - Getting local block rdd_3_35
2019-04-02 17:51:32 DEBUG BlockManager:58 - Block rdd_3_35 was not found
2019-04-02 17:51:32 DEBUG BlockManager:58 - Getting remote block rdd_3_35
2019-04-02 17:51:32 DEBUG BlockManager:58 - Block rdd_3_35 not found
2019-04-02 17:51:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB732496-SEED1799567-20190128183347593-00000-h3.warc.gz:0+187753
2019-04-02 17:51:32 INFO MemoryStore:54 - Block rdd_3_35 stored as values in memory (estimated size 656.8 KB, free 55.8 GB)
2019-04-02 17:51:32 INFO BlockManagerInfo:54 - Added rdd_3_35 in memory on tuna.cs.uwaterloo.ca:36364 (size: 656.8 KB, free: 55.8 GB)
2019-04-02 17:51:32 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_35
2019-04-02 17:51:32 DEBUG BlockManager:58 - Told master about block rdd_3_35
2019-04-02 17:51:32 DEBUG BlockManager:58 - Put block rdd_3_35 locally took 467 ms
2019-04-02 17:51:32 DEBUG BlockManager:58 - Putting block rdd_3_35 without replication took 467 ms
2019-04-02 17:51:32 DEBUG BlockManager:58 - Getting local block rdd_3_35
2019-04-02 17:51:32 DEBUG BlockManager:58 - Level for block rdd_3_35 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:32 DEBUG TaskMemoryManager:233 - Task 35 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@29cca70b
2019-04-02 17:51:32 INFO Executor:54 - Finished task 35.0 in stage 0.0 (TID 35). 1216 bytes result sent to driver
2019-04-02 17:51:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:32 INFO TaskSetManager:54 - Starting task 36.0 in stage 0.0 (TID 36, localhost, executor driver, partition 36, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:32 INFO Executor:54 - Running task 36.0 in stage 0.0 (TID 36)
2019-04-02 17:51:32 INFO TaskSetManager:54 - Finished task 35.0 in stage 0.0 (TID 35) in 482 ms on localhost (executor driver) (7/56)
2019-04-02 17:51:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:32 DEBUG BlockManager:58 - Getting local block rdd_3_36
2019-04-02 17:51:32 DEBUG BlockManager:58 - Block rdd_3_36 was not found
2019-04-02 17:51:32 DEBUG BlockManager:58 - Getting remote block rdd_3_36
2019-04-02 17:51:32 DEBUG BlockManager:58 - Block rdd_3_36 not found
2019-04-02 17:51:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1855311-20190110143803510-00000-h3.warc.gz:0+544105
2019-04-02 17:51:33 INFO MemoryStore:54 - Block rdd_3_36 stored as values in memory (estimated size 184.7 KB, free 55.8 GB)
2019-04-02 17:51:33 INFO BlockManagerInfo:54 - Added rdd_3_36 in memory on tuna.cs.uwaterloo.ca:36364 (size: 184.7 KB, free: 55.8 GB)
2019-04-02 17:51:33 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_36
2019-04-02 17:51:33 DEBUG BlockManager:58 - Told master about block rdd_3_36
2019-04-02 17:51:33 DEBUG BlockManager:58 - Put block rdd_3_36 locally took 304 ms
2019-04-02 17:51:33 DEBUG BlockManager:58 - Putting block rdd_3_36 without replication took 304 ms
2019-04-02 17:51:33 DEBUG BlockManager:58 - Getting local block rdd_3_36
2019-04-02 17:51:33 DEBUG BlockManager:58 - Level for block rdd_3_36 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:33 DEBUG TaskMemoryManager:233 - Task 36 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@12748ee0
2019-04-02 17:51:33 INFO Executor:54 - Finished task 36.0 in stage 0.0 (TID 36). 1173 bytes result sent to driver
2019-04-02 17:51:33 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:33 INFO TaskSetManager:54 - Starting task 37.0 in stage 0.0 (TID 37, localhost, executor driver, partition 37, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:33 INFO Executor:54 - Running task 37.0 in stage 0.0 (TID 37)
2019-04-02 17:51:33 INFO TaskSetManager:54 - Finished task 36.0 in stage 0.0 (TID 36) in 318 ms on localhost (executor driver) (8/56)
2019-04-02 17:51:33 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:33 DEBUG BlockManager:58 - Getting local block rdd_3_37
2019-04-02 17:51:33 DEBUG BlockManager:58 - Block rdd_3_37 was not found
2019-04-02 17:51:33 DEBUG BlockManager:58 - Getting remote block rdd_3_37
2019-04-02 17:51:33 DEBUG BlockManager:58 - Block rdd_3_37 not found
2019-04-02 17:51:33 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799566-20190110143759686-00000-h3.warc.gz:0+23467416
2019-04-02 17:51:33 INFO MemoryStore:54 - Block rdd_3_24 stored as values in memory (estimated size 12.5 MB, free 55.8 GB)
2019-04-02 17:51:33 INFO BlockManagerInfo:54 - Added rdd_3_24 in memory on tuna.cs.uwaterloo.ca:36364 (size: 12.5 MB, free: 55.8 GB)
2019-04-02 17:51:33 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_24
2019-04-02 17:51:33 DEBUG BlockManager:58 - Told master about block rdd_3_24
2019-04-02 17:51:33 DEBUG BlockManager:58 - Put block rdd_3_24 locally took 5279 ms
2019-04-02 17:51:33 DEBUG BlockManager:58 - Putting block rdd_3_24 without replication took 5279 ms
2019-04-02 17:51:33 DEBUG BlockManager:58 - Getting local block rdd_3_24
2019-04-02 17:51:33 DEBUG BlockManager:58 - Level for block rdd_3_24 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:33 DEBUG TaskMemoryManager:233 - Task 24 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@29fd355e
2019-04-02 17:51:33 INFO Executor:54 - Finished task 24.0 in stage 0.0 (TID 24). 1216 bytes result sent to driver
2019-04-02 17:51:33 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:33 INFO TaskSetManager:54 - Starting task 38.0 in stage 0.0 (TID 38, localhost, executor driver, partition 38, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:33 INFO Executor:54 - Running task 38.0 in stage 0.0 (TID 38)
2019-04-02 17:51:33 INFO TaskSetManager:54 - Finished task 24.0 in stage 0.0 (TID 24) in 7284 ms on localhost (executor driver) (9/56)
2019-04-02 17:51:33 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:33 DEBUG BlockManager:58 - Getting local block rdd_3_38
2019-04-02 17:51:33 DEBUG BlockManager:58 - Block rdd_3_38 was not found
2019-04-02 17:51:33 DEBUG BlockManager:58 - Getting remote block rdd_3_38
2019-04-02 17:51:33 DEBUG BlockManager:58 - Block rdd_3_38 not found
2019-04-02 17:51:33 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799565-20190110143759559-00000-h3.warc.gz:0+717999
2019-04-02 17:51:34 INFO MemoryStore:54 - Block rdd_3_38 stored as values in memory (estimated size 788.0 KB, free 55.8 GB)
2019-04-02 17:51:34 INFO BlockManagerInfo:54 - Added rdd_3_38 in memory on tuna.cs.uwaterloo.ca:36364 (size: 788.0 KB, free: 55.8 GB)
2019-04-02 17:51:34 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_38
2019-04-02 17:51:34 DEBUG BlockManager:58 - Told master about block rdd_3_38
2019-04-02 17:51:34 DEBUG BlockManager:58 - Put block rdd_3_38 locally took 703 ms
2019-04-02 17:51:34 DEBUG BlockManager:58 - Putting block rdd_3_38 without replication took 703 ms
2019-04-02 17:51:34 DEBUG BlockManager:58 - Getting local block rdd_3_38
2019-04-02 17:51:34 DEBUG BlockManager:58 - Level for block rdd_3_38 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:34 DEBUG TaskMemoryManager:233 - Task 38 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@56174a
2019-04-02 17:51:34 INFO Executor:54 - Finished task 38.0 in stage 0.0 (TID 38). 1216 bytes result sent to driver
2019-04-02 17:51:34 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:34 INFO TaskSetManager:54 - Starting task 39.0 in stage 0.0 (TID 39, localhost, executor driver, partition 39, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:34 INFO Executor:54 - Running task 39.0 in stage 0.0 (TID 39)
2019-04-02 17:51:34 INFO TaskSetManager:54 - Finished task 38.0 in stage 0.0 (TID 38) in 714 ms on localhost (executor driver) (10/56)
2019-04-02 17:51:34 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:34 DEBUG BlockManager:58 - Getting local block rdd_3_39
2019-04-02 17:51:34 DEBUG BlockManager:58 - Block rdd_3_39 was not found
2019-04-02 17:51:34 DEBUG BlockManager:58 - Getting remote block rdd_3_39
2019-04-02 17:51:34 DEBUG BlockManager:58 - Block rdd_3_39 not found
2019-04-02 17:51:34 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828211946243-00010.warc.gz:0+1105587835
2019-04-02 17:51:34 INFO MemoryStore:54 - Block rdd_3_10 stored as values in memory (estimated size 11.4 MB, free 55.8 GB)
2019-04-02 17:51:34 INFO BlockManagerInfo:54 - Added rdd_3_10 in memory on tuna.cs.uwaterloo.ca:36364 (size: 11.4 MB, free: 55.8 GB)
2019-04-02 17:51:34 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_10
2019-04-02 17:51:34 DEBUG BlockManager:58 - Told master about block rdd_3_10
2019-04-02 17:51:34 DEBUG BlockManager:58 - Put block rdd_3_10 locally took 6403 ms
2019-04-02 17:51:34 DEBUG BlockManager:58 - Putting block rdd_3_10 without replication took 6403 ms
2019-04-02 17:51:34 DEBUG BlockManager:58 - Getting local block rdd_3_10
2019-04-02 17:51:34 DEBUG BlockManager:58 - Level for block rdd_3_10 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:34 DEBUG TaskMemoryManager:233 - Task 10 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@6bbd8c47
2019-04-02 17:51:34 INFO Executor:54 - Finished task 10.0 in stage 0.0 (TID 10). 1216 bytes result sent to driver
2019-04-02 17:51:34 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:34 INFO TaskSetManager:54 - Starting task 40.0 in stage 0.0 (TID 40, localhost, executor driver, partition 40, PROCESS_LOCAL, 8040 bytes)
2019-04-02 17:51:34 INFO Executor:54 - Running task 40.0 in stage 0.0 (TID 40)
2019-04-02 17:51:34 INFO TaskSetManager:54 - Finished task 10.0 in stage 0.0 (TID 10) in 8432 ms on localhost (executor driver) (11/56)
2019-04-02 17:51:34 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:34 DEBUG BlockManager:58 - Getting local block rdd_3_40
2019-04-02 17:51:34 DEBUG BlockManager:58 - Block rdd_3_40 was not found
2019-04-02 17:51:34 DEBUG BlockManager:58 - Getting remote block rdd_3_40
2019-04-02 17:51:34 DEBUG BlockManager:58 - Block rdd_3_40 not found
2019-04-02 17:51:34 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB696655-SEED1855311-20181101150538679-00000-jqlwpa42.warc.gz:0+3274004
2019-04-02 17:51:36 INFO MemoryStore:54 - Block rdd_3_19 stored as values in memory (estimated size 4.7 MB, free 55.8 GB)
2019-04-02 17:51:36 INFO BlockManagerInfo:54 - Added rdd_3_19 in memory on tuna.cs.uwaterloo.ca:36364 (size: 4.7 MB, free: 55.8 GB)
2019-04-02 17:51:36 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_19
2019-04-02 17:51:36 DEBUG BlockManager:58 - Told master about block rdd_3_19
2019-04-02 17:51:36 DEBUG BlockManager:58 - Put block rdd_3_19 locally took 8501 ms
2019-04-02 17:51:36 DEBUG BlockManager:58 - Putting block rdd_3_19 without replication took 8501 ms
2019-04-02 17:51:36 DEBUG BlockManager:58 - Getting local block rdd_3_19
2019-04-02 17:51:36 DEBUG BlockManager:58 - Level for block rdd_3_19 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:36 DEBUG TaskMemoryManager:233 - Task 19 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@7d8557b3
2019-04-02 17:51:36 INFO Executor:54 - Finished task 19.0 in stage 0.0 (TID 19). 1259 bytes result sent to driver
2019-04-02 17:51:36 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:36 INFO TaskSetManager:54 - Starting task 41.0 in stage 0.0 (TID 41, localhost, executor driver, partition 41, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:36 INFO Executor:54 - Running task 41.0 in stage 0.0 (TID 41)
2019-04-02 17:51:36 INFO TaskSetManager:54 - Finished task 19.0 in stage 0.0 (TID 19) in 10511 ms on localhost (executor driver) (12/56)
2019-04-02 17:51:36 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:36 DEBUG BlockManager:58 - Getting local block rdd_3_41
2019-04-02 17:51:36 DEBUG BlockManager:58 - Block rdd_3_41 was not found
2019-04-02 17:51:36 DEBUG BlockManager:58 - Getting remote block rdd_3_41
2019-04-02 17:51:36 DEBUG BlockManager:58 - Block rdd_3_41 not found
2019-04-02 17:51:36 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828230433994-00021.warc.gz:0+748633570
2019-04-02 17:51:36 INFO MemoryStore:54 - Block rdd_3_15 stored as values in memory (estimated size 79.8 MB, free 55.7 GB)
2019-04-02 17:51:36 INFO BlockManagerInfo:54 - Added rdd_3_15 in memory on tuna.cs.uwaterloo.ca:36364 (size: 79.8 MB, free: 55.7 GB)
2019-04-02 17:51:36 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_15
2019-04-02 17:51:36 DEBUG BlockManager:58 - Told master about block rdd_3_15
2019-04-02 17:51:36 DEBUG BlockManager:58 - Put block rdd_3_15 locally took 8721 ms
2019-04-02 17:51:36 DEBUG BlockManager:58 - Putting block rdd_3_15 without replication took 8721 ms
2019-04-02 17:51:36 DEBUG BlockManager:58 - Getting local block rdd_3_15
2019-04-02 17:51:36 DEBUG BlockManager:58 - Level for block rdd_3_15 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:36 DEBUG TaskMemoryManager:233 - Task 15 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@3b4266d5
2019-04-02 17:51:36 INFO Executor:54 - Finished task 15.0 in stage 0.0 (TID 15). 1216 bytes result sent to driver
2019-04-02 17:51:36 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:36 INFO TaskSetManager:54 - Starting task 42.0 in stage 0.0 (TID 42, localhost, executor driver, partition 42, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:36 INFO Executor:54 - Running task 42.0 in stage 0.0 (TID 42)
2019-04-02 17:51:36 INFO TaskSetManager:54 - Finished task 15.0 in stage 0.0 (TID 15) in 10733 ms on localhost (executor driver) (13/56)
2019-04-02 17:51:36 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:36 DEBUG BlockManager:58 - Getting local block rdd_3_42
2019-04-02 17:51:36 DEBUG BlockManager:58 - Block rdd_3_42 was not found
2019-04-02 17:51:36 DEBUG BlockManager:58 - Getting remote block rdd_3_42
2019-04-02 17:51:36 DEBUG BlockManager:58 - Block rdd_3_42 not found
2019-04-02 17:51:36 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828220801526-00019.warc.gz:0+1000100089
2019-04-02 17:51:38 INFO MemoryStore:54 - Block rdd_3_7 stored as values in memory (estimated size 7.4 MB, free 55.7 GB)
2019-04-02 17:51:38 INFO BlockManagerInfo:54 - Added rdd_3_7 in memory on tuna.cs.uwaterloo.ca:36364 (size: 7.4 MB, free: 55.7 GB)
2019-04-02 17:51:38 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_7
2019-04-02 17:51:38 DEBUG BlockManager:58 - Told master about block rdd_3_7
2019-04-02 17:51:38 DEBUG BlockManager:58 - Put block rdd_3_7 locally took 10949 ms
2019-04-02 17:51:38 DEBUG BlockManager:58 - Putting block rdd_3_7 without replication took 10949 ms
2019-04-02 17:51:38 DEBUG BlockManager:58 - Getting local block rdd_3_7
2019-04-02 17:51:38 DEBUG BlockManager:58 - Level for block rdd_3_7 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:38 DEBUG TaskMemoryManager:233 - Task 7 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@376cb5b5
2019-04-02 17:51:38 INFO Executor:54 - Finished task 7.0 in stage 0.0 (TID 7). 1216 bytes result sent to driver
2019-04-02 17:51:38 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:38 INFO TaskSetManager:54 - Starting task 43.0 in stage 0.0 (TID 43, localhost, executor driver, partition 43, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:51:38 INFO Executor:54 - Running task 43.0 in stage 0.0 (TID 43)
2019-04-02 17:51:38 INFO TaskSetManager:54 - Finished task 7.0 in stage 0.0 (TID 7) in 12982 ms on localhost (executor driver) (14/56)
2019-04-02 17:51:38 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:38 DEBUG BlockManager:58 - Getting local block rdd_3_43
2019-04-02 17:51:38 DEBUG BlockManager:58 - Block rdd_3_43 was not found
2019-04-02 17:51:38 DEBUG BlockManager:58 - Getting remote block rdd_3_43
2019-04-02 17:51:38 DEBUG BlockManager:58 - Block rdd_3_43 not found
2019-04-02 17:51:38 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799561-20190110145814212-00001-h3.warc.gz:0+1166454239
2019-04-02 17:51:42 INFO MemoryStore:54 - Block rdd_3_40 stored as values in memory (estimated size 540.5 KB, free 55.7 GB)
2019-04-02 17:51:42 INFO BlockManagerInfo:54 - Added rdd_3_40 in memory on tuna.cs.uwaterloo.ca:36364 (size: 540.5 KB, free: 55.7 GB)
2019-04-02 17:51:42 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_40
2019-04-02 17:51:42 DEBUG BlockManager:58 - Told master about block rdd_3_40
2019-04-02 17:51:42 DEBUG BlockManager:58 - Put block rdd_3_40 locally took 7947 ms
2019-04-02 17:51:42 DEBUG BlockManager:58 - Putting block rdd_3_40 without replication took 7947 ms
2019-04-02 17:51:42 DEBUG BlockManager:58 - Getting local block rdd_3_40
2019-04-02 17:51:42 DEBUG BlockManager:58 - Level for block rdd_3_40 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:42 DEBUG TaskMemoryManager:233 - Task 40 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@150d738b
2019-04-02 17:51:42 INFO Executor:54 - Finished task 40.0 in stage 0.0 (TID 40). 1216 bytes result sent to driver
2019-04-02 17:51:42 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:42 INFO TaskSetManager:54 - Starting task 44.0 in stage 0.0 (TID 44, localhost, executor driver, partition 44, PROCESS_LOCAL, 8039 bytes)
2019-04-02 17:51:42 INFO Executor:54 - Running task 44.0 in stage 0.0 (TID 44)
2019-04-02 17:51:42 INFO TaskSetManager:54 - Finished task 40.0 in stage 0.0 (TID 40) in 7992 ms on localhost (executor driver) (15/56)
2019-04-02 17:51:42 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:42 DEBUG BlockManager:58 - Getting local block rdd_3_44
2019-04-02 17:51:42 DEBUG BlockManager:58 - Block rdd_3_44 was not found
2019-04-02 17:51:42 DEBUG BlockManager:58 - Getting remote block rdd_3_44
2019-04-02 17:51:42 DEBUG BlockManager:58 - Block rdd_3_44 not found
2019-04-02 17:51:42 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB681820-20180918145931833-00000.warc.gz:0+2056664
2019-04-02 17:51:44 INFO MemoryStore:54 - Block rdd_3_44 stored as values in memory (estimated size 13.2 MB, free 55.7 GB)
2019-04-02 17:51:44 INFO BlockManagerInfo:54 - Added rdd_3_44 in memory on tuna.cs.uwaterloo.ca:36364 (size: 13.2 MB, free: 55.7 GB)
2019-04-02 17:51:44 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_44
2019-04-02 17:51:44 DEBUG BlockManager:58 - Told master about block rdd_3_44
2019-04-02 17:51:44 DEBUG BlockManager:58 - Put block rdd_3_44 locally took 2367 ms
2019-04-02 17:51:44 DEBUG BlockManager:58 - Putting block rdd_3_44 without replication took 2368 ms
2019-04-02 17:51:44 DEBUG BlockManager:58 - Getting local block rdd_3_44
2019-04-02 17:51:44 DEBUG BlockManager:58 - Level for block rdd_3_44 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:44 DEBUG TaskMemoryManager:233 - Task 44 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@15bdff8e
2019-04-02 17:51:44 INFO Executor:54 - Finished task 44.0 in stage 0.0 (TID 44). 1216 bytes result sent to driver
2019-04-02 17:51:44 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:44 INFO TaskSetManager:54 - Starting task 45.0 in stage 0.0 (TID 45, localhost, executor driver, partition 45, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:44 INFO Executor:54 - Running task 45.0 in stage 0.0 (TID 45)
2019-04-02 17:51:44 INFO TaskSetManager:54 - Finished task 44.0 in stage 0.0 (TID 44) in 2380 ms on localhost (executor driver) (16/56)
2019-04-02 17:51:44 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:44 DEBUG BlockManager:58 - Getting local block rdd_3_45
2019-04-02 17:51:44 DEBUG BlockManager:58 - Block rdd_3_45 was not found
2019-04-02 17:51:44 DEBUG BlockManager:58 - Getting remote block rdd_3_45
2019-04-02 17:51:44 DEBUG BlockManager:58 - Block rdd_3_45 not found
2019-04-02 17:51:44 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB685188-20180928193923608-00000-h3.warc.gz:0+5233345
2019-04-02 17:51:48 INFO MemoryStore:54 - Block rdd_3_16 stored as values in memory (estimated size 8.5 MB, free 55.7 GB)
2019-04-02 17:51:48 INFO BlockManagerInfo:54 - Added rdd_3_16 in memory on tuna.cs.uwaterloo.ca:36364 (size: 8.5 MB, free: 55.7 GB)
2019-04-02 17:51:48 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_16
2019-04-02 17:51:48 DEBUG BlockManager:58 - Told master about block rdd_3_16
2019-04-02 17:51:48 DEBUG BlockManager:58 - Put block rdd_3_16 locally took 20154 ms
2019-04-02 17:51:48 DEBUG BlockManager:58 - Putting block rdd_3_16 without replication took 20154 ms
2019-04-02 17:51:48 DEBUG BlockManager:58 - Getting local block rdd_3_16
2019-04-02 17:51:48 DEBUG BlockManager:58 - Level for block rdd_3_16 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:48 DEBUG TaskMemoryManager:233 - Task 16 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@2186001c
2019-04-02 17:51:48 INFO Executor:54 - Finished task 16.0 in stage 0.0 (TID 16). 1216 bytes result sent to driver
2019-04-02 17:51:48 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:48 INFO TaskSetManager:54 - Starting task 46.0 in stage 0.0 (TID 46, localhost, executor driver, partition 46, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:48 INFO Executor:54 - Running task 46.0 in stage 0.0 (TID 46)
2019-04-02 17:51:48 INFO TaskSetManager:54 - Finished task 16.0 in stage 0.0 (TID 16) in 22191 ms on localhost (executor driver) (17/56)
2019-04-02 17:51:48 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:48 DEBUG BlockManager:58 - Getting local block rdd_3_46
2019-04-02 17:51:48 DEBUG BlockManager:58 - Block rdd_3_46 was not found
2019-04-02 17:51:48 DEBUG BlockManager:58 - Getting remote block rdd_3_46
2019-04-02 17:51:48 DEBUG BlockManager:58 - Block rdd_3_46 not found
2019-04-02 17:51:48 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB681536-20180917154003987-00000.warc.gz:0+1020548813
2019-04-02 17:51:51 INFO MemoryStore:54 - Block rdd_3_32 stored as values in memory (estimated size 38.5 MB, free 55.6 GB)
2019-04-02 17:51:51 INFO BlockManagerInfo:54 - Added rdd_3_32 in memory on tuna.cs.uwaterloo.ca:36364 (size: 38.5 MB, free: 55.6 GB)
2019-04-02 17:51:51 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_32
2019-04-02 17:51:51 DEBUG BlockManager:58 - Told master about block rdd_3_32
2019-04-02 17:51:51 DEBUG BlockManager:58 - Put block rdd_3_32 locally took 21549 ms
2019-04-02 17:51:51 DEBUG BlockManager:58 - Putting block rdd_3_32 without replication took 21550 ms
2019-04-02 17:51:51 DEBUG BlockManager:58 - Getting local block rdd_3_32
2019-04-02 17:51:51 DEBUG BlockManager:58 - Level for block rdd_3_32 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:51 DEBUG TaskMemoryManager:233 - Task 32 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@18338950
2019-04-02 17:51:51 INFO Executor:54 - Finished task 32.0 in stage 0.0 (TID 32). 1216 bytes result sent to driver
2019-04-02 17:51:51 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:51 INFO TaskSetManager:54 - Starting task 47.0 in stage 0.0 (TID 47, localhost, executor driver, partition 47, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:51:51 INFO TaskSetManager:54 - Finished task 32.0 in stage 0.0 (TID 32) in 21564 ms on localhost (executor driver) (18/56)
2019-04-02 17:51:51 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:51 INFO Executor:54 - Running task 47.0 in stage 0.0 (TID 47)
2019-04-02 17:51:51 DEBUG BlockManager:58 - Getting local block rdd_3_47
2019-04-02 17:51:51 DEBUG BlockManager:58 - Block rdd_3_47 was not found
2019-04-02 17:51:51 DEBUG BlockManager:58 - Getting remote block rdd_3_47
2019-04-02 17:51:51 DEBUG BlockManager:58 - Block rdd_3_47 not found
2019-04-02 17:51:51 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828203721238-00008.warc.gz:0+1754240023
2019-04-02 17:51:55 INFO MemoryStore:54 - Block rdd_3_45 stored as values in memory (estimated size 22.1 MB, free 55.6 GB)
2019-04-02 17:51:55 INFO BlockManagerInfo:54 - Added rdd_3_45 in memory on tuna.cs.uwaterloo.ca:36364 (size: 22.1 MB, free: 55.6 GB)
2019-04-02 17:51:55 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_45
2019-04-02 17:51:55 DEBUG BlockManager:58 - Told master about block rdd_3_45
2019-04-02 17:51:55 DEBUG BlockManager:58 - Put block rdd_3_45 locally took 11088 ms
2019-04-02 17:51:55 DEBUG BlockManager:58 - Putting block rdd_3_45 without replication took 11088 ms
2019-04-02 17:51:55 DEBUG BlockManager:58 - Getting local block rdd_3_45
2019-04-02 17:51:55 DEBUG BlockManager:58 - Level for block rdd_3_45 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:51:55 DEBUG TaskMemoryManager:233 - Task 45 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@445909b7
2019-04-02 17:51:55 INFO Executor:54 - Finished task 45.0 in stage 0.0 (TID 45). 1216 bytes result sent to driver
2019-04-02 17:51:55 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:51:55 INFO TaskSetManager:54 - Starting task 48.0 in stage 0.0 (TID 48, localhost, executor driver, partition 48, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:51:55 INFO TaskSetManager:54 - Finished task 45.0 in stage 0.0 (TID 45) in 11101 ms on localhost (executor driver) (19/56)
2019-04-02 17:51:55 INFO Executor:54 - Running task 48.0 in stage 0.0 (TID 48)
2019-04-02 17:51:55 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:51:55 DEBUG BlockManager:58 - Getting local block rdd_3_48
2019-04-02 17:51:55 DEBUG BlockManager:58 - Block rdd_3_48 was not found
2019-04-02 17:51:55 DEBUG BlockManager:58 - Getting remote block rdd_3_48
2019-04-02 17:51:55 DEBUG BlockManager:58 - Block rdd_3_48 not found
2019-04-02 17:51:55 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB734431-20190204173020907-00000-h3.warc.gz:0+10868086
2019-04-02 17:52:05 INFO MemoryStore:54 - Block rdd_3_37 stored as values in memory (estimated size 77.7 MB, free 55.5 GB)
2019-04-02 17:52:05 INFO BlockManagerInfo:54 - Added rdd_3_37 in memory on tuna.cs.uwaterloo.ca:36364 (size: 77.7 MB, free: 55.5 GB)
2019-04-02 17:52:05 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_37
2019-04-02 17:52:05 DEBUG BlockManager:58 - Told master about block rdd_3_37
2019-04-02 17:52:05 DEBUG BlockManager:58 - Put block rdd_3_37 locally took 32121 ms
2019-04-02 17:52:05 DEBUG BlockManager:58 - Putting block rdd_3_37 without replication took 32121 ms
2019-04-02 17:52:05 DEBUG BlockManager:58 - Getting local block rdd_3_37
2019-04-02 17:52:05 DEBUG BlockManager:58 - Level for block rdd_3_37 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:52:05 DEBUG TaskMemoryManager:233 - Task 37 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@5ae516b8
2019-04-02 17:52:05 INFO Executor:54 - Finished task 37.0 in stage 0.0 (TID 37). 1216 bytes result sent to driver
2019-04-02 17:52:05 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:52:05 INFO TaskSetManager:54 - Starting task 49.0 in stage 0.0 (TID 49, localhost, executor driver, partition 49, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:52:05 INFO Executor:54 - Running task 49.0 in stage 0.0 (TID 49)
2019-04-02 17:52:05 INFO TaskSetManager:54 - Finished task 37.0 in stage 0.0 (TID 37) in 32146 ms on localhost (executor driver) (20/56)
2019-04-02 17:52:05 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:52:05 DEBUG BlockManager:58 - Getting local block rdd_3_49
2019-04-02 17:52:05 DEBUG BlockManager:58 - Block rdd_3_49 was not found
2019-04-02 17:52:05 DEBUG BlockManager:58 - Getting remote block rdd_3_49
2019-04-02 17:52:05 DEBUG BlockManager:58 - Block rdd_3_49 not found
2019-04-02 17:52:05 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB708893-20181108195047898-00000-h3.warc.gz:0+902945
2019-04-02 17:52:21 INFO MemoryStore:54 - Block rdd_3_49 stored as values in memory (estimated size 3.5 MB, free 55.5 GB)
2019-04-02 17:52:21 INFO BlockManagerInfo:54 - Added rdd_3_49 in memory on tuna.cs.uwaterloo.ca:36364 (size: 3.5 MB, free: 55.5 GB)
2019-04-02 17:52:21 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_49
2019-04-02 17:52:21 DEBUG BlockManager:58 - Told master about block rdd_3_49
2019-04-02 17:52:21 DEBUG BlockManager:58 - Put block rdd_3_49 locally took 16600 ms
2019-04-02 17:52:21 DEBUG BlockManager:58 - Putting block rdd_3_49 without replication took 16601 ms
2019-04-02 17:52:21 DEBUG BlockManager:58 - Getting local block rdd_3_49
2019-04-02 17:52:21 DEBUG BlockManager:58 - Level for block rdd_3_49 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:52:21 DEBUG TaskMemoryManager:233 - Task 49 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@1496a3cc
2019-04-02 17:52:21 INFO Executor:54 - Finished task 49.0 in stage 0.0 (TID 49). 1216 bytes result sent to driver
2019-04-02 17:52:21 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:52:21 INFO TaskSetManager:54 - Starting task 50.0 in stage 0.0 (TID 50, localhost, executor driver, partition 50, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:52:21 INFO Executor:54 - Running task 50.0 in stage 0.0 (TID 50)
2019-04-02 17:52:21 INFO TaskSetManager:54 - Finished task 49.0 in stage 0.0 (TID 49) in 16615 ms on localhost (executor driver) (21/56)
2019-04-02 17:52:21 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:52:21 DEBUG BlockManager:58 - Getting local block rdd_3_50
2019-04-02 17:52:21 DEBUG BlockManager:58 - Block rdd_3_50 was not found
2019-04-02 17:52:21 DEBUG BlockManager:58 - Getting remote block rdd_3_50
2019-04-02 17:52:21 DEBUG BlockManager:58 - Block rdd_3_50 not found
2019-04-02 17:52:21 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799563-20190110143759785-00000-h3.warc.gz:0+985116090
2019-04-02 17:52:32 INFO MemoryStore:54 - Block rdd_3_48 stored as values in memory (estimated size 128.7 MB, free 55.4 GB)
2019-04-02 17:52:32 INFO BlockManagerInfo:54 - Added rdd_3_48 in memory on tuna.cs.uwaterloo.ca:36364 (size: 128.7 MB, free: 55.4 GB)
2019-04-02 17:52:32 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_48
2019-04-02 17:52:32 DEBUG BlockManager:58 - Told master about block rdd_3_48
2019-04-02 17:52:32 DEBUG BlockManager:58 - Put block rdd_3_48 locally took 36661 ms
2019-04-02 17:52:32 DEBUG BlockManager:58 - Putting block rdd_3_48 without replication took 36662 ms
2019-04-02 17:52:32 DEBUG BlockManager:58 - Getting local block rdd_3_48
2019-04-02 17:52:32 DEBUG BlockManager:58 - Level for block rdd_3_48 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:52:32 DEBUG TaskMemoryManager:233 - Task 48 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@511944a0
2019-04-02 17:52:32 INFO Executor:54 - Finished task 48.0 in stage 0.0 (TID 48). 1216 bytes result sent to driver
2019-04-02 17:52:32 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:52:32 INFO TaskSetManager:54 - Starting task 51.0 in stage 0.0 (TID 51, localhost, executor driver, partition 51, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:52:32 INFO Executor:54 - Running task 51.0 in stage 0.0 (TID 51)
2019-04-02 17:52:32 INFO TaskSetManager:54 - Finished task 48.0 in stage 0.0 (TID 48) in 36676 ms on localhost (executor driver) (22/56)
2019-04-02 17:52:32 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:52:32 DEBUG BlockManager:58 - Getting local block rdd_3_51
2019-04-02 17:52:32 DEBUG BlockManager:58 - Block rdd_3_51 was not found
2019-04-02 17:52:32 DEBUG BlockManager:58 - Getting remote block rdd_3_51
2019-04-02 17:52:32 DEBUG BlockManager:58 - Block rdd_3_51 not found
2019-04-02 17:52:32 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828201750185-00006.warc.gz:0+1140663408
2019-04-02 17:55:49 INFO MemoryStore:54 - Block rdd_3_31 stored as values in memory (estimated size 27.2 MB, free 55.4 GB)
2019-04-02 17:55:49 INFO BlockManagerInfo:54 - Added rdd_3_31 in memory on tuna.cs.uwaterloo.ca:36364 (size: 27.2 MB, free: 55.4 GB)
2019-04-02 17:55:49 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_31
2019-04-02 17:55:49 DEBUG BlockManager:58 - Told master about block rdd_3_31
2019-04-02 17:55:49 DEBUG BlockManager:58 - Put block rdd_3_31 locally took 260817 ms
2019-04-02 17:55:49 DEBUG BlockManager:58 - Putting block rdd_3_31 without replication took 260818 ms
2019-04-02 17:55:49 DEBUG BlockManager:58 - Getting local block rdd_3_31
2019-04-02 17:55:49 DEBUG BlockManager:58 - Level for block rdd_3_31 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:55:49 DEBUG TaskMemoryManager:233 - Task 31 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@50abc345
2019-04-02 17:55:49 INFO Executor:54 - Finished task 31.0 in stage 0.0 (TID 31). 1216 bytes result sent to driver
2019-04-02 17:55:49 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:55:49 INFO TaskSetManager:54 - Starting task 52.0 in stage 0.0 (TID 52, localhost, executor driver, partition 52, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:55:49 INFO Executor:54 - Running task 52.0 in stage 0.0 (TID 52)
2019-04-02 17:55:49 INFO TaskSetManager:54 - Finished task 31.0 in stage 0.0 (TID 31) in 260835 ms on localhost (executor driver) (23/56)
2019-04-02 17:55:49 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:55:49 DEBUG BlockManager:58 - Getting local block rdd_3_52
2019-04-02 17:55:49 DEBUG BlockManager:58 - Block rdd_3_52 was not found
2019-04-02 17:55:49 DEBUG BlockManager:58 - Getting remote block rdd_3_52
2019-04-02 17:55:49 DEBUG BlockManager:58 - Block rdd_3_52 not found
2019-04-02 17:55:49 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828220229658-00018.warc.gz:0+2235305772
2019-04-02 17:55:59 INFO MemoryStore:54 - Block rdd_3_26 stored as values in memory (estimated size 346.2 MB, free 55.0 GB)
2019-04-02 17:55:59 INFO BlockManagerInfo:54 - Added rdd_3_26 in memory on tuna.cs.uwaterloo.ca:36364 (size: 346.2 MB, free: 55.0 GB)
2019-04-02 17:55:59 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_26
2019-04-02 17:55:59 DEBUG BlockManager:58 - Told master about block rdd_3_26
2019-04-02 17:55:59 DEBUG BlockManager:58 - Put block rdd_3_26 locally took 271779 ms
2019-04-02 17:55:59 DEBUG BlockManager:58 - Putting block rdd_3_26 without replication took 271779 ms
2019-04-02 17:55:59 DEBUG BlockManager:58 - Getting local block rdd_3_26
2019-04-02 17:55:59 DEBUG BlockManager:58 - Level for block rdd_3_26 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:55:59 DEBUG TaskMemoryManager:233 - Task 26 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@2250c932
2019-04-02 17:55:59 INFO Executor:54 - Finished task 26.0 in stage 0.0 (TID 26). 1216 bytes result sent to driver
2019-04-02 17:55:59 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:55:59 INFO TaskSetManager:54 - Starting task 53.0 in stage 0.0 (TID 53, localhost, executor driver, partition 53, PROCESS_LOCAL, 8042 bytes)
2019-04-02 17:55:59 INFO Executor:54 - Running task 53.0 in stage 0.0 (TID 53)
2019-04-02 17:55:59 INFO TaskSetManager:54 - Finished task 26.0 in stage 0.0 (TID 26) in 273803 ms on localhost (executor driver) (24/56)
2019-04-02 17:55:59 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:55:59 DEBUG BlockManager:58 - Getting local block rdd_3_53
2019-04-02 17:55:59 DEBUG BlockManager:58 - Block rdd_3_53 was not found
2019-04-02 17:55:59 DEBUG BlockManager:58 - Getting remote block rdd_3_53
2019-04-02 17:55:59 DEBUG BlockManager:58 - Block rdd_3_53 not found
2019-04-02 17:55:59 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-MISSING_URLS_PATCH_CRAWL-JOB732833-20190129184629136-00000-h3.warc.gz:0+4083327
2019-04-02 17:56:11 INFO MemoryStore:54 - Block rdd_3_53 stored as values in memory (estimated size 5.7 MB, free 55.0 GB)
2019-04-02 17:56:11 INFO BlockManagerInfo:54 - Added rdd_3_53 in memory on tuna.cs.uwaterloo.ca:36364 (size: 5.7 MB, free: 55.0 GB)
2019-04-02 17:56:11 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_53
2019-04-02 17:56:11 DEBUG BlockManager:58 - Told master about block rdd_3_53
2019-04-02 17:56:11 DEBUG BlockManager:58 - Put block rdd_3_53 locally took 11737 ms
2019-04-02 17:56:11 DEBUG BlockManager:58 - Putting block rdd_3_53 without replication took 11737 ms
2019-04-02 17:56:11 DEBUG BlockManager:58 - Getting local block rdd_3_53
2019-04-02 17:56:11 DEBUG BlockManager:58 - Level for block rdd_3_53 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:56:11 DEBUG TaskMemoryManager:233 - Task 53 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@410798a2
2019-04-02 17:56:11 INFO Executor:54 - Finished task 53.0 in stage 0.0 (TID 53). 1216 bytes result sent to driver
2019-04-02 17:56:11 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:56:11 INFO TaskSetManager:54 - Starting task 54.0 in stage 0.0 (TID 54, localhost, executor driver, partition 54, PROCESS_LOCAL, 8015 bytes)
2019-04-02 17:56:11 INFO Executor:54 - Running task 54.0 in stage 0.0 (TID 54)
2019-04-02 17:56:11 INFO TaskSetManager:54 - Finished task 53.0 in stage 0.0 (TID 53) in 11748 ms on localhost (executor driver) (25/56)
2019-04-02 17:56:11 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:56:11 DEBUG BlockManager:58 - Getting local block rdd_3_54
2019-04-02 17:56:11 DEBUG BlockManager:58 - Block rdd_3_54 was not found
2019-04-02 17:56:11 DEBUG BlockManager:58 - Getting remote block rdd_3_54
2019-04-02 17:56:11 DEBUG BlockManager:58 - Block rdd_3_54 not found
2019-04-02 17:56:11 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB677126-20180828213131476-00014.warc.gz:0+1042060933
2019-04-02 17:56:24 INFO MemoryStore:54 - Block rdd_3_52 stored as values in memory (estimated size 248.6 KB, free 55.0 GB)
2019-04-02 17:56:24 INFO BlockManagerInfo:54 - Added rdd_3_52 in memory on tuna.cs.uwaterloo.ca:36364 (size: 248.6 KB, free: 55.0 GB)
2019-04-02 17:56:24 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_52
2019-04-02 17:56:24 DEBUG BlockManager:58 - Told master about block rdd_3_52
2019-04-02 17:56:24 DEBUG BlockManager:58 - Put block rdd_3_52 locally took 35691 ms
2019-04-02 17:56:24 DEBUG BlockManager:58 - Putting block rdd_3_52 without replication took 35691 ms
2019-04-02 17:56:24 DEBUG BlockManager:58 - Getting local block rdd_3_52
2019-04-02 17:56:24 DEBUG BlockManager:58 - Level for block rdd_3_52 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 17:56:24 DEBUG TaskMemoryManager:233 - Task 52 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@21ce59bc
2019-04-02 17:56:24 INFO Executor:54 - Finished task 52.0 in stage 0.0 (TID 52). 1216 bytes result sent to driver
2019-04-02 17:56:24 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 17:56:24 INFO TaskSetManager:54 - Starting task 55.0 in stage 0.0 (TID 55, localhost, executor driver, partition 55, PROCESS_LOCAL, 8031 bytes)
2019-04-02 17:56:24 INFO Executor:54 - Running task 55.0 in stage 0.0 (TID 55)
2019-04-02 17:56:24 INFO TaskSetManager:54 - Finished task 52.0 in stage 0.0 (TID 52) in 35701 ms on localhost (executor driver) (26/56)
2019-04-02 17:56:24 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 17:56:24 DEBUG BlockManager:58 - Getting local block rdd_3_55
2019-04-02 17:56:24 DEBUG BlockManager:58 - Block rdd_3_55 was not found
2019-04-02 17:56:24 DEBUG BlockManager:58 - Getting remote block rdd_3_55
2019-04-02 17:56:24 DEBUG BlockManager:58 - Block rdd_3_55 not found
2019-04-02 17:56:24 INFO NewHadoopRDD:54 - Input split: file:/tuna1/scratch/nruest/auk_collection_testing/10689/warcs/ARCHIVEIT-10689-TEST-JOB727752-SEED1799562-20190110143814510-00000-h3.warc.gz:0+835642506
2019-04-02 18:02:26 INFO MemoryStore:54 - Block rdd_3_0 stored as values in memory (estimated size 804.5 MB, free 54.3 GB)
2019-04-02 18:02:26 INFO BlockManagerInfo:54 - Added rdd_3_0 in memory on tuna.cs.uwaterloo.ca:36364 (size: 804.5 MB, free: 54.3 GB)
2019-04-02 18:02:26 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_0
2019-04-02 18:02:26 DEBUG BlockManager:58 - Told master about block rdd_3_0
2019-04-02 18:02:26 DEBUG BlockManager:58 - Put block rdd_3_0 locally took 658302 ms
2019-04-02 18:02:26 DEBUG BlockManager:58 - Putting block rdd_3_0 without replication took 658302 ms
2019-04-02 18:02:26 DEBUG BlockManager:58 - Getting local block rdd_3_0
2019-04-02 18:02:26 DEBUG BlockManager:58 - Level for block rdd_3_0 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 18:02:26 DEBUG TaskMemoryManager:233 - Task 0 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@1f0cde73
2019-04-02 18:02:26 INFO Executor:54 - Finished task 0.0 in stage 0.0 (TID 0). 1216 bytes result sent to driver
2019-04-02 18:02:26 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 29
2019-04-02 18:02:26 DEBUG TaskSetManager:58 - No tasks for locality level NO_PREF, so moving to locality level ANY
2019-04-02 18:02:26 INFO TaskSetManager:54 - Finished task 0.0 in stage 0.0 (TID 0) in 660507 ms on localhost (executor driver) (27/56)
2019-04-02 18:02:26 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 18:10:15 INFO MemoryStore:54 - Block rdd_3_17 stored as values in memory (estimated size 468.0 MB, free 53.8 GB)
2019-04-02 18:10:15 INFO BlockManagerInfo:54 - Added rdd_3_17 in memory on tuna.cs.uwaterloo.ca:36364 (size: 468.0 MB, free: 53.8 GB)
2019-04-02 18:10:15 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_17
2019-04-02 18:10:15 DEBUG BlockManager:58 - Told master about block rdd_3_17
2019-04-02 18:10:15 DEBUG BlockManager:58 - Put block rdd_3_17 locally took 1127639 ms
2019-04-02 18:10:15 DEBUG BlockManager:58 - Putting block rdd_3_17 without replication took 1127639 ms
2019-04-02 18:10:15 DEBUG BlockManager:58 - Getting local block rdd_3_17
2019-04-02 18:10:15 DEBUG BlockManager:58 - Level for block rdd_3_17 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 18:10:15 DEBUG TaskMemoryManager:233 - Task 17 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@52171903
2019-04-02 18:10:15 INFO Executor:54 - Finished task 17.0 in stage 0.0 (TID 17). 1259 bytes result sent to driver
2019-04-02 18:10:15 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 28
2019-04-02 18:10:15 INFO TaskSetManager:54 - Finished task 17.0 in stage 0.0 (TID 17) in 1129653 ms on localhost (executor driver) (28/56)
2019-04-02 18:10:15 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 18:10:27 INFO MemoryStore:54 - Block rdd_3_2 stored as values in memory (estimated size 99.6 MB, free 53.7 GB)
2019-04-02 18:10:27 INFO BlockManagerInfo:54 - Added rdd_3_2 in memory on tuna.cs.uwaterloo.ca:36364 (size: 99.6 MB, free: 53.7 GB)
2019-04-02 18:10:27 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_2
2019-04-02 18:10:27 DEBUG BlockManager:58 - Told master about block rdd_3_2
2019-04-02 18:10:27 DEBUG BlockManager:58 - Put block rdd_3_2 locally took 1139751 ms
2019-04-02 18:10:27 DEBUG BlockManager:58 - Putting block rdd_3_2 without replication took 1139751 ms
2019-04-02 18:10:27 DEBUG BlockManager:58 - Getting local block rdd_3_2
2019-04-02 18:10:27 DEBUG BlockManager:58 - Level for block rdd_3_2 is StorageLevel(disk, memory, deserialized, 1 replicas)
2019-04-02 18:10:27 DEBUG TaskMemoryManager:233 - Task 2 release 0.0 B from org.apache.spark.util.collection.ExternalSorter@11d9ee90
2019-04-02 18:10:27 INFO Executor:54 - Finished task 2.0 in stage 0.0 (TID 2). 1216 bytes result sent to driver
2019-04-02 18:10:27 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 27
2019-04-02 18:10:27 INFO TaskSetManager:54 - Finished task 2.0 in stage 0.0 (TID 2) in 1141813 ms on localhost (executor driver) (29/56)
2019-04-02 18:10:27 DEBUG DAGScheduler:58 - ShuffleMapTask finished on driver
2019-04-02 18:15:09 INFO MemoryStore:54 - Will not store rdd_3_6
2019-04-02 18:15:09 WARN MemoryStore:66 - Not enough space to cache rdd_3_6 in memory! (computed 2.2 GB so far)
2019-04-02 18:15:09 INFO MemoryStore:54 - Memory use = 2.1 GB (blocks) + 53.5 GB (scratch space shared across 27 tasks(s)) = 55.6 GB. Storage limit = 55.8 GB.
2019-04-02 18:15:09 WARN BlockManager:66 - Persisting block rdd_3_6 to disk instead.
2019-04-02 18:15:09 DEBUG DiskStore:58 - Attempting to put block rdd_3_6
2019-04-02 18:15:10 WARN BlockManager:66 - Putting block rdd_3_6 failed due to exception java.io.NotSerializableException: org.archive.io.warc.WARCRecord
Serialization stack:
- object not serializable (class: org.archive.io.warc.WARCRecord, value: org.archive.io.warc.WARCRecord@402a95eb)
- field (class: io.archivesunleashed.ArchiveRecordImpl, name: warcRecord, type: class org.archive.io.warc.WARCRecord)
- object (class io.archivesunleashed.ArchiveRecordImpl, io.archivesunleashed.ArchiveRecordImpl@6743d5e5).
2019-04-02 18:15:10 WARN BlockManager:66 - Block rdd_3_6 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:10 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_6
2019-04-02 18:15:10 DEBUG BlockManager:58 - Told master about block rdd_3_6
2019-04-02 18:15:10 ERROR Executor:91 - Exception in task 6.0 in stage 0.0 (TID 6)
java.io.NotSerializableException: org.archive.io.warc.WARCRecord
Serialization stack:
- object not serializable (class: org.archive.io.warc.WARCRecord, value: org.archive.io.warc.WARCRecord@402a95eb)
- field (class: io.archivesunleashed.ArchiveRecordImpl, name: warcRecord, type: class org.archive.io.warc.WARCRecord)
- object (class io.archivesunleashed.ArchiveRecordImpl, io.archivesunleashed.ArchiveRecordImpl@6743d5e5)
at org.apache.spark.serializer.SerializationDebugger$.improveException(SerializationDebugger.scala:40)
at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:46)
at org.apache.spark.serializer.SerializationStream.writeAll(Serializer.scala:140)
at org.apache.spark.serializer.SerializerManager.dataSerializeStream(SerializerManager.scala:174)
at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1$$anonfun$apply$7.apply(BlockManager.scala:1174)
at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1$$anonfun$apply$7.apply(BlockManager.scala:1172)
at org.apache.spark.storage.DiskStore.put(DiskStore.scala:68)
at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1.apply(BlockManager.scala:1172)
at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1.apply(BlockManager.scala:1156)
at org.apache.spark.storage.BlockManager.doPut(BlockManager.scala:1091)
at org.apache.spark.storage.BlockManager.doPutIterator(BlockManager.scala:1156)
at org.apache.spark.storage.BlockManager.getOrElseUpdate(BlockManager.scala:882)
at org.apache.spark.rdd.RDD.getOrCompute(RDD.scala:335)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:286)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:288)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:288)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
at org.apache.spark.scheduler.Task.run(Task.scala:121)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:402)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:408)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2019-04-02 18:15:10 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 26
2019-04-02 18:15:10 ERROR TaskSetManager:70 - Task 6.0 in stage 0.0 (TID 6) had a not serializable result: org.archive.io.warc.WARCRecord
Serialization stack:
- object not serializable (class: org.archive.io.warc.WARCRecord, value: org.archive.io.warc.WARCRecord@402a95eb)
- field (class: io.archivesunleashed.ArchiveRecordImpl, name: warcRecord, type: class org.archive.io.warc.WARCRecord)
- object (class io.archivesunleashed.ArchiveRecordImpl, io.archivesunleashed.ArchiveRecordImpl@6743d5e5); not retrying
2019-04-02 18:15:10 INFO TaskSchedulerImpl:54 - Cancelling stage 0
2019-04-02 18:15:10 INFO TaskSchedulerImpl:54 - Killing all running tasks in stage 0: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 51.0 in stage 0.0 (TID 51), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 30.0 in stage 0.0 (TID 30), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 9.0 in stage 0.0 (TID 9), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 1.0 in stage 0.0 (TID 1), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 3.0 in stage 0.0 (TID 3), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 54.0 in stage 0.0 (TID 54), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 25.0 in stage 0.0 (TID 25), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 55.0 in stage 0.0 (TID 55), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 47.0 in stage 0.0 (TID 47), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 20.0 in stage 0.0 (TID 20), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 50.0 in stage 0.0 (TID 50), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 42.0 in stage 0.0 (TID 42), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 21.0 in stage 0.0 (TID 21), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 43.0 in stage 0.0 (TID 43), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 22.0 in stage 0.0 (TID 22), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 14.0 in stage 0.0 (TID 14), reason: Stage cancelled
2019-04-02 18:15:10 INFO TaskSchedulerImpl:54 - Stage 0 was cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 23.0 in stage 0.0 (TID 23), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 46.0 in stage 0.0 (TID 46), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 39.0 in stage 0.0 (TID 39), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 18.0 in stage 0.0 (TID 18), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 11.0 in stage 0.0 (TID 11), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 41.0 in stage 0.0 (TID 41), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 34.0 in stage 0.0 (TID 34), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 13.0 in stage 0.0 (TID 13), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 29.0 in stage 0.0 (TID 29), reason: Stage cancelled
2019-04-02 18:15:10 INFO Executor:54 - Executor is trying to kill task 8.0 in stage 0.0 (TID 8), reason: Stage cancelled
2019-04-02 18:15:10 INFO DAGScheduler:54 - ShuffleMapStage 0 (map at package.scala:88) failed in 1424.349 s due to Job aborted due to stage failure: Task 6.0 in stage 0.0 (TID 6) had a not serializable result: org.archive.io.warc.WARCRecord
Serialization stack:
- object not serializable (class: org.archive.io.warc.WARCRecord, value: org.archive.io.warc.WARCRecord@402a95eb)
- field (class: io.archivesunleashed.ArchiveRecordImpl, name: warcRecord, type: class org.archive.io.warc.WARCRecord)
- object (class io.archivesunleashed.ArchiveRecordImpl, io.archivesunleashed.ArchiveRecordImpl@6743d5e5)
2019-04-02 18:15:10 DEBUG DAGScheduler:58 - Removing stage 1 from waiting set.
2019-04-02 18:15:10 DEBUG DAGScheduler:58 - After removal of stage 1, remaining stages = 1
2019-04-02 18:15:10 DEBUG DAGScheduler:58 - After removal of stage 0, remaining stages = 0
2019-04-02 18:15:10 INFO DAGScheduler:54 - Job 0 failed: sortBy at package.scala:90, took 1424.912509 s
2019-04-02 18:15:10 WARN BlockManager:66 - Putting block rdd_3_42 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:15:10 WARN BlockManager:66 - Block rdd_3_42 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:10 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_42
2019-04-02 18:15:10 DEBUG BlockManager:58 - Told master about block rdd_3_42
2019-04-02 18:15:10 INFO Executor:54 - Executor killed task 42.0 in stage 0.0 (TID 42), reason: Stage cancelled
2019-04-02 18:15:10 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 25
2019-04-02 18:15:10 WARN TaskSetManager:66 - Lost task 42.0 in stage 0.0 (TID 42, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:15:10 WARN BlockManager:66 - Putting block rdd_3_23 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:15:10 WARN BlockManager:66 - Block rdd_3_23 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:10 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_23
2019-04-02 18:15:10 DEBUG BlockManager:58 - Told master about block rdd_3_23
2019-04-02 18:15:10 INFO Executor:54 - Executor killed task 23.0 in stage 0.0 (TID 23), reason: Stage cancelled
2019-04-02 18:15:10 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 24
2019-04-02 18:15:10 WARN TaskSetManager:66 - Lost task 23.0 in stage 0.0 (TID 23, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:15:10 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
2019-04-02 18:15:10 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
2019-04-02 18:15:10 WARN BlockManager:66 - Putting block rdd_3_47 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:15:10 WARN BlockManager:66 - Block rdd_3_47 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:10 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_47
2019-04-02 18:15:10 DEBUG BlockManager:58 - Told master about block rdd_3_47
2019-04-02 18:15:10 INFO Executor:54 - Executor killed task 47.0 in stage 0.0 (TID 47), reason: Stage cancelled
2019-04-02 18:15:10 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 23
2019-04-02 18:15:10 WARN TaskSetManager:66 - Lost task 47.0 in stage 0.0 (TID 47, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:15:10 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
2019-04-02 18:15:10 WARN BlockManager:66 - Putting block rdd_3_41 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:15:10 WARN BlockManager:66 - Block rdd_3_41 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:10 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_41
2019-04-02 18:15:10 DEBUG BlockManager:58 - Told master about block rdd_3_41
2019-04-02 18:15:10 INFO Executor:54 - Executor killed task 41.0 in stage 0.0 (TID 41), reason: Stage cancelled
2019-04-02 18:15:10 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 22
2019-04-02 18:15:10 WARN TaskSetManager:66 - Lost task 41.0 in stage 0.0 (TID 41, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:15:10 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
2019-04-02 18:15:10 WARN BlockManager:66 - Putting block rdd_3_22 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:15:10 WARN BlockManager:66 - Block rdd_3_22 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:10 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_22
2019-04-02 18:15:10 DEBUG BlockManager:58 - Told master about block rdd_3_22
2019-04-02 18:15:10 INFO Executor:54 - Executor killed task 22.0 in stage 0.0 (TID 22), reason: Stage cancelled
2019-04-02 18:15:10 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 21
2019-04-02 18:15:10 WARN TaskSetManager:66 - Lost task 22.0 in stage 0.0 (TID 22, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:15:10 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
org.apache.spark.SparkException: Job aborted due to stage failure: Task 6.0 in stage 0.0 (TID 6) had a not serializable result: org.archive.io.warc.WARCRecord
Serialization stack:
- object not serializable (class: org.archive.io.warc.WARCRecord, value: org.archive.io.warc.WARCRecord@402a95eb)
- field (class: io.archivesunleashed.ArchiveRecordImpl, name: warcRecord, type: class org.archive.io.warc.WARCRecord)
- object (class io.archivesunleashed.ArchiveRecordImpl, io.archivesunleashed.ArchiveRecordImpl@6743d5e5)
at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1887)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1875)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1874)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1874)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:926)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:926)
at scala.Option.foreach(Option.scala:257)
at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:926)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2108)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2057)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2046)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:737)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2061)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2082)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2101)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2126)
at org.apache.spark.rdd.RDD$$anonfun$collect$1.apply(RDD.scala:945)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
at org.apache.spark.rdd.RDD.collect(RDD.scala:944)
at org.apache.spark.RangePartitioner$.sketch(Partitioner.scala:309)
at org.apache.spark.RangePartitioner.<init>(Partitioner.scala:171)
at org.apache.spark.RangePartitioner.<init>(Partitioner.scala:151)
at org.apache.spark.rdd.OrderedRDDFunctions$$anonfun$sortByKey$1.apply(OrderedRDDFunctions.scala:62)
at org.apache.spark.rdd.OrderedRDDFunctions$$anonfun$sortByKey$1.apply(OrderedRDDFunctions.scala:61)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
at org.apache.spark.rdd.OrderedRDDFunctions.sortByKey(OrderedRDDFunctions.scala:61)
at org.apache.spark.rdd.RDD$$anonfun$sortBy$1.apply(RDD.scala:623)
at org.apache.spark.rdd.RDD$$anonfun$sortBy$1.apply(RDD.scala:624)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
at org.apache.spark.rdd.RDD.sortBy(RDD.scala:621)
at io.archivesunleashed.package$CountableRDD.countItems(package.scala:90)
... 65 elided
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.0
/_/
Using Scala version 2.11.12 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_121)
Type in expressions to have them evaluated.
Type :help for more information.
scala> 2019-04-02 18:15:20 DEBUG ContextCleaner:58 - Got cleaning task CleanRDD(3)
2019-04-02 18:15:20 DEBUG ContextCleaner:58 - Cleaning RDD 3
2019-04-02 18:15:20 DEBUG BlockManagerSlaveEndpoint:58 - removing RDD 3
2019-04-02 18:15:20 INFO BlockManager:54 - Removing RDD 3
2019-04-02 18:15:20 DEBUG BlockManager:58 - Removing block rdd_3_46
2019-04-02 18:15:25 WARN BlockManager:66 - Putting block rdd_3_51 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:15:25 WARN BlockManager:66 - Block rdd_3_51 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:25 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_51
2019-04-02 18:15:25 DEBUG BlockManager:58 - Told master about block rdd_3_51
2019-04-02 18:15:25 INFO Executor:54 - Executor killed task 51.0 in stage 0.0 (TID 51), reason: Stage cancelled
2019-04-02 18:15:25 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 20
2019-04-02 18:15:25 WARN TaskSetManager:66 - Lost task 51.0 in stage 0.0 (TID 51, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:15:25 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
2019-04-02 18:15:42 WARN BlockManager:66 - Putting block rdd_3_21 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:15:42 WARN BlockManager:66 - Block rdd_3_21 could not be removed as it was not found on disk or in memory
2019-04-02 18:15:42 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_21
2019-04-02 18:15:42 DEBUG BlockManager:58 - Told master about block rdd_3_21
2019-04-02 18:15:42 INFO Executor:54 - Executor killed task 21.0 in stage 0.0 (TID 21), reason: Stage cancelled
2019-04-02 18:15:42 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 19
2019-04-02 18:15:42 WARN TaskSetManager:66 - Lost task 21.0 in stage 0.0 (TID 21, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:15:42 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
2019-04-02 18:16:12 WARN BlockManager:66 - Putting block rdd_3_46 failed due to exception org.apache.spark.TaskKilledException.
2019-04-02 18:16:12 WARN BlockManager:66 - Block rdd_3_46 could not be removed as it was not found on disk or in memory
2019-04-02 18:16:12 DEBUG BlockManagerMaster:58 - Updated info of block rdd_3_46
2019-04-02 18:16:12 DEBUG BlockManager:58 - Told master about block rdd_3_46
2019-04-02 18:16:12 INFO Executor:54 - Executor killed task 46.0 in stage 0.0 (TID 46), reason: Stage cancelled
2019-04-02 18:16:12 DEBUG TaskSchedulerImpl:58 - parentName: , name: TaskSet_0.0, runningTasks: 18
2019-04-02 18:16:12 WARN BlockManager:66 - Asked to remove block rdd_3_46, which does not exist
2019-04-02 18:16:12 WARN TaskSetManager:66 - Lost task 46.0 in stage 0.0 (TID 46, localhost, executor driver): TaskKilled (Stage cancelled)
2019-04-02 18:16:12 DEBUG BlockManager:58 - Removing block rdd_3_38
2019-04-02 18:16:12 DEBUG OutputCommitCoordinator:58 - Ignoring task completion for completed stage
2019-04-02 18:16:12 DEBUG MemoryStore:58 - Block rdd_3_38 of size 806928 dropped from memory (free 57663889508)
2019-04-02 18:16:12 DEBUG BlockManager:58 - Removing block rdd_3_30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment