sparkexecutoroutput.txt

Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
16/05/25 13:52:24 INFO CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT]
16/05/25 13:52:24 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/05/25 13:52:24 INFO SecurityManager: Changing view acls to: ubuntu
16/05/25 13:52:24 INFO SecurityManager: Changing modify acls to: ubuntu
16/05/25 13:52:24 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(ubuntu); users with modify permissions: Set(ubuntu)
16/05/25 13:52:25 INFO SecurityManager: Changing view acls to: ubuntu
16/05/25 13:52:25 INFO SecurityManager: Changing modify acls to: ubuntu
16/05/25 13:52:25 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(ubuntu); users with modify permissions: Set(ubuntu)
16/05/25 13:52:25 INFO Slf4jLogger: Slf4jLogger started
16/05/25 13:52:25 INFO Remoting: Starting remoting
16/05/25 13:52:26 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutorActorSystem@10.0.0.9:7006]
16/05/25 13:52:26 INFO Utils: Successfully started service 'sparkExecutorActorSystem' on port 7006.
16/05/25 13:52:26 INFO DiskBlockManager: Created local directory at /tmp/spark-911136c2-effc-470a-b963-86b29ec7fb8f/executor-272ecf5f-d794-46c5-84d9-a918ea948bb7/blockmgr-523db293-d6a1-411d-82ed-1596edc205e3
16/05/25 13:52:26 INFO MemoryStore: MemoryStore started with capacity 10.2 GB
16/05/25 13:52:26 INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@10.0.0.2:7001
16/05/25 13:52:26 INFO WorkerWatcher: Connecting to worker spark://Worker@10.0.0.9:39808
16/05/25 13:52:26 INFO CoarseGrainedExecutorBackend: Successfully registered with driver
16/05/25 13:52:26 INFO Executor: Starting executor ID 2 on host slave5.cluster
16/05/25 13:52:26 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 7005.
16/05/25 13:52:26 INFO NettyBlockTransferService: Server created on 7005
16/05/25 13:52:26 INFO BlockManagerMaster: Trying to register BlockManager
16/05/25 13:52:26 INFO BlockManagerMaster: Registered BlockManager
16/05/25 13:58:13 INFO CoarseGrainedExecutorBackend: Got assigned task 4
16/05/25 13:58:13 INFO Executor: Running task 4.0 in stage 0.0 (TID 4)
16/05/25 13:58:13 INFO Executor: Fetching http://10.0.0.2:7004/jars/dl4j-ethnicity-test-0.1-SNAPSHOT-all.jar with timestamp 1464209569661
16/05/25 13:58:13 INFO Utils: Fetching http://10.0.0.2:7004/jars/dl4j-ethnicity-test-0.1-SNAPSHOT-all.jar to /tmp/spark-911136c2-effc-470a-b963-86b29ec7fb8f/executor-272ecf5f-d794-46c5-84d9-a918ea948bb7/spark-973a8690-6ba1-4434-9b42-2cc4c2275bb2/fetchFileTemp714532615205793782.tmp
16/05/25 13:58:14 INFO CoarseGrainedExecutorBackend: Got assigned task 10
16/05/25 13:58:14 INFO Executor: Running task 10.0 in stage 0.0 (TID 10)
16/05/25 13:58:14 INFO CoarseGrainedExecutorBackend: Got assigned task 16
16/05/25 13:58:14 INFO Executor: Running task 16.0 in stage 0.0 (TID 16)
16/05/25 13:58:15 INFO CoarseGrainedExecutorBackend: Got assigned task 22
16/05/25 13:58:15 INFO Executor: Running task 22.0 in stage 0.0 (TID 22)
16/05/25 13:58:16 INFO CoarseGrainedExecutorBackend: Got assigned task 28
16/05/25 13:58:16 INFO Executor: Running task 28.0 in stage 0.0 (TID 28)
16/05/25 13:58:16 INFO CoarseGrainedExecutorBackend: Got assigned task 34
16/05/25 13:58:16 INFO Executor: Running task 34.0 in stage 0.0 (TID 34)
16/05/25 13:58:17 INFO CoarseGrainedExecutorBackend: Got assigned task 40
16/05/25 13:58:17 INFO Executor: Running task 40.0 in stage 0.0 (TID 40)
16/05/25 13:58:17 INFO CoarseGrainedExecutorBackend: Got assigned task 46
16/05/25 13:58:17 INFO Executor: Running task 46.0 in stage 0.0 (TID 46)
16/05/25 13:58:20 INFO Utils: Copying /tmp/spark-911136c2-effc-470a-b963-86b29ec7fb8f/executor-272ecf5f-d794-46c5-84d9-a918ea948bb7/spark-973a8690-6ba1-4434-9b42-2cc4c2275bb2/-15813784931464209569661_cache to /home/ubuntu/spark/work/app-20160525135249-0031/2/./dl4j-ethnicity-test-0.1-SNAPSHOT-all.jar
16/05/25 13:58:20 INFO Executor: Adding file:/home/ubuntu/spark/work/app-20160525135249-0031/2/./dl4j-ethnicity-test-0.1-SNAPSHOT-all.jar to class loader
16/05/25 13:58:21 INFO Reflections: Reflections took 299 ms to scan 1 urls, producing 104 keys and 339 values 
16/05/25 13:58:21 INFO HttpBroadcast: Started reading broadcast variable 3
16/05/25 13:58:22 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 94.8 MB, free 94.8 MB)
16/05/25 13:58:22 INFO HttpBroadcast: Reading broadcast variable 3 took 0.466895577 s
16/05/25 13:58:22 INFO BlockManager: Found block broadcast_3 locally
16/05/25 13:58:22 INFO BlockManager: Found block broadcast_3 locally
16/05/25 13:58:22 INFO BlockManager: Found block broadcast_3 locally
16/05/25 13:58:22 INFO BlockManager: Found block broadcast_3 locally
16/05/25 13:58:22 INFO BlockManager: Found block broadcast_3 locally
16/05/25 13:58:22 INFO BlockManager: Found block broadcast_3 locally
16/05/25 13:58:22 INFO BlockManager: Found block broadcast_3 locally
16/05/25 13:58:22 INFO HttpBroadcast: Started reading broadcast variable 1
16/05/25 13:58:24 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 69.8 KB, free 94.9 MB)
16/05/25 13:58:24 INFO HttpBroadcast: Reading broadcast variable 1 took 2.060259266 s
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_1 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_1 locally
16/05/25 13:58:24 INFO HttpBroadcast: Started reading broadcast variable 2
16/05/25 13:58:24 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 944.0 B, free 94.9 MB)
16/05/25 13:58:24 INFO HttpBroadcast: Reading broadcast variable 2 took 0.013219035 s
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_1 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_1 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_2 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_1 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_2 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_1 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_2 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_1 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_2 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_2 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_2 locally
16/05/25 13:58:24 INFO BlockManager: Found block broadcast_2 locally
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_4 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_16 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_4 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_16 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_40 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_40 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_34 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_10 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_34 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_10 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_22 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_46 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_46 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_22 not found, computing it
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_16 stored as values in memory (estimated size 103.7 KB, free 95.0 MB)
16/05/25 13:58:26 INFO CacheManager: Partition rdd_95_28 not found, computing it
16/05/25 13:58:26 INFO CacheManager: Partition rdd_0_28 not found, computing it
OMP: Warning #205: KMP_AFFINITY: cpuid leaf 11 not supported - decoding legacy APIC ids.
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_4 stored as values in memory (estimated size 103.7 KB, free 95.1 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_22 stored as values in memory (estimated size 103.9 KB, free 95.2 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_95_4 stored as values in memory (estimated size 16.0 B, free 95.2 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_95_22 stored as values in memory (estimated size 16.0 B, free 95.2 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_34 stored as values in memory (estimated size 104.2 KB, free 95.3 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_46 stored as values in memory (estimated size 105.9 KB, free 95.4 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_95_34 stored as values in memory (estimated size 16.0 B, free 95.4 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_40 stored as values in memory (estimated size 105.9 KB, free 95.5 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_28 stored as values in memory (estimated size 106.0 KB, free 95.6 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_0_10 stored as values in memory (estimated size 106.0 KB, free 95.7 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_95_10 stored as values in memory (estimated size 16.0 B, free 95.7 MB)
16/05/25 13:58:26 INFO MemoryStore: Block rdd_95_28 stored as values in memory (estimated size 16.0 B, free 95.7 MB)
16/05/25 13:58:29 INFO Executor: Finished task 4.0 in stage 0.0 (TID 4). 99431108 bytes result sent to driver
16/05/25 13:58:29 INFO Executor: Finished task 10.0 in stage 0.0 (TID 10). 99431108 bytes result sent to driver
16/05/25 13:58:30 INFO Executor: Finished task 34.0 in stage 0.0 (TID 34). 99431108 bytes result sent to driver
16/05/25 13:58:30 INFO Executor: Finished task 28.0 in stage 0.0 (TID 28). 99431108 bytes result sent to driver
16/05/25 13:58:33 INFO Executor: Finished task 22.0 in stage 0.0 (TID 22). 99431108 bytes result sent to driver
16/05/25 13:59:58 INFO ScoreIterationListener: Score at iteration 0 is 22.493202337535074
16/05/25 13:59:58 INFO ScoreIterationListener: Score at iteration 0 is 23.420097479136636
16/05/25 13:59:58 INFO ScoreIterationListener: Score at iteration 0 is 25.622049459727457
16/05/25 14:00:14 INFO MemoryStore: Block rdd_95_16 stored as values in memory (estimated size 220.0 KB, free 96.0 MB)
16/05/25 14:00:14 INFO MemoryStore: Block rdd_95_40 stored as values in memory (estimated size 220.0 KB, free 96.2 MB)
16/05/25 14:00:14 INFO MemoryStore: Block rdd_95_46 stored as values in memory (estimated size 220.0 KB, free 96.4 MB)
16/05/25 14:06:00 INFO Adder: Invoked add operation 
16/05/25 14:06:00 INFO Adder: Invoked add operation 
16/05/25 14:06:00 INFO Adder: Invoked add operation 
16/05/25 14:06:04 INFO Executor: Finished task 40.0 in stage 0.0 (TID 40). 99431150 bytes result sent to driver
16/05/25 14:06:04 INFO Executor: Finished task 16.0 in stage 0.0 (TID 16). 99431150 bytes result sent to driver
16/05/25 14:06:04 INFO Executor: Finished task 46.0 in stage 0.0 (TID 46). 99431150 bytes result sent to driver
16/05/25 14:09:04 INFO CoarseGrainedExecutorBackend: Got assigned task 50
16/05/25 14:09:04 INFO Executor: Running task 4.0 in stage 1.0 (TID 50)
16/05/25 14:09:04 INFO CoarseGrainedExecutorBackend: Got assigned task 56
16/05/25 14:09:04 INFO Executor: Running task 10.0 in stage 1.0 (TID 56)
16/05/25 14:09:04 INFO CoarseGrainedExecutorBackend: Got assigned task 62
16/05/25 14:09:04 INFO Executor: Running task 16.0 in stage 1.0 (TID 62)
16/05/25 14:09:04 INFO HttpBroadcast: Started reading broadcast variable 4
16/05/25 14:09:04 INFO CoarseGrainedExecutorBackend: Got assigned task 68
16/05/25 14:09:04 INFO Executor: Running task 22.0 in stage 1.0 (TID 68)
16/05/25 14:09:04 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 25.3 KB, free 96.4 MB)
16/05/25 14:09:04 INFO HttpBroadcast: Reading broadcast variable 4 took 0.090303299 s
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_4 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_4 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:04 INFO BlockManager: Found block rdd_95_10 locally
16/05/25 14:09:04 INFO BlockManager: Found block rdd_95_16 locally
16/05/25 14:09:04 INFO BlockManager: Found block rdd_95_4 locally
16/05/25 14:09:04 INFO Executor: Finished task 16.0 in stage 1.0 (TID 62). 2277 bytes result sent to driver
16/05/25 14:09:04 INFO Executor: Finished task 10.0 in stage 1.0 (TID 56). 2277 bytes result sent to driver
16/05/25 14:09:04 INFO Executor: Finished task 4.0 in stage 1.0 (TID 50). 2277 bytes result sent to driver
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_4 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:04 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:04 INFO BlockManager: Found block rdd_95_22 locally
16/05/25 14:09:04 INFO Executor: Finished task 22.0 in stage 1.0 (TID 68). 2277 bytes result sent to driver
16/05/25 14:09:05 INFO CoarseGrainedExecutorBackend: Got assigned task 74
16/05/25 14:09:05 INFO Executor: Running task 28.0 in stage 1.0 (TID 74)
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_4 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:05 INFO BlockManager: Found block rdd_95_28 locally
16/05/25 14:09:05 INFO Executor: Finished task 28.0 in stage 1.0 (TID 74). 2277 bytes result sent to driver
16/05/25 14:09:05 INFO CoarseGrainedExecutorBackend: Got assigned task 80
16/05/25 14:09:05 INFO Executor: Running task 34.0 in stage 1.0 (TID 80)
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_4 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:05 INFO BlockManager: Found block rdd_95_34 locally
16/05/25 14:09:05 INFO Executor: Finished task 34.0 in stage 1.0 (TID 80). 2277 bytes result sent to driver
16/05/25 14:09:05 INFO CoarseGrainedExecutorBackend: Got assigned task 86
16/05/25 14:09:05 INFO Executor: Running task 40.0 in stage 1.0 (TID 86)
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_4 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:05 INFO BlockManager: Found block rdd_95_40 locally
16/05/25 14:09:05 INFO Executor: Finished task 40.0 in stage 1.0 (TID 86). 2277 bytes result sent to driver
16/05/25 14:09:05 INFO CoarseGrainedExecutorBackend: Got assigned task 92
16/05/25 14:09:05 INFO Executor: Running task 46.0 in stage 1.0 (TID 92)
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_4 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:05 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:05 INFO BlockManager: Found block rdd_95_46 locally
16/05/25 14:09:05 INFO Executor: Finished task 46.0 in stage 1.0 (TID 92). 2277 bytes result sent to driver
16/05/25 14:09:16 INFO CoarseGrainedExecutorBackend: Got assigned task 96
16/05/25 14:09:16 INFO Executor: Running task 4.0 in stage 2.0 (TID 96)
16/05/25 14:09:16 INFO CoarseGrainedExecutorBackend: Got assigned task 102
16/05/25 14:09:16 INFO Executor: Running task 10.0 in stage 2.0 (TID 102)
16/05/25 14:09:16 INFO CoarseGrainedExecutorBackend: Got assigned task 108
16/05/25 14:09:16 INFO Executor: Running task 16.0 in stage 2.0 (TID 108)
16/05/25 14:09:16 INFO CoarseGrainedExecutorBackend: Got assigned task 114
16/05/25 14:09:16 INFO Executor: Running task 22.0 in stage 2.0 (TID 114)
16/05/25 14:09:16 INFO HttpBroadcast: Started reading broadcast variable 5
16/05/25 14:09:16 INFO CoarseGrainedExecutorBackend: Got assigned task 120
16/05/25 14:09:16 INFO Executor: Running task 28.0 in stage 2.0 (TID 120)
16/05/25 14:09:16 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 25.3 KB, free 1620.6 KB)
16/05/25 14:09:16 INFO HttpBroadcast: Reading broadcast variable 5 took 0.014874243 s
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_5 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_5 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_5 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:16 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:16 INFO BlockManager: Found block rdd_95_16 locally
16/05/25 14:09:16 INFO BlockManager: Found block rdd_95_4 locally
16/05/25 14:09:16 INFO Executor: Finished task 16.0 in stage 2.0 (TID 108). 2277 bytes result sent to driver
16/05/25 14:09:16 INFO Executor: Finished task 4.0 in stage 2.0 (TID 96). 2277 bytes result sent to driver
16/05/25 14:09:16 INFO BlockManager: Found block rdd_95_10 locally
16/05/25 14:09:16 INFO BlockManager: Found block rdd_95_22 locally
16/05/25 14:09:16 INFO Executor: Finished task 10.0 in stage 2.0 (TID 102). 2277 bytes result sent to driver
16/05/25 14:09:16 INFO Executor: Finished task 22.0 in stage 2.0 (TID 114). 2277 bytes result sent to driver
16/05/25 14:09:17 INFO CoarseGrainedExecutorBackend: Got assigned task 126
16/05/25 14:09:17 INFO Executor: Running task 34.0 in stage 2.0 (TID 126)
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_5 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:17 INFO BlockManager: Found block rdd_95_28 locally
16/05/25 14:09:17 INFO Executor: Finished task 28.0 in stage 2.0 (TID 120). 2277 bytes result sent to driver
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_5 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:17 INFO BlockManager: Found block rdd_95_34 locally
16/05/25 14:09:17 INFO Executor: Finished task 34.0 in stage 2.0 (TID 126). 2277 bytes result sent to driver
16/05/25 14:09:17 INFO CoarseGrainedExecutorBackend: Got assigned task 132
16/05/25 14:09:17 INFO Executor: Running task 40.0 in stage 2.0 (TID 132)
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_5 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:17 INFO BlockManager: Found block rdd_95_40 locally
16/05/25 14:09:17 INFO Executor: Finished task 40.0 in stage 2.0 (TID 132). 2277 bytes result sent to driver
16/05/25 14:09:17 INFO CoarseGrainedExecutorBackend: Got assigned task 138
16/05/25 14:09:17 INFO Executor: Running task 46.0 in stage 2.0 (TID 138)
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_5 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:17 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:17 INFO BlockManager: Found block rdd_95_46 locally
16/05/25 14:09:17 INFO Executor: Finished task 46.0 in stage 2.0 (TID 138). 2277 bytes result sent to driver
16/05/25 14:09:32 INFO CoarseGrainedExecutorBackend: Got assigned task 148
16/05/25 14:09:32 INFO Executor: Running task 4.0 in stage 3.0 (TID 148)
16/05/25 14:09:32 INFO CoarseGrainedExecutorBackend: Got assigned task 154
16/05/25 14:09:32 INFO Executor: Running task 10.0 in stage 3.0 (TID 154)
16/05/25 14:09:32 INFO CoarseGrainedExecutorBackend: Got assigned task 160
16/05/25 14:09:32 INFO Executor: Running task 16.0 in stage 3.0 (TID 160)
16/05/25 14:09:33 INFO CoarseGrainedExecutorBackend: Got assigned task 166
16/05/25 14:09:33 INFO Executor: Running task 22.0 in stage 3.0 (TID 166)
16/05/25 14:09:33 INFO HttpBroadcast: Started reading broadcast variable 6
16/05/25 14:09:33 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 25.3 KB, free 1645.9 KB)
16/05/25 14:09:33 INFO HttpBroadcast: Reading broadcast variable 6 took 0.010617498 s
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_6 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_6 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_6 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO CoarseGrainedExecutorBackend: Got assigned task 172
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO Executor: Running task 28.0 in stage 3.0 (TID 172)
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_4 locally
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_16 locally
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_10 locally
16/05/25 14:09:33 INFO Executor: Finished task 4.0 in stage 3.0 (TID 148). 2073 bytes result sent to driver
16/05/25 14:09:33 INFO Executor: Finished task 10.0 in stage 3.0 (TID 154). 2073 bytes result sent to driver
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_22 locally
16/05/25 14:09:33 INFO Executor: Finished task 22.0 in stage 3.0 (TID 166). 2073 bytes result sent to driver
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_6 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_28 locally
16/05/25 14:09:33 INFO Executor: Finished task 28.0 in stage 3.0 (TID 172). 2073 bytes result sent to driver
16/05/25 14:09:33 INFO CoarseGrainedExecutorBackend: Got assigned task 178
16/05/25 14:09:33 INFO Executor: Running task 34.0 in stage 3.0 (TID 178)
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_6 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_34 locally
16/05/25 14:09:33 INFO Executor: Finished task 34.0 in stage 3.0 (TID 178). 2073 bytes result sent to driver
16/05/25 14:09:33 INFO CoarseGrainedExecutorBackend: Got assigned task 184
16/05/25 14:09:33 INFO Executor: Running task 40.0 in stage 3.0 (TID 184)
16/05/25 14:09:33 INFO CoarseGrainedExecutorBackend: Got assigned task 190
16/05/25 14:09:33 INFO Executor: Running task 46.0 in stage 3.0 (TID 190)
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_6 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_40 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_6 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_1 locally
16/05/25 14:09:33 INFO BlockManager: Found block broadcast_2 locally
16/05/25 14:09:33 INFO BlockManager: Found block rdd_95_46 locally
16/05/25 14:09:38 INFO Executor: Finished task 16.0 in stage 3.0 (TID 160). 99920393 bytes result sent to driver
16/05/25 14:09:40 INFO Executor: Finished task 40.0 in stage 3.0 (TID 184). 99920393 bytes result sent to driver
16/05/25 14:09:40 INFO Executor: Finished task 46.0 in stage 3.0 (TID 190). 99920393 bytes result sent to driver
16/05/25 14:14:41 INFO CoarseGrainedExecutorBackend: Got assigned task 192
16/05/25 14:14:41 INFO Executor: Running task 4.0 in stage 4.0 (TID 192)
16/05/25 14:14:41 INFO CoarseGrainedExecutorBackend: Got assigned task 198
16/05/25 14:14:41 INFO Executor: Running task 10.0 in stage 4.0 (TID 198)
16/05/25 14:14:41 INFO HttpBroadcast: Started reading broadcast variable 9
16/05/25 14:14:41 INFO CoarseGrainedExecutorBackend: Got assigned task 204
16/05/25 14:14:41 INFO Executor: Running task 16.0 in stage 4.0 (TID 204)
16/05/25 14:14:41 INFO CoarseGrainedExecutorBackend: Got assigned task 210
16/05/25 14:14:41 INFO Executor: Running task 22.0 in stage 4.0 (TID 210)
16/05/25 14:14:41 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 94.8 MB, free 96.5 MB)
16/05/25 14:14:41 INFO HttpBroadcast: Reading broadcast variable 9 took 0.357649555 s
16/05/25 14:14:41 INFO BlockManager: Found block broadcast_9 locally
16/05/25 14:14:41 INFO BlockManager: Found block broadcast_9 locally
16/05/25 14:14:42 INFO CoarseGrainedExecutorBackend: Got assigned task 216
16/05/25 14:14:42 INFO Executor: Running task 28.0 in stage 4.0 (TID 216)
16/05/25 14:14:42 INFO CoarseGrainedExecutorBackend: Got assigned task 222
16/05/25 14:14:42 INFO Executor: Running task 34.0 in stage 4.0 (TID 222)
16/05/25 14:14:42 INFO CoarseGrainedExecutorBackend: Got assigned task 228
16/05/25 14:14:42 INFO Executor: Running task 40.0 in stage 4.0 (TID 228)
16/05/25 14:14:42 INFO HttpBroadcast: Started reading broadcast variable 7
16/05/25 14:14:42 INFO CoarseGrainedExecutorBackend: Got assigned task 234
16/05/25 14:14:42 INFO Executor: Running task 46.0 in stage 4.0 (TID 234)
16/05/25 14:14:47 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 247.8 KB, free 96.7 MB)
16/05/25 14:14:47 INFO HttpBroadcast: Reading broadcast variable 7 took 5.113410916 s
16/05/25 14:14:47 INFO BlockManager: Found block broadcast_9 locally
16/05/25 14:14:47 INFO HttpBroadcast: Started reading broadcast variable 8
16/05/25 14:14:52 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 269.9 KB, free 97.0 MB)
16/05/25 14:14:52 INFO HttpBroadcast: Reading broadcast variable 8 took 4.5534661 s
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_9 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_7 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_8 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_9 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_7 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_8 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_9 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_9 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_7 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_8 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_7 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_7 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_8 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_7 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_8 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_8 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_7 locally
16/05/25 14:14:52 INFO BlockManager: Found block broadcast_8 locally
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_16 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_16 locally
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_46 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_46 locally
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_22 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_22 locally
16/05/25 14:14:54 INFO MemoryStore: Block rdd_104_22 stored as values in memory (estimated size 16.0 B, free 97.0 MB)
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_40 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_40 locally
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_10 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_10 locally
16/05/25 14:14:54 INFO MemoryStore: Block rdd_104_10 stored as values in memory (estimated size 16.0 B, free 97.0 MB)
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_34 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_34 locally
16/05/25 14:14:54 INFO MemoryStore: Block rdd_104_34 stored as values in memory (estimated size 16.0 B, free 97.0 MB)
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_28 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_28 locally
16/05/25 14:14:54 INFO MemoryStore: Block rdd_104_28 stored as values in memory (estimated size 16.0 B, free 97.0 MB)
16/05/25 14:14:54 INFO CacheManager: Partition rdd_104_4 not found, computing it
16/05/25 14:14:54 INFO BlockManager: Found block rdd_0_4 locally
16/05/25 14:14:54 INFO MemoryStore: Block rdd_104_4 stored as values in memory (estimated size 16.0 B, free 97.0 MB)
16/05/25 14:14:56 INFO Executor: Finished task 22.0 in stage 4.0 (TID 210). 99432108 bytes result sent to driver
16/05/25 14:14:56 INFO Executor: Finished task 10.0 in stage 4.0 (TID 198). 99432108 bytes result sent to driver
16/05/25 14:14:57 INFO Executor: Finished task 34.0 in stage 4.0 (TID 222). 99432108 bytes result sent to driver
16/05/25 14:14:57 INFO Executor: Finished task 28.0 in stage 4.0 (TID 216). 99432108 bytes result sent to driver
16/05/25 14:14:57 INFO Executor: Finished task 4.0 in stage 4.0 (TID 192). 99432108 bytes result sent to driver
16/05/25 14:16:22 INFO ScoreIterationListener: Score at iteration 0 is 19.30731224312271
16/05/25 14:16:23 INFO ScoreIterationListener: Score at iteration 0 is 26.30647873177017
16/05/25 14:16:23 INFO ScoreIterationListener: Score at iteration 0 is 18.91441559090103
16/05/25 14:16:39 INFO MemoryStore: Block rdd_104_40 stored as values in memory (estimated size 255.2 KB, free 97.2 MB)
16/05/25 14:16:39 INFO MemoryStore: Block rdd_104_16 stored as values in memory (estimated size 255.2 KB, free 97.5 MB)
16/05/25 14:16:39 INFO MemoryStore: Block rdd_104_46 stored as values in memory (estimated size 255.2 KB, free 97.7 MB)
16/05/25 14:21:50 INFO Adder: Invoked add operation 
16/05/25 14:21:50 INFO Adder: Invoked add operation 
16/05/25 14:21:50 INFO Adder: Invoked add operation 
16/05/25 14:21:54 INFO Executor: Finished task 40.0 in stage 4.0 (TID 228). 99432145 bytes result sent to driver
16/05/25 14:21:54 INFO Executor: Finished task 16.0 in stage 4.0 (TID 204). 99432145 bytes result sent to driver
16/05/25 14:21:54 INFO Executor: Finished task 46.0 in stage 4.0 (TID 234). 99432145 bytes result sent to driver