Created
December 9, 2013 16:14
-
-
Save gregakespret/7874908 to your computer and use it in GitHub Desktop.
Resubmision due to a fetch failure
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Connected to jdbc:vertica://vertica7.aws.celtra-test.com:5433/aws7 (DirectBatchInsert: false) | |
| 13/12/09 15:45:36,704 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started | |
| 13/12/09 15:45:36,888 INFO spark.SparkEnv: Registering BlockManagerMaster | |
| 13/12/09 15:45:36,925 INFO storage.DiskBlockManager: Created local directory at /tmp/spark-local-20131209154536-5135 | |
| 13/12/09 15:45:36,933 INFO storage.MemoryStore: MemoryStore started with capacity 2.2 GB. | |
| 13/12/09 15:45:36,969 INFO network.ConnectionManager: Bound socket to port 45383 with id = ConnectionManagerId(ip-10-170-8-11.ec2.internal,45383) | |
| 13/12/09 15:45:36,977 INFO storage.BlockManagerMaster: Trying to register BlockManager | |
| 13/12/09 15:45:36,988 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-170-8-11.ec2.internal:45383 with 2.2 GB RAM | |
| 13/12/09 15:45:36,989 INFO storage.BlockManagerMaster: Registered BlockManager | |
| 13/12/09 15:45:37,078 INFO server.Server: jetty-7.x.y-SNAPSHOT | |
| 13/12/09 15:45:37,102 INFO server.AbstractConnector: Started SocketConnector@0.0.0.0:40816 | |
| 13/12/09 15:45:37,103 INFO broadcast.HttpBroadcast: Broadcast server started at http://10.170.8.11:40816 | |
| 13/12/09 15:45:37,108 INFO spark.SparkEnv: Registering MapOutputTracker | |
| 13/12/09 15:45:37,113 INFO spark.HttpFileServer: HTTP File server directory is /tmp/spark-9d21a3c6-31ee-4cad-bcea-a6d511220210 | |
| 13/12/09 15:45:37,114 INFO server.Server: jetty-7.x.y-SNAPSHOT | |
| 13/12/09 15:45:37,116 INFO server.AbstractConnector: Started SocketConnector@0.0.0.0:44411 | |
| 13/12/09 15:45:37,214 INFO server.Server: jetty-7.x.y-SNAPSHOT | |
| 13/12/09 15:45:37,214 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/storage/rdd,null} | |
| 13/12/09 15:45:37,215 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/storage,null} | |
| 13/12/09 15:45:37,215 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/stages/stage,null} | |
| 13/12/09 15:45:37,215 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/stages/pool,null} | |
| 13/12/09 15:45:37,215 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/stages,null} | |
| 13/12/09 15:45:37,216 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/environment,null} | |
| 13/12/09 15:45:37,216 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/executors,null} | |
| 13/12/09 15:45:37,216 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/metrics/json,null} | |
| 13/12/09 15:45:37,217 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/static,null} | |
| 13/12/09 15:45:37,217 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/,null} | |
| 13/12/09 15:45:37,229 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:5555 | |
| 13/12/09 15:45:37,230 INFO ui.SparkUI: Started Spark Web UI at http://ip-10-170-8-11.ec2.internal:5555 | |
| 13/12/09 15:45:37,795 INFO spark.SparkContext: Added JAR /home/grega/mab-grega/analyzer/target/scala-2.9.3/analyzer-assembly-1.0-SNAPSHOT.jar at http://10.170.8.11:44411/jars/analyzer-assembly-1.0-SNAPSHOT.jar with timestamp 1386603937794 | |
| 13/12/09 15:45:37,856 INFO client.Client$ClientActor: Connecting to master spark://ec2-184-72-177-49.compute-1.amazonaws.com:7077... | |
| 13/12/09 15:45:38,043 INFO cluster.SparkDeploySchedulerBackend: Connected to Spark cluster with app ID app-20131209154538-0001 | |
| 13/12/09 15:45:38,063 INFO client.Client$ClientActor: Executor added: app-20131209154538-0001/0 on worker-20131209153424-ip-10-43-129-89.ec2.internal-36674 (ip-10-43-129-89.ec2.internal:7077) with 8 cores | |
| 13/12/09 15:45:38,064 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20131209154538-0001/0 on hostPort ip-10-43-129-89.ec2.internal:7077 with 8 cores, 5.0 GB RAM | |
| 13/12/09 15:45:38,064 INFO client.Client$ClientActor: Executor added: app-20131209154538-0001/1 on worker-20131209153424-ip-10-181-0-146.ec2.internal-48913 (ip-10-181-0-146.ec2.internal:7077) with 8 cores | |
| 13/12/09 15:45:38,064 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20131209154538-0001/1 on hostPort ip-10-181-0-146.ec2.internal:7077 with 8 cores, 5.0 GB RAM | |
| 13/12/09 15:45:38,100 INFO client.Client$ClientActor: Executor updated: app-20131209154538-0001/0 is now RUNNING | |
| 13/12/09 15:45:38,101 INFO client.Client$ClientActor: Executor updated: app-20131209154538-0001/1 is now RUNNING | |
| 13/12/09 15:45:38,130 INFO util.Utils: Copying /home/grega/mab-grega/vendor/maxmind/GeoIPCity.dat to /tmp/spark-dfe8539c-c3c7-4cce-ab9f-3a8f84fe64fa/GeoIPCity.dat | |
| 13/12/09 15:45:38,282 INFO spark.SparkContext: Added file /home/grega/mab-grega/vendor/maxmind/GeoIPCity.dat at http://10.170.8.11:44411/files/GeoIPCity.dat with timestamp 1386603938128 | |
| 13/12/09 15:45:38,283 INFO util.Utils: Copying /home/grega/mab-grega/shared/constants.json to /tmp/spark-dfe8539c-c3c7-4cce-ab9f-3a8f84fe64fa/constants.json | |
| 13/12/09 15:45:38,289 INFO spark.SparkContext: Added file /home/grega/mab-grega/shared/constants.json at http://10.170.8.11:44411/files/constants.json with timestamp 1386603938282 | |
| 13/12/09 15:45:38,503 INFO analyzer.Entities: Loading entities from operational database... | |
| 13/12/09 15:45:39,589 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-181-0-146.ec2.internal:47339/user/Executor] with ID 1 | |
| 13/12/09 15:45:39,621 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-43-129-89.ec2.internal:59327/user/Executor] with ID 0 | |
| 13/12/09 15:45:39,834 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-181-0-146.ec2.internal:33986 with 3.2 GB RAM | |
| 13/12/09 15:45:39,862 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-43-129-89.ec2.internal:46195 with 3.2 GB RAM | |
| 13/12/09 15:46:51,090 INFO analyzer.Entities: Loaded 561 accounts, 10988 campaigns, 60862 creatives, 22198 placements | |
| 13/12/09 15:46:51,092 INFO analyzer.LogAnalyzer: Analyzing sessions started in 2013-01-27T00:00:00.000Z/2013-01-27T01:00:00.000Z (max session duration: PT1800S) | |
| 13/12/09 15:46:51,094 INFO analyzer.S3: Requested logs for interval 2013-01-27T00:00:00.000Z/2013-01-27T01:30:00.000Z | |
| 13/12/09 15:46:51,095 INFO analyzer.S3: 18 partitions total | |
| 13/12/09 15:46:51,099 INFO analyzer.S3: Creating RDD with URL: s3n://celtra-mab/tracking-logs/{x,2013-01-27/{_,00-00,00-05,00-10,00-15,00-20,00-25,00-30,00-35,00-40,00-45,00-50,00-55,01-00,01-05,01-10,01-15,01-20,01-25}}/*{.events,.events.gz} | |
| 13/12/09 15:46:51,184 INFO storage.MemoryStore: ensureFreeSpace(36819) called with curMem=0, maxMem=2362260848 | |
| 13/12/09 15:46:51,185 INFO storage.MemoryStore: Block broadcast_0 stored as values to memory (estimated size 36.0 KB, free 2.2 GB) | |
| 13/12/09 15:46:52,060 INFO storage.MemoryStore: ensureFreeSpace(34415520) called with curMem=36819, maxMem=2362260848 | |
| 13/12/09 15:46:52,060 INFO storage.MemoryStore: Block broadcast_1 stored as values to memory (estimated size 32.8 MB, free 2.2 GB) | |
| 13/12/09 15:46:52,833 INFO analyzer.LogAnalyzer: Using 64 tasks for grouping sessions | |
| 13/12/09 15:46:52,880 INFO vertica.Vertica: Creating temporary tables... | |
| 13/12/09 15:46:54,583 INFO vertica.Vertica: Inserting sessions... | |
| 13/12/09 15:46:54,584 INFO vertica.Vertica: Using 64 inserters and a batch size of 10000 | |
| 13/12/09 15:46:54,586 INFO vertica.Vertica: Inserting to temporary tables started | |
| 13/12/09 15:46:54,644 INFO spark.SparkContext: Starting job: foreach at Vertica.scala:143 | |
| 13/12/09 15:46:56,591 INFO mapred.FileInputFormat: Total input paths to process : 216 | |
| 13/12/09 15:46:56,624 INFO scheduler.DAGScheduler: Registering RDD 2 (keyBy at LogAnalyzer.scala:35) | |
| 13/12/09 15:46:56,627 INFO scheduler.DAGScheduler: Got job 0 (foreach at Vertica.scala:143) with 64 output partitions (allowLocal=false) | |
| 13/12/09 15:46:56,628 INFO scheduler.DAGScheduler: Final stage: Stage 0 (foreach at Vertica.scala:143) | |
| 13/12/09 15:46:56,628 INFO scheduler.DAGScheduler: Parents of final stage: List(Stage 1) | |
| 13/12/09 15:46:56,648 INFO scheduler.DAGScheduler: Missing parents: List(Stage 1) | |
| 13/12/09 15:46:56,677 INFO scheduler.DAGScheduler: Submitting Stage 1 (MappedRDD[2] at keyBy at LogAnalyzer.scala:35), which has no missing parents | |
| 13/12/09 15:46:56,734 INFO scheduler.DAGScheduler: Submitting 216 missing tasks from Stage 1 (MappedRDD[2] at keyBy at LogAnalyzer.scala:35) | |
| 13/12/09 15:46:56,737 INFO cluster.ClusterScheduler: Adding task set 1.0 with 216 tasks | |
| 13/12/09 15:46:56,755 INFO cluster.ClusterTaskSetManager: Starting task 1.0:0 as TID 0 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,763 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:0 as 2083 bytes in 6 ms | |
| 13/12/09 15:46:56,769 INFO cluster.ClusterTaskSetManager: Starting task 1.0:1 as TID 1 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,770 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:1 as 2083 bytes in 1 ms | |
| 13/12/09 15:46:56,770 INFO cluster.ClusterTaskSetManager: Starting task 1.0:2 as TID 2 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,771 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:2 as 2083 bytes in 1 ms | |
| 13/12/09 15:46:56,771 INFO cluster.ClusterTaskSetManager: Starting task 1.0:3 as TID 3 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,772 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:3 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,773 INFO cluster.ClusterTaskSetManager: Starting task 1.0:4 as TID 4 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,773 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:4 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,774 INFO cluster.ClusterTaskSetManager: Starting task 1.0:5 as TID 5 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,774 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:5 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,775 INFO cluster.ClusterTaskSetManager: Starting task 1.0:6 as TID 6 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,776 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:6 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,776 INFO cluster.ClusterTaskSetManager: Starting task 1.0:7 as TID 7 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,777 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:7 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,778 INFO cluster.ClusterTaskSetManager: Starting task 1.0:8 as TID 8 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,778 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:8 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,779 INFO cluster.ClusterTaskSetManager: Starting task 1.0:9 as TID 9 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,780 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:9 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,780 INFO cluster.ClusterTaskSetManager: Starting task 1.0:10 as TID 10 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,781 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:10 as 2083 bytes in 1 ms | |
| 13/12/09 15:46:56,781 INFO cluster.ClusterTaskSetManager: Starting task 1.0:11 as TID 11 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,782 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:11 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,783 INFO cluster.ClusterTaskSetManager: Starting task 1.0:12 as TID 12 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,783 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:12 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,784 INFO cluster.ClusterTaskSetManager: Starting task 1.0:13 as TID 13 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,785 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:13 as 2083 bytes in 1 ms | |
| 13/12/09 15:46:56,786 INFO cluster.ClusterTaskSetManager: Starting task 1.0:14 as TID 14 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,786 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:14 as 2083 bytes in 0 ms | |
| 13/12/09 15:46:56,787 INFO cluster.ClusterTaskSetManager: Starting task 1.0:15 as TID 15 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:46:56,787 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:15 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:01,707 INFO cluster.ClusterTaskSetManager: Starting task 1.0:16 as TID 16 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,708 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:16 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:01,717 INFO cluster.ClusterTaskSetManager: Finished TID 12 in 4934 ms on ip-10-43-129-89.ec2.internal (progress: 0/216) | |
| 13/12/09 15:47:01,720 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 12) | |
| 13/12/09 15:47:01,720 INFO cluster.ClusterTaskSetManager: Starting task 1.0:17 as TID 17 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,720 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:17 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:01,723 INFO cluster.ClusterTaskSetManager: Finished TID 14 in 4935 ms on ip-10-43-129-89.ec2.internal (progress: 1/216) | |
| 13/12/09 15:47:01,723 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 14) | |
| 13/12/09 15:47:01,766 INFO cluster.ClusterTaskSetManager: Starting task 1.0:18 as TID 18 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,767 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:18 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:01,768 INFO cluster.ClusterTaskSetManager: Finished TID 10 in 4988 ms on ip-10-43-129-89.ec2.internal (progress: 2/216) | |
| 13/12/09 15:47:01,769 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 10) | |
| 13/12/09 15:47:01,799 INFO cluster.ClusterTaskSetManager: Starting task 1.0:19 as TID 19 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,800 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:19 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:01,801 INFO cluster.ClusterTaskSetManager: Finished TID 2 in 5030 ms on ip-10-43-129-89.ec2.internal (progress: 3/216) | |
| 13/12/09 15:47:01,802 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 2) | |
| 13/12/09 15:47:01,804 INFO cluster.ClusterTaskSetManager: Starting task 1.0:20 as TID 20 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,805 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:20 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:01,806 INFO cluster.ClusterTaskSetManager: Finished TID 0 in 5053 ms on ip-10-43-129-89.ec2.internal (progress: 4/216) | |
| 13/12/09 15:47:01,806 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 0) | |
| 13/12/09 15:47:01,824 INFO cluster.ClusterTaskSetManager: Finished TID 13 in 5040 ms on ip-10-181-0-146.ec2.internal (progress: 5/216) | |
| 13/12/09 15:47:01,824 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 13) | |
| 13/12/09 15:47:01,825 INFO cluster.ClusterTaskSetManager: Starting task 1.0:21 as TID 21 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,825 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:21 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:01,907 INFO cluster.ClusterTaskSetManager: Starting task 1.0:22 as TID 22 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,908 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:22 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:01,908 INFO cluster.ClusterTaskSetManager: Finished TID 1 in 5139 ms on ip-10-181-0-146.ec2.internal (progress: 6/216) | |
| 13/12/09 15:47:01,909 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 1) | |
| 13/12/09 15:47:01,909 INFO cluster.ClusterTaskSetManager: Starting task 1.0:23 as TID 23 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,910 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:23 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:01,911 INFO cluster.ClusterTaskSetManager: Finished TID 11 in 5129 ms on ip-10-181-0-146.ec2.internal (progress: 7/216) | |
| 13/12/09 15:47:01,911 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 11) | |
| 13/12/09 15:47:01,983 INFO cluster.ClusterTaskSetManager: Starting task 1.0:24 as TID 24 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:01,983 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:24 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:01,984 INFO cluster.ClusterTaskSetManager: Finished TID 9 in 5205 ms on ip-10-181-0-146.ec2.internal (progress: 8/216) | |
| 13/12/09 15:47:01,985 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 9) | |
| 13/12/09 15:47:02,248 INFO cluster.ClusterTaskSetManager: Starting task 1.0:25 as TID 25 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,249 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:25 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,250 INFO cluster.ClusterTaskSetManager: Finished TID 6 in 5475 ms on ip-10-43-129-89.ec2.internal (progress: 9/216) | |
| 13/12/09 15:47:02,250 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 6) | |
| 13/12/09 15:47:02,253 INFO cluster.ClusterTaskSetManager: Starting task 1.0:26 as TID 26 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,253 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:26 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,254 INFO cluster.ClusterTaskSetManager: Finished TID 4 in 5482 ms on ip-10-43-129-89.ec2.internal (progress: 10/216) | |
| 13/12/09 15:47:02,254 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 4) | |
| 13/12/09 15:47:02,262 INFO cluster.ClusterTaskSetManager: Starting task 1.0:27 as TID 27 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,263 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:27 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:02,263 INFO cluster.ClusterTaskSetManager: Finished TID 8 in 5485 ms on ip-10-43-129-89.ec2.internal (progress: 11/216) | |
| 13/12/09 15:47:02,264 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 8) | |
| 13/12/09 15:47:02,360 INFO cluster.ClusterTaskSetManager: Starting task 1.0:28 as TID 28 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,361 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:28 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:02,362 INFO cluster.ClusterTaskSetManager: Finished TID 3 in 5590 ms on ip-10-181-0-146.ec2.internal (progress: 12/216) | |
| 13/12/09 15:47:02,362 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 3) | |
| 13/12/09 15:47:02,375 INFO cluster.ClusterTaskSetManager: Starting task 1.0:29 as TID 29 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,376 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:29 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:02,377 INFO cluster.ClusterTaskSetManager: Finished TID 5 in 5603 ms on ip-10-181-0-146.ec2.internal (progress: 13/216) | |
| 13/12/09 15:47:02,377 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 5) | |
| 13/12/09 15:47:02,445 INFO cluster.ClusterTaskSetManager: Starting task 1.0:30 as TID 30 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,445 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:30 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,446 INFO cluster.ClusterTaskSetManager: Finished TID 15 in 5659 ms on ip-10-181-0-146.ec2.internal (progress: 14/216) | |
| 13/12/09 15:47:02,446 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 15) | |
| 13/12/09 15:47:02,464 INFO cluster.ClusterTaskSetManager: Starting task 1.0:31 as TID 31 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,464 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:31 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,465 INFO cluster.ClusterTaskSetManager: Finished TID 7 in 5689 ms on ip-10-181-0-146.ec2.internal (progress: 15/216) | |
| 13/12/09 15:47:02,466 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 7) | |
| 13/12/09 15:47:02,593 INFO cluster.ClusterTaskSetManager: Starting task 1.0:32 as TID 32 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,594 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:32 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,595 INFO cluster.ClusterTaskSetManager: Finished TID 23 in 685 ms on ip-10-181-0-146.ec2.internal (progress: 16/216) | |
| 13/12/09 15:47:02,595 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 23) | |
| 13/12/09 15:47:02,626 INFO cluster.ClusterTaskSetManager: Finished TID 22 in 720 ms on ip-10-181-0-146.ec2.internal (progress: 17/216) | |
| 13/12/09 15:47:02,626 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 22) | |
| 13/12/09 15:47:02,626 INFO cluster.ClusterTaskSetManager: Starting task 1.0:33 as TID 33 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,627 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:33 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,651 INFO cluster.ClusterTaskSetManager: Starting task 1.0:34 as TID 34 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,652 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:34 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,652 INFO cluster.ClusterTaskSetManager: Finished TID 21 in 828 ms on ip-10-181-0-146.ec2.internal (progress: 18/216) | |
| 13/12/09 15:47:02,653 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 21) | |
| 13/12/09 15:47:02,721 INFO cluster.ClusterTaskSetManager: Starting task 1.0:35 as TID 35 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,722 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:35 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,722 INFO cluster.ClusterTaskSetManager: Finished TID 24 in 740 ms on ip-10-181-0-146.ec2.internal (progress: 19/216) | |
| 13/12/09 15:47:02,723 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 24) | |
| 13/12/09 15:47:02,850 INFO cluster.ClusterTaskSetManager: Starting task 1.0:36 as TID 36 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,851 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:36 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:02,852 INFO cluster.ClusterTaskSetManager: Finished TID 26 in 599 ms on ip-10-43-129-89.ec2.internal (progress: 20/216) | |
| 13/12/09 15:47:02,853 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 26) | |
| 13/12/09 15:47:02,882 INFO cluster.ClusterTaskSetManager: Starting task 1.0:37 as TID 37 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:02,883 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:37 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:02,884 INFO cluster.ClusterTaskSetManager: Finished TID 25 in 636 ms on ip-10-43-129-89.ec2.internal (progress: 21/216) | |
| 13/12/09 15:47:02,884 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 25) | |
| 13/12/09 15:47:03,009 INFO cluster.ClusterTaskSetManager: Starting task 1.0:38 as TID 38 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,009 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:38 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,010 INFO cluster.ClusterTaskSetManager: Finished TID 18 in 1244 ms on ip-10-43-129-89.ec2.internal (progress: 22/216) | |
| 13/12/09 15:47:03,010 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 18) | |
| 13/12/09 15:47:03,018 INFO cluster.ClusterTaskSetManager: Starting task 1.0:39 as TID 39 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,018 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:39 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,019 INFO cluster.ClusterTaskSetManager: Finished TID 16 in 1312 ms on ip-10-43-129-89.ec2.internal (progress: 23/216) | |
| 13/12/09 15:47:03,020 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 16) | |
| 13/12/09 15:47:03,043 INFO cluster.ClusterTaskSetManager: Finished TID 17 in 1323 ms on ip-10-43-129-89.ec2.internal (progress: 24/216) | |
| 13/12/09 15:47:03,044 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 17) | |
| 13/12/09 15:47:03,044 INFO cluster.ClusterTaskSetManager: Starting task 1.0:40 as TID 40 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,045 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:40 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,054 INFO cluster.ClusterTaskSetManager: Starting task 1.0:41 as TID 41 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,055 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:41 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:03,056 INFO cluster.ClusterTaskSetManager: Finished TID 19 in 1256 ms on ip-10-43-129-89.ec2.internal (progress: 25/216) | |
| 13/12/09 15:47:03,056 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 19) | |
| 13/12/09 15:47:03,134 INFO cluster.ClusterTaskSetManager: Starting task 1.0:42 as TID 42 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,135 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:42 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:03,136 INFO cluster.ClusterTaskSetManager: Finished TID 20 in 1331 ms on ip-10-43-129-89.ec2.internal (progress: 26/216) | |
| 13/12/09 15:47:03,136 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 20) | |
| 13/12/09 15:47:03,254 INFO cluster.ClusterTaskSetManager: Starting task 1.0:43 as TID 43 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,254 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:43 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,255 INFO cluster.ClusterTaskSetManager: Finished TID 33 in 629 ms on ip-10-181-0-146.ec2.internal (progress: 27/216) | |
| 13/12/09 15:47:03,255 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 33) | |
| 13/12/09 15:47:03,354 INFO cluster.ClusterTaskSetManager: Starting task 1.0:44 as TID 44 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,355 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:44 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:03,355 INFO cluster.ClusterTaskSetManager: Finished TID 35 in 634 ms on ip-10-181-0-146.ec2.internal (progress: 28/216) | |
| 13/12/09 15:47:03,356 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 35) | |
| 13/12/09 15:47:03,377 INFO cluster.ClusterTaskSetManager: Finished TID 27 in 1114 ms on ip-10-43-129-89.ec2.internal (progress: 29/216) | |
| 13/12/09 15:47:03,377 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 27) | |
| 13/12/09 15:47:03,377 INFO cluster.ClusterTaskSetManager: Starting task 1.0:45 as TID 45 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,378 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:45 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,396 INFO cluster.ClusterTaskSetManager: Finished TID 34 in 745 ms on ip-10-181-0-146.ec2.internal (progress: 30/216) | |
| 13/12/09 15:47:03,396 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 34) | |
| 13/12/09 15:47:03,396 INFO cluster.ClusterTaskSetManager: Starting task 1.0:46 as TID 46 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,397 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:46 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:03,429 INFO cluster.ClusterTaskSetManager: Starting task 1.0:47 as TID 47 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,429 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:47 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,430 INFO cluster.ClusterTaskSetManager: Finished TID 28 in 1070 ms on ip-10-181-0-146.ec2.internal (progress: 31/216) | |
| 13/12/09 15:47:03,430 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 28) | |
| 13/12/09 15:47:03,486 INFO cluster.ClusterTaskSetManager: Starting task 1.0:48 as TID 48 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,487 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:48 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,487 INFO cluster.ClusterTaskSetManager: Finished TID 31 in 1023 ms on ip-10-181-0-146.ec2.internal (progress: 32/216) | |
| 13/12/09 15:47:03,488 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 31) | |
| 13/12/09 15:47:03,544 INFO cluster.ClusterTaskSetManager: Finished TID 37 in 661 ms on ip-10-43-129-89.ec2.internal (progress: 33/216) | |
| 13/12/09 15:47:03,544 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 37) | |
| 13/12/09 15:47:03,544 INFO cluster.ClusterTaskSetManager: Starting task 1.0:49 as TID 49 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,545 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:49 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,556 INFO cluster.ClusterTaskSetManager: Finished TID 30 in 1112 ms on ip-10-181-0-146.ec2.internal (progress: 34/216) | |
| 13/12/09 15:47:03,556 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 30) | |
| 13/12/09 15:47:03,556 INFO cluster.ClusterTaskSetManager: Starting task 1.0:50 as TID 50 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,557 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:50 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:03,559 INFO cluster.ClusterTaskSetManager: Starting task 1.0:51 as TID 51 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,560 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:51 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:03,560 INFO cluster.ClusterTaskSetManager: Finished TID 36 in 710 ms on ip-10-43-129-89.ec2.internal (progress: 35/216) | |
| 13/12/09 15:47:03,561 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 36) | |
| 13/12/09 15:47:03,612 INFO cluster.ClusterTaskSetManager: Starting task 1.0:52 as TID 52 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,613 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:52 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,613 INFO cluster.ClusterTaskSetManager: Finished TID 29 in 1238 ms on ip-10-181-0-146.ec2.internal (progress: 36/216) | |
| 13/12/09 15:47:03,614 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 29) | |
| 13/12/09 15:47:03,672 INFO cluster.ClusterTaskSetManager: Starting task 1.0:53 as TID 53 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,673 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:53 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,673 INFO cluster.ClusterTaskSetManager: Finished TID 32 in 1080 ms on ip-10-181-0-146.ec2.internal (progress: 37/216) | |
| 13/12/09 15:47:03,674 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 32) | |
| 13/12/09 15:47:03,746 INFO cluster.ClusterTaskSetManager: Starting task 1.0:54 as TID 54 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:03,746 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:54 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:03,747 INFO cluster.ClusterTaskSetManager: Finished TID 38 in 739 ms on ip-10-43-129-89.ec2.internal (progress: 38/216) | |
| 13/12/09 15:47:03,748 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 38) | |
| 13/12/09 15:47:04,099 INFO cluster.ClusterTaskSetManager: Starting task 1.0:55 as TID 55 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,099 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:55 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,100 INFO cluster.ClusterTaskSetManager: Finished TID 45 in 723 ms on ip-10-43-129-89.ec2.internal (progress: 39/216) | |
| 13/12/09 15:47:04,101 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 45) | |
| 13/12/09 15:47:04,104 INFO cluster.ClusterTaskSetManager: Starting task 1.0:56 as TID 56 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,104 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:56 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,105 INFO cluster.ClusterTaskSetManager: Finished TID 46 in 709 ms on ip-10-181-0-146.ec2.internal (progress: 40/216) | |
| 13/12/09 15:47:04,106 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 46) | |
| 13/12/09 15:47:04,119 INFO cluster.ClusterTaskSetManager: Starting task 1.0:57 as TID 57 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,119 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:57 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,121 INFO cluster.ClusterTaskSetManager: Finished TID 48 in 635 ms on ip-10-181-0-146.ec2.internal (progress: 41/216) | |
| 13/12/09 15:47:04,122 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 48) | |
| 13/12/09 15:47:04,167 INFO cluster.ClusterTaskSetManager: Starting task 1.0:58 as TID 58 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,168 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:58 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,172 INFO cluster.ClusterTaskSetManager: Finished TID 47 in 742 ms on ip-10-181-0-146.ec2.internal (progress: 42/216) | |
| 13/12/09 15:47:04,172 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 47) | |
| 13/12/09 15:47:04,176 INFO cluster.ClusterTaskSetManager: Starting task 1.0:59 as TID 59 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,176 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:59 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,177 INFO cluster.ClusterTaskSetManager: Finished TID 40 in 1133 ms on ip-10-43-129-89.ec2.internal (progress: 43/216) | |
| 13/12/09 15:47:04,177 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 40) | |
| 13/12/09 15:47:04,225 INFO cluster.ClusterTaskSetManager: Starting task 1.0:60 as TID 60 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,226 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:60 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:04,227 INFO cluster.ClusterTaskSetManager: Starting task 1.0:61 as TID 61 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,227 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:61 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,228 INFO cluster.ClusterTaskSetManager: Finished TID 41 in 1174 ms on ip-10-43-129-89.ec2.internal (progress: 44/216) | |
| 13/12/09 15:47:04,228 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 41) | |
| 13/12/09 15:47:04,228 INFO cluster.ClusterTaskSetManager: Finished TID 39 in 1210 ms on ip-10-43-129-89.ec2.internal (progress: 45/216) | |
| 13/12/09 15:47:04,229 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 39) | |
| 13/12/09 15:47:04,231 INFO cluster.ClusterTaskSetManager: Starting task 1.0:62 as TID 62 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,232 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:62 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,233 INFO cluster.ClusterTaskSetManager: Finished TID 50 in 676 ms on ip-10-181-0-146.ec2.internal (progress: 46/216) | |
| 13/12/09 15:47:04,233 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 50) | |
| 13/12/09 15:47:04,271 INFO cluster.ClusterTaskSetManager: Starting task 1.0:63 as TID 63 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,272 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:63 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,273 INFO cluster.ClusterTaskSetManager: Finished TID 49 in 729 ms on ip-10-43-129-89.ec2.internal (progress: 47/216) | |
| 13/12/09 15:47:04,273 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 49) | |
| 13/12/09 15:47:04,331 INFO cluster.ClusterTaskSetManager: Starting task 1.0:64 as TID 64 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,332 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:64 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:04,332 INFO cluster.ClusterTaskSetManager: Finished TID 42 in 1198 ms on ip-10-43-129-89.ec2.internal (progress: 48/216) | |
| 13/12/09 15:47:04,333 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 42) | |
| 13/12/09 15:47:04,376 INFO cluster.ClusterTaskSetManager: Starting task 1.0:65 as TID 65 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,377 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:65 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:04,377 INFO cluster.ClusterTaskSetManager: Finished TID 43 in 1124 ms on ip-10-181-0-146.ec2.internal (progress: 49/216) | |
| 13/12/09 15:47:04,378 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 43) | |
| 13/12/09 15:47:04,513 INFO cluster.ClusterTaskSetManager: Starting task 1.0:66 as TID 66 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,513 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:66 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,514 INFO cluster.ClusterTaskSetManager: Finished TID 44 in 1160 ms on ip-10-181-0-146.ec2.internal (progress: 50/216) | |
| 13/12/09 15:47:04,514 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 44) | |
| 13/12/09 15:47:04,603 INFO cluster.ClusterTaskSetManager: Starting task 1.0:67 as TID 67 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,603 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:67 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,604 INFO cluster.ClusterTaskSetManager: Finished TID 51 in 1046 ms on ip-10-43-129-89.ec2.internal (progress: 51/216) | |
| 13/12/09 15:47:04,604 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 51) | |
| 13/12/09 15:47:04,776 INFO cluster.ClusterTaskSetManager: Starting task 1.0:68 as TID 68 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,776 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:68 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,777 INFO cluster.ClusterTaskSetManager: Finished TID 52 in 1165 ms on ip-10-181-0-146.ec2.internal (progress: 52/216) | |
| 13/12/09 15:47:04,777 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 52) | |
| 13/12/09 15:47:04,793 INFO cluster.ClusterTaskSetManager: Finished TID 58 in 626 ms on ip-10-181-0-146.ec2.internal (progress: 53/216) | |
| 13/12/09 15:47:04,793 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 58) | |
| 13/12/09 15:47:04,793 INFO cluster.ClusterTaskSetManager: Starting task 1.0:69 as TID 69 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,794 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:69 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:04,813 INFO cluster.ClusterTaskSetManager: Starting task 1.0:70 as TID 70 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,814 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:70 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,816 INFO cluster.ClusterTaskSetManager: Finished TID 59 in 640 ms on ip-10-43-129-89.ec2.internal (progress: 54/216) | |
| 13/12/09 15:47:04,816 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 59) | |
| 13/12/09 15:47:04,816 INFO cluster.ClusterTaskSetManager: Starting task 1.0:71 as TID 71 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,817 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:71 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,817 INFO cluster.ClusterTaskSetManager: Finished TID 54 in 1072 ms on ip-10-43-129-89.ec2.internal (progress: 55/216) | |
| 13/12/09 15:47:04,818 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 54) | |
| 13/12/09 15:47:04,818 INFO cluster.ClusterTaskSetManager: Starting task 1.0:72 as TID 72 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,818 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:72 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,819 INFO cluster.ClusterTaskSetManager: Finished TID 53 in 1147 ms on ip-10-181-0-146.ec2.internal (progress: 56/216) | |
| 13/12/09 15:47:04,820 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 53) | |
| 13/12/09 15:47:04,842 INFO cluster.ClusterTaskSetManager: Finished TID 57 in 723 ms on ip-10-181-0-146.ec2.internal (progress: 57/216) | |
| 13/12/09 15:47:04,842 INFO cluster.ClusterTaskSetManager: Starting task 1.0:73 as TID 73 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,843 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:73 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,844 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 57) | |
| 13/12/09 15:47:04,921 INFO cluster.ClusterTaskSetManager: Starting task 1.0:74 as TID 74 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,921 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:74 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,922 INFO cluster.ClusterTaskSetManager: Finished TID 61 in 695 ms on ip-10-43-129-89.ec2.internal (progress: 58/216) | |
| 13/12/09 15:47:04,922 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 61) | |
| 13/12/09 15:47:04,948 INFO cluster.ClusterTaskSetManager: Starting task 1.0:75 as TID 75 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:04,949 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:75 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:04,950 INFO cluster.ClusterTaskSetManager: Finished TID 62 in 718 ms on ip-10-181-0-146.ec2.internal (progress: 59/216) | |
| 13/12/09 15:47:04,950 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 62) | |
| 13/12/09 15:47:05,001 INFO cluster.ClusterTaskSetManager: Starting task 1.0:76 as TID 76 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,001 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:76 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,002 INFO cluster.ClusterTaskSetManager: Finished TID 60 in 777 ms on ip-10-43-129-89.ec2.internal (progress: 60/216) | |
| 13/12/09 15:47:05,002 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 60) | |
| 13/12/09 15:47:05,136 INFO cluster.ClusterTaskSetManager: Starting task 1.0:77 as TID 77 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,136 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:77 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,137 INFO cluster.ClusterTaskSetManager: Finished TID 55 in 1038 ms on ip-10-43-129-89.ec2.internal (progress: 61/216) | |
| 13/12/09 15:47:05,137 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 55) | |
| 13/12/09 15:47:05,218 INFO cluster.ClusterTaskSetManager: Starting task 1.0:78 as TID 78 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,218 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:78 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,219 INFO cluster.ClusterTaskSetManager: Finished TID 56 in 1116 ms on ip-10-181-0-146.ec2.internal (progress: 62/216) | |
| 13/12/09 15:47:05,219 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 56) | |
| 13/12/09 15:47:05,344 INFO cluster.ClusterTaskSetManager: Starting task 1.0:79 as TID 79 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,345 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:79 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:05,345 INFO cluster.ClusterTaskSetManager: Finished TID 63 in 1074 ms on ip-10-43-129-89.ec2.internal (progress: 63/216) | |
| 13/12/09 15:47:05,346 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 63) | |
| 13/12/09 15:47:05,353 INFO cluster.ClusterTaskSetManager: Starting task 1.0:80 as TID 80 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,354 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:80 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,355 INFO cluster.ClusterTaskSetManager: Finished TID 64 in 1023 ms on ip-10-43-129-89.ec2.internal (progress: 64/216) | |
| 13/12/09 15:47:05,355 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 64) | |
| 13/12/09 15:47:05,356 INFO cluster.ClusterTaskSetManager: Finished TID 72 in 538 ms on ip-10-181-0-146.ec2.internal (progress: 65/216) | |
| 13/12/09 15:47:05,357 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 72) | |
| 13/12/09 15:47:05,357 INFO cluster.ClusterTaskSetManager: Starting task 1.0:81 as TID 81 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,357 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:81 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,430 INFO cluster.ClusterTaskSetManager: Starting task 1.0:82 as TID 82 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,431 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:82 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,432 INFO cluster.ClusterTaskSetManager: Finished TID 73 in 590 ms on ip-10-181-0-146.ec2.internal (progress: 66/216) | |
| 13/12/09 15:47:05,432 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 73) | |
| 13/12/09 15:47:05,436 INFO cluster.ClusterTaskSetManager: Starting task 1.0:83 as TID 83 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,436 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:83 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,437 INFO cluster.ClusterTaskSetManager: Finished TID 70 in 624 ms on ip-10-43-129-89.ec2.internal (progress: 67/216) | |
| 13/12/09 15:47:05,437 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 70) | |
| 13/12/09 15:47:05,445 INFO cluster.ClusterTaskSetManager: Finished TID 71 in 628 ms on ip-10-43-129-89.ec2.internal (progress: 68/216) | |
| 13/12/09 15:47:05,445 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 71) | |
| 13/12/09 15:47:05,445 INFO cluster.ClusterTaskSetManager: Starting task 1.0:84 as TID 84 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,446 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:84 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,455 INFO cluster.ClusterTaskSetManager: Finished TID 69 in 662 ms on ip-10-181-0-146.ec2.internal (progress: 69/216) | |
| 13/12/09 15:47:05,456 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 69) | |
| 13/12/09 15:47:05,456 INFO cluster.ClusterTaskSetManager: Starting task 1.0:85 as TID 85 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,456 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:85 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,463 INFO cluster.ClusterTaskSetManager: Starting task 1.0:86 as TID 86 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,463 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:86 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,464 INFO cluster.ClusterTaskSetManager: Finished TID 65 in 1088 ms on ip-10-181-0-146.ec2.internal (progress: 70/216) | |
| 13/12/09 15:47:05,465 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 65) | |
| 13/12/09 15:47:05,593 INFO cluster.ClusterTaskSetManager: Starting task 1.0:87 as TID 87 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,593 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:87 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,594 INFO cluster.ClusterTaskSetManager: Finished TID 74 in 674 ms on ip-10-43-129-89.ec2.internal (progress: 71/216) | |
| 13/12/09 15:47:05,594 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 74) | |
| 13/12/09 15:47:05,595 INFO cluster.ClusterTaskSetManager: Finished TID 66 in 1082 ms on ip-10-181-0-146.ec2.internal (progress: 72/216) | |
| 13/12/09 15:47:05,595 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 66) | |
| 13/12/09 15:47:05,596 INFO cluster.ClusterTaskSetManager: Starting task 1.0:88 as TID 88 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,596 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:88 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,665 INFO cluster.ClusterTaskSetManager: Starting task 1.0:89 as TID 89 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,665 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:89 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,666 INFO cluster.ClusterTaskSetManager: Finished TID 67 in 1063 ms on ip-10-43-129-89.ec2.internal (progress: 73/216) | |
| 13/12/09 15:47:05,667 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 67) | |
| 13/12/09 15:47:05,800 INFO cluster.ClusterTaskSetManager: Finished TID 68 in 1024 ms on ip-10-181-0-146.ec2.internal (progress: 74/216) | |
| 13/12/09 15:47:05,800 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 68) | |
| 13/12/09 15:47:05,801 INFO cluster.ClusterTaskSetManager: Starting task 1.0:90 as TID 90 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,801 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:90 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,953 INFO cluster.ClusterTaskSetManager: Starting task 1.0:91 as TID 91 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,954 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:91 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,955 INFO cluster.ClusterTaskSetManager: Finished TID 81 in 598 ms on ip-10-181-0-146.ec2.internal (progress: 75/216) | |
| 13/12/09 15:47:05,955 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 81) | |
| 13/12/09 15:47:05,977 INFO cluster.ClusterTaskSetManager: Starting task 1.0:92 as TID 92 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,977 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:92 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,978 INFO cluster.ClusterTaskSetManager: Finished TID 82 in 548 ms on ip-10-181-0-146.ec2.internal (progress: 76/216) | |
| 13/12/09 15:47:05,978 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 82) | |
| 13/12/09 15:47:05,991 INFO cluster.ClusterTaskSetManager: Starting task 1.0:93 as TID 93 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:05,991 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:93 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:05,992 INFO cluster.ClusterTaskSetManager: Finished TID 85 in 536 ms on ip-10-181-0-146.ec2.internal (progress: 77/216) | |
| 13/12/09 15:47:05,993 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 85) | |
| 13/12/09 15:47:06,022 INFO cluster.ClusterTaskSetManager: Starting task 1.0:94 as TID 94 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,023 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:94 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,024 INFO cluster.ClusterTaskSetManager: Finished TID 76 in 1023 ms on ip-10-43-129-89.ec2.internal (progress: 78/216) | |
| 13/12/09 15:47:06,024 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 76) | |
| 13/12/09 15:47:06,024 INFO cluster.ClusterTaskSetManager: Starting task 1.0:95 as TID 95 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,025 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:95 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:06,025 INFO cluster.ClusterTaskSetManager: Finished TID 75 in 1077 ms on ip-10-181-0-146.ec2.internal (progress: 79/216) | |
| 13/12/09 15:47:06,026 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 75) | |
| 13/12/09 15:47:06,041 INFO cluster.ClusterTaskSetManager: Starting task 1.0:96 as TID 96 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,041 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:96 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,042 INFO cluster.ClusterTaskSetManager: Finished TID 83 in 607 ms on ip-10-43-129-89.ec2.internal (progress: 80/216) | |
| 13/12/09 15:47:06,042 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 83) | |
| 13/12/09 15:47:06,043 INFO cluster.ClusterTaskSetManager: Starting task 1.0:97 as TID 97 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,043 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:97 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,044 INFO cluster.ClusterTaskSetManager: Finished TID 84 in 598 ms on ip-10-43-129-89.ec2.internal (progress: 81/216) | |
| 13/12/09 15:47:06,044 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 84) | |
| 13/12/09 15:47:06,075 INFO cluster.ClusterTaskSetManager: Starting task 1.0:98 as TID 98 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,075 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:98 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,076 INFO cluster.ClusterTaskSetManager: Finished TID 77 in 941 ms on ip-10-43-129-89.ec2.internal (progress: 82/216) | |
| 13/12/09 15:47:06,076 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 77) | |
| 13/12/09 15:47:06,094 INFO cluster.ClusterTaskSetManager: Starting task 1.0:99 as TID 99 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,094 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:99 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,095 INFO cluster.ClusterTaskSetManager: Finished TID 86 in 632 ms on ip-10-181-0-146.ec2.internal (progress: 83/216) | |
| 13/12/09 15:47:06,096 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 86) | |
| 13/12/09 15:47:06,373 INFO cluster.ClusterTaskSetManager: Starting task 1.0:100 as TID 100 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,374 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:100 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:06,375 INFO cluster.ClusterTaskSetManager: Finished TID 79 in 1030 ms on ip-10-43-129-89.ec2.internal (progress: 84/216) | |
| 13/12/09 15:47:06,375 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 79) | |
| 13/12/09 15:47:06,379 INFO cluster.ClusterTaskSetManager: Starting task 1.0:101 as TID 101 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,379 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:101 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,380 INFO cluster.ClusterTaskSetManager: Finished TID 78 in 1163 ms on ip-10-181-0-146.ec2.internal (progress: 85/216) | |
| 13/12/09 15:47:06,380 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 78) | |
| 13/12/09 15:47:06,466 INFO cluster.ClusterTaskSetManager: Starting task 1.0:102 as TID 102 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,466 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:102 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,467 INFO cluster.ClusterTaskSetManager: Finished TID 80 in 1114 ms on ip-10-43-129-89.ec2.internal (progress: 86/216) | |
| 13/12/09 15:47:06,467 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 80) | |
| 13/12/09 15:47:06,594 INFO cluster.ClusterTaskSetManager: Starting task 1.0:103 as TID 103 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,594 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:103 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,595 INFO cluster.ClusterTaskSetManager: Finished TID 98 in 520 ms on ip-10-43-129-89.ec2.internal (progress: 87/216) | |
| 13/12/09 15:47:06,595 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 98) | |
| 13/12/09 15:47:06,596 INFO cluster.ClusterTaskSetManager: Starting task 1.0:104 as TID 104 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,596 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:104 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,597 INFO cluster.ClusterTaskSetManager: Finished TID 96 in 555 ms on ip-10-43-129-89.ec2.internal (progress: 88/216) | |
| 13/12/09 15:47:06,597 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 96) | |
| 13/12/09 15:47:06,603 INFO cluster.ClusterTaskSetManager: Starting task 1.0:105 as TID 105 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,604 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:105 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,605 INFO cluster.ClusterTaskSetManager: Finished TID 94 in 582 ms on ip-10-43-129-89.ec2.internal (progress: 89/216) | |
| 13/12/09 15:47:06,605 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 94) | |
| 13/12/09 15:47:06,611 INFO cluster.ClusterTaskSetManager: Starting task 1.0:106 as TID 106 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,611 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:106 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,612 INFO cluster.ClusterTaskSetManager: Finished TID 95 in 588 ms on ip-10-181-0-146.ec2.internal (progress: 90/216) | |
| 13/12/09 15:47:06,613 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 95) | |
| 13/12/09 15:47:06,635 INFO cluster.ClusterTaskSetManager: Starting task 1.0:107 as TID 107 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,636 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:107 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,637 INFO cluster.ClusterTaskSetManager: Finished TID 88 in 1041 ms on ip-10-181-0-146.ec2.internal (progress: 91/216) | |
| 13/12/09 15:47:06,637 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 88) | |
| 13/12/09 15:47:06,638 INFO cluster.ClusterTaskSetManager: Starting task 1.0:108 as TID 108 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,638 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:108 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,639 INFO cluster.ClusterTaskSetManager: Finished TID 93 in 648 ms on ip-10-181-0-146.ec2.internal (progress: 92/216) | |
| 13/12/09 15:47:06,639 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 93) | |
| 13/12/09 15:47:06,661 INFO cluster.ClusterTaskSetManager: Finished TID 89 in 996 ms on ip-10-43-129-89.ec2.internal (progress: 93/216) | |
| 13/12/09 15:47:06,661 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 89) | |
| 13/12/09 15:47:06,662 INFO cluster.ClusterTaskSetManager: Starting task 1.0:109 as TID 109 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,662 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:109 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,673 INFO cluster.ClusterTaskSetManager: Starting task 1.0:110 as TID 110 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,673 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:110 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,674 INFO cluster.ClusterTaskSetManager: Finished TID 97 in 632 ms on ip-10-43-129-89.ec2.internal (progress: 94/216) | |
| 13/12/09 15:47:06,674 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 97) | |
| 13/12/09 15:47:06,762 INFO cluster.ClusterTaskSetManager: Starting task 1.0:111 as TID 111 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,762 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:111 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,763 INFO cluster.ClusterTaskSetManager: Finished TID 87 in 1171 ms on ip-10-43-129-89.ec2.internal (progress: 95/216) | |
| 13/12/09 15:47:06,764 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 87) | |
| 13/12/09 15:47:06,895 INFO cluster.ClusterTaskSetManager: Starting task 1.0:112 as TID 112 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:06,896 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:112 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:06,897 INFO cluster.ClusterTaskSetManager: Finished TID 90 in 1095 ms on ip-10-181-0-146.ec2.internal (progress: 96/216) | |
| 13/12/09 15:47:06,897 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 90) | |
| 13/12/09 15:47:07,099 INFO cluster.ClusterTaskSetManager: Starting task 1.0:113 as TID 113 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,100 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:113 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,101 INFO cluster.ClusterTaskSetManager: Finished TID 92 in 1125 ms on ip-10-181-0-146.ec2.internal (progress: 97/216) | |
| 13/12/09 15:47:07,101 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 92) | |
| 13/12/09 15:47:07,112 INFO cluster.ClusterTaskSetManager: Starting task 1.0:114 as TID 114 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,112 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:114 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,113 INFO cluster.ClusterTaskSetManager: Finished TID 91 in 1160 ms on ip-10-181-0-146.ec2.internal (progress: 98/216) | |
| 13/12/09 15:47:07,114 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 91) | |
| 13/12/09 15:47:07,119 INFO cluster.ClusterTaskSetManager: Starting task 1.0:115 as TID 115 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,120 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:115 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:07,120 INFO cluster.ClusterTaskSetManager: Finished TID 99 in 1026 ms on ip-10-181-0-146.ec2.internal (progress: 99/216) | |
| 13/12/09 15:47:07,121 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 99) | |
| 13/12/09 15:47:07,166 INFO cluster.ClusterTaskSetManager: Starting task 1.0:116 as TID 116 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,167 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:116 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:07,167 INFO cluster.ClusterTaskSetManager: Finished TID 110 in 494 ms on ip-10-43-129-89.ec2.internal (progress: 100/216) | |
| 13/12/09 15:47:07,168 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 110) | |
| 13/12/09 15:47:07,177 INFO cluster.ClusterTaskSetManager: Starting task 1.0:117 as TID 117 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,178 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:117 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:07,179 INFO cluster.ClusterTaskSetManager: Finished TID 105 in 576 ms on ip-10-43-129-89.ec2.internal (progress: 101/216) | |
| 13/12/09 15:47:07,180 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 105) | |
| 13/12/09 15:47:07,199 INFO cluster.ClusterTaskSetManager: Starting task 1.0:118 as TID 118 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,199 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:118 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,200 INFO cluster.ClusterTaskSetManager: Finished TID 108 in 563 ms on ip-10-181-0-146.ec2.internal (progress: 102/216) | |
| 13/12/09 15:47:07,200 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 108) | |
| 13/12/09 15:47:07,206 INFO cluster.ClusterTaskSetManager: Starting task 1.0:119 as TID 119 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,206 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:119 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,207 INFO cluster.ClusterTaskSetManager: Finished TID 106 in 595 ms on ip-10-181-0-146.ec2.internal (progress: 103/216) | |
| 13/12/09 15:47:07,207 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 106) | |
| 13/12/09 15:47:07,231 INFO cluster.ClusterTaskSetManager: Starting task 1.0:120 as TID 120 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,232 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:120 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,232 INFO cluster.ClusterTaskSetManager: Finished TID 109 in 570 ms on ip-10-43-129-89.ec2.internal (progress: 104/216) | |
| 13/12/09 15:47:07,233 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 109) | |
| 13/12/09 15:47:07,249 INFO cluster.ClusterTaskSetManager: Starting task 1.0:121 as TID 121 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,250 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:121 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,251 INFO cluster.ClusterTaskSetManager: Finished TID 107 in 616 ms on ip-10-181-0-146.ec2.internal (progress: 105/216) | |
| 13/12/09 15:47:07,251 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 107) | |
| 13/12/09 15:47:07,252 INFO cluster.ClusterTaskSetManager: Starting task 1.0:122 as TID 122 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,252 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:122 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,253 INFO cluster.ClusterTaskSetManager: Finished TID 100 in 880 ms on ip-10-43-129-89.ec2.internal (progress: 106/216) | |
| 13/12/09 15:47:07,254 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 100) | |
| 13/12/09 15:47:07,340 INFO cluster.ClusterTaskSetManager: Starting task 1.0:123 as TID 123 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,341 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:123 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,342 INFO cluster.ClusterTaskSetManager: Finished TID 102 in 877 ms on ip-10-43-129-89.ec2.internal (progress: 107/216) | |
| 13/12/09 15:47:07,342 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 102) | |
| 13/12/09 15:47:07,393 INFO cluster.ClusterTaskSetManager: Starting task 1.0:124 as TID 124 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,393 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:124 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,394 INFO cluster.ClusterTaskSetManager: Finished TID 101 in 1015 ms on ip-10-181-0-146.ec2.internal (progress: 108/216) | |
| 13/12/09 15:47:07,395 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 101) | |
| 13/12/09 15:47:07,453 INFO cluster.ClusterTaskSetManager: Starting task 1.0:125 as TID 125 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,454 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:125 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,455 INFO cluster.ClusterTaskSetManager: Finished TID 103 in 860 ms on ip-10-43-129-89.ec2.internal (progress: 109/216) | |
| 13/12/09 15:47:07,455 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 103) | |
| 13/12/09 15:47:07,760 INFO cluster.ClusterTaskSetManager: Starting task 1.0:126 as TID 126 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,760 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:126 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,761 INFO cluster.ClusterTaskSetManager: Finished TID 119 in 556 ms on ip-10-181-0-146.ec2.internal (progress: 110/216) | |
| 13/12/09 15:47:07,761 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 119) | |
| 13/12/09 15:47:07,761 INFO cluster.ClusterTaskSetManager: Starting task 1.0:127 as TID 127 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,762 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:127 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,763 INFO cluster.ClusterTaskSetManager: Finished TID 118 in 563 ms on ip-10-181-0-146.ec2.internal (progress: 111/216) | |
| 13/12/09 15:47:07,763 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 118) | |
| 13/12/09 15:47:07,793 INFO cluster.ClusterTaskSetManager: Starting task 1.0:128 as TID 128 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,794 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:128 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,795 INFO cluster.ClusterTaskSetManager: Finished TID 117 in 617 ms on ip-10-43-129-89.ec2.internal (progress: 112/216) | |
| 13/12/09 15:47:07,795 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 117) | |
| 13/12/09 15:47:07,796 INFO cluster.ClusterTaskSetManager: Starting task 1.0:129 as TID 129 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,796 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:129 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,797 INFO cluster.ClusterTaskSetManager: Finished TID 112 in 902 ms on ip-10-181-0-146.ec2.internal (progress: 113/216) | |
| 13/12/09 15:47:07,797 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 112) | |
| 13/12/09 15:47:07,803 INFO cluster.ClusterTaskSetManager: Finished TID 121 in 554 ms on ip-10-181-0-146.ec2.internal (progress: 114/216) | |
| 13/12/09 15:47:07,803 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 121) | |
| 13/12/09 15:47:07,804 INFO cluster.ClusterTaskSetManager: Starting task 1.0:130 as TID 130 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,804 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:130 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,830 INFO cluster.ClusterTaskSetManager: Starting task 1.0:131 as TID 131 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,830 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:131 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,831 INFO cluster.ClusterTaskSetManager: Finished TID 120 in 600 ms on ip-10-43-129-89.ec2.internal (progress: 115/216) | |
| 13/12/09 15:47:07,832 INFO cluster.ClusterTaskSetManager: Finished TID 122 in 580 ms on ip-10-43-129-89.ec2.internal (progress: 116/216) | |
| 13/12/09 15:47:07,833 INFO cluster.ClusterTaskSetManager: Starting task 1.0:132 as TID 132 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,833 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:132 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,833 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 120) | |
| 13/12/09 15:47:07,835 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 122) | |
| 13/12/09 15:47:07,935 INFO cluster.ClusterTaskSetManager: Starting task 1.0:133 as TID 133 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,936 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:133 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,937 INFO cluster.ClusterTaskSetManager: Finished TID 104 in 1342 ms on ip-10-43-129-89.ec2.internal (progress: 117/216) | |
| 13/12/09 15:47:07,937 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 104) | |
| 13/12/09 15:47:07,974 INFO cluster.ClusterTaskSetManager: Starting task 1.0:134 as TID 134 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,975 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:134 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:07,975 INFO cluster.ClusterTaskSetManager: Finished TID 113 in 876 ms on ip-10-181-0-146.ec2.internal (progress: 118/216) | |
| 13/12/09 15:47:07,976 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 113) | |
| 13/12/09 15:47:07,979 INFO cluster.ClusterTaskSetManager: Starting task 1.0:135 as TID 135 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:07,980 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:135 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:07,981 INFO cluster.ClusterTaskSetManager: Finished TID 115 in 861 ms on ip-10-181-0-146.ec2.internal (progress: 119/216) | |
| 13/12/09 15:47:07,981 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 115) | |
| 13/12/09 15:47:08,005 INFO cluster.ClusterTaskSetManager: Finished TID 111 in 1244 ms on ip-10-43-129-89.ec2.internal (progress: 120/216) | |
| 13/12/09 15:47:08,005 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 111) | |
| 13/12/09 15:47:08,006 INFO cluster.ClusterTaskSetManager: Starting task 1.0:136 as TID 136 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,006 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:136 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,014 INFO cluster.ClusterTaskSetManager: Starting task 1.0:137 as TID 137 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,014 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:137 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,015 INFO cluster.ClusterTaskSetManager: Finished TID 114 in 903 ms on ip-10-181-0-146.ec2.internal (progress: 121/216) | |
| 13/12/09 15:47:08,015 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 114) | |
| 13/12/09 15:47:08,072 INFO cluster.ClusterTaskSetManager: Starting task 1.0:138 as TID 138 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,073 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:138 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:08,073 INFO cluster.ClusterTaskSetManager: Finished TID 116 in 907 ms on ip-10-43-129-89.ec2.internal (progress: 122/216) | |
| 13/12/09 15:47:08,074 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 116) | |
| 13/12/09 15:47:08,181 INFO cluster.ClusterTaskSetManager: Starting task 1.0:139 as TID 139 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,182 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:139 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,182 INFO cluster.ClusterTaskSetManager: Finished TID 123 in 842 ms on ip-10-43-129-89.ec2.internal (progress: 123/216) | |
| 13/12/09 15:47:08,183 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 123) | |
| 13/12/09 15:47:08,293 INFO cluster.ClusterTaskSetManager: Starting task 1.0:140 as TID 140 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,294 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:140 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,295 INFO cluster.ClusterTaskSetManager: Finished TID 125 in 842 ms on ip-10-43-129-89.ec2.internal (progress: 124/216) | |
| 13/12/09 15:47:08,296 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 125) | |
| 13/12/09 15:47:08,312 INFO cluster.ClusterTaskSetManager: Starting task 1.0:141 as TID 141 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,313 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:141 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,314 INFO cluster.ClusterTaskSetManager: Finished TID 124 in 921 ms on ip-10-181-0-146.ec2.internal (progress: 125/216) | |
| 13/12/09 15:47:08,314 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 124) | |
| 13/12/09 15:47:08,353 INFO cluster.ClusterTaskSetManager: Finished TID 132 in 521 ms on ip-10-43-129-89.ec2.internal (progress: 126/216) | |
| 13/12/09 15:47:08,354 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 132) | |
| 13/12/09 15:47:08,354 INFO cluster.ClusterTaskSetManager: Starting task 1.0:142 as TID 142 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,355 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:142 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:08,427 INFO cluster.ClusterTaskSetManager: Starting task 1.0:143 as TID 143 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,428 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:143 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,428 INFO cluster.ClusterTaskSetManager: Finished TID 129 in 633 ms on ip-10-181-0-146.ec2.internal (progress: 127/216) | |
| 13/12/09 15:47:08,429 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 129) | |
| 13/12/09 15:47:08,439 INFO cluster.ClusterTaskSetManager: Starting task 1.0:144 as TID 144 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,440 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:144 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,440 INFO cluster.ClusterTaskSetManager: Finished TID 130 in 637 ms on ip-10-181-0-146.ec2.internal (progress: 128/216) | |
| 13/12/09 15:47:08,441 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 130) | |
| 13/12/09 15:47:08,476 INFO cluster.ClusterTaskSetManager: Finished TID 131 in 647 ms on ip-10-43-129-89.ec2.internal (progress: 129/216) | |
| 13/12/09 15:47:08,477 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 131) | |
| 13/12/09 15:47:08,477 INFO cluster.ClusterTaskSetManager: Starting task 1.0:145 as TID 145 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,478 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:145 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,533 INFO cluster.ClusterTaskSetManager: Finished TID 134 in 558 ms on ip-10-181-0-146.ec2.internal (progress: 130/216) | |
| 13/12/09 15:47:08,534 INFO cluster.ClusterTaskSetManager: Starting task 1.0:146 as TID 146 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,534 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 134) | |
| 13/12/09 15:47:08,534 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:146 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,536 INFO cluster.ClusterTaskSetManager: Starting task 1.0:147 as TID 147 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,537 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:147 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,537 INFO cluster.ClusterTaskSetManager: Finished TID 133 in 602 ms on ip-10-43-129-89.ec2.internal (progress: 131/216) | |
| 13/12/09 15:47:08,538 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 133) | |
| 13/12/09 15:47:08,574 INFO cluster.ClusterTaskSetManager: Starting task 1.0:148 as TID 148 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,575 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:148 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:08,575 INFO cluster.ClusterTaskSetManager: Finished TID 127 in 814 ms on ip-10-181-0-146.ec2.internal (progress: 132/216) | |
| 13/12/09 15:47:08,576 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 127) | |
| 13/12/09 15:47:08,619 INFO cluster.ClusterTaskSetManager: Starting task 1.0:149 as TID 149 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,620 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:149 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,621 INFO cluster.ClusterTaskSetManager: Finished TID 128 in 827 ms on ip-10-43-129-89.ec2.internal (progress: 133/216) | |
| 13/12/09 15:47:08,621 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 128) | |
| 13/12/09 15:47:08,675 INFO cluster.ClusterTaskSetManager: Finished TID 126 in 915 ms on ip-10-181-0-146.ec2.internal (progress: 134/216) | |
| 13/12/09 15:47:08,675 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 126) | |
| 13/12/09 15:47:08,675 INFO cluster.ClusterTaskSetManager: Starting task 1.0:150 as TID 150 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,676 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:150 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:08,825 INFO cluster.ClusterTaskSetManager: Starting task 1.0:151 as TID 151 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,826 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:151 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,826 INFO cluster.ClusterTaskSetManager: Finished TID 141 in 514 ms on ip-10-181-0-146.ec2.internal (progress: 135/216) | |
| 13/12/09 15:47:08,827 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 141) | |
| 13/12/09 15:47:08,879 INFO cluster.ClusterTaskSetManager: Finished TID 136 in 874 ms on ip-10-43-129-89.ec2.internal (progress: 136/216) | |
| 13/12/09 15:47:08,879 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 136) | |
| 13/12/09 15:47:08,879 INFO cluster.ClusterTaskSetManager: Starting task 1.0:152 as TID 152 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,880 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:152 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:08,902 INFO cluster.ClusterTaskSetManager: Starting task 1.0:153 as TID 153 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,902 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:153 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,903 INFO cluster.ClusterTaskSetManager: Finished TID 142 in 549 ms on ip-10-43-129-89.ec2.internal (progress: 137/216) | |
| 13/12/09 15:47:08,904 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 142) | |
| 13/12/09 15:47:08,924 INFO cluster.ClusterTaskSetManager: Starting task 1.0:154 as TID 154 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,924 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:154 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,925 INFO cluster.ClusterTaskSetManager: Finished TID 135 in 946 ms on ip-10-181-0-146.ec2.internal (progress: 138/216) | |
| 13/12/09 15:47:08,925 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 135) | |
| 13/12/09 15:47:08,926 INFO cluster.ClusterTaskSetManager: Finished TID 137 in 912 ms on ip-10-181-0-146.ec2.internal (progress: 139/216) | |
| 13/12/09 15:47:08,926 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 137) | |
| 13/12/09 15:47:08,926 INFO cluster.ClusterTaskSetManager: Starting task 1.0:155 as TID 155 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,927 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:155 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,943 INFO cluster.ClusterTaskSetManager: Starting task 1.0:156 as TID 156 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,943 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:156 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,944 INFO cluster.ClusterTaskSetManager: Finished TID 138 in 872 ms on ip-10-43-129-89.ec2.internal (progress: 140/216) | |
| 13/12/09 15:47:08,944 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 138) | |
| 13/12/09 15:47:08,996 INFO cluster.ClusterTaskSetManager: Starting task 1.0:157 as TID 157 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:08,997 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:157 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:08,997 INFO cluster.ClusterTaskSetManager: Finished TID 139 in 816 ms on ip-10-43-129-89.ec2.internal (progress: 141/216) | |
| 13/12/09 15:47:08,998 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 139) | |
| 13/12/09 15:47:09,015 INFO cluster.ClusterTaskSetManager: Finished TID 145 in 538 ms on ip-10-43-129-89.ec2.internal (progress: 142/216) | |
| 13/12/09 15:47:09,016 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 145) | |
| 13/12/09 15:47:09,016 INFO cluster.ClusterTaskSetManager: Starting task 1.0:158 as TID 158 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,016 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:158 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,032 INFO cluster.ClusterTaskSetManager: Starting task 1.0:159 as TID 159 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,033 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:159 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:09,033 INFO cluster.ClusterTaskSetManager: Finished TID 144 in 594 ms on ip-10-181-0-146.ec2.internal (progress: 143/216) | |
| 13/12/09 15:47:09,034 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 144) | |
| 13/12/09 15:47:09,061 INFO cluster.ClusterTaskSetManager: Finished TID 146 in 528 ms on ip-10-181-0-146.ec2.internal (progress: 144/216) | |
| 13/12/09 15:47:09,062 INFO cluster.ClusterTaskSetManager: Starting task 1.0:160 as TID 160 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,062 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:160 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,063 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 146) | |
| 13/12/09 15:47:09,115 INFO cluster.ClusterTaskSetManager: Starting task 1.0:161 as TID 161 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,116 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:161 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:09,116 INFO cluster.ClusterTaskSetManager: Finished TID 143 in 690 ms on ip-10-181-0-146.ec2.internal (progress: 145/216) | |
| 13/12/09 15:47:09,117 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 143) | |
| 13/12/09 15:47:09,171 INFO cluster.ClusterTaskSetManager: Starting task 1.0:162 as TID 162 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,171 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:162 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,172 INFO cluster.ClusterTaskSetManager: Finished TID 140 in 879 ms on ip-10-43-129-89.ec2.internal (progress: 146/216) | |
| 13/12/09 15:47:09,172 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 140) | |
| 13/12/09 15:47:09,395 INFO cluster.ClusterTaskSetManager: Starting task 1.0:163 as TID 163 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,395 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:163 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,396 INFO cluster.ClusterTaskSetManager: Finished TID 147 in 860 ms on ip-10-43-129-89.ec2.internal (progress: 147/216) | |
| 13/12/09 15:47:09,396 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 147) | |
| 13/12/09 15:47:09,408 INFO cluster.ClusterTaskSetManager: Starting task 1.0:164 as TID 164 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,409 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:164 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,410 INFO cluster.ClusterTaskSetManager: Finished TID 148 in 836 ms on ip-10-181-0-146.ec2.internal (progress: 148/216) | |
| 13/12/09 15:47:09,410 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 148) | |
| 13/12/09 15:47:09,450 INFO cluster.ClusterTaskSetManager: Starting task 1.0:165 as TID 165 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,450 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:165 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,451 INFO cluster.ClusterTaskSetManager: Finished TID 154 in 528 ms on ip-10-181-0-146.ec2.internal (progress: 149/216) | |
| 13/12/09 15:47:09,451 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 154) | |
| 13/12/09 15:47:09,475 INFO cluster.ClusterTaskSetManager: Starting task 1.0:166 as TID 166 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,475 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:166 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,476 INFO cluster.ClusterTaskSetManager: Finished TID 153 in 574 ms on ip-10-43-129-89.ec2.internal (progress: 150/216) | |
| 13/12/09 15:47:09,476 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 153) | |
| 13/12/09 15:47:09,494 INFO cluster.ClusterTaskSetManager: Starting task 1.0:167 as TID 167 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,495 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:167 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:09,495 INFO cluster.ClusterTaskSetManager: Finished TID 156 in 552 ms on ip-10-43-129-89.ec2.internal (progress: 151/216) | |
| 13/12/09 15:47:09,496 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 156) | |
| 13/12/09 15:47:09,507 INFO cluster.ClusterTaskSetManager: Starting task 1.0:168 as TID 168 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,507 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:168 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,508 INFO cluster.ClusterTaskSetManager: Finished TID 150 in 833 ms on ip-10-181-0-146.ec2.internal (progress: 152/216) | |
| 13/12/09 15:47:09,508 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 150) | |
| 13/12/09 15:47:09,512 INFO cluster.ClusterTaskSetManager: Starting task 1.0:169 as TID 169 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,513 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:169 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,514 INFO cluster.ClusterTaskSetManager: Finished TID 158 in 498 ms on ip-10-43-129-89.ec2.internal (progress: 153/216) | |
| 13/12/09 15:47:09,514 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 158) | |
| 13/12/09 15:47:09,522 INFO cluster.ClusterTaskSetManager: Starting task 1.0:170 as TID 170 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,523 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:170 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,524 INFO cluster.ClusterTaskSetManager: Finished TID 155 in 597 ms on ip-10-181-0-146.ec2.internal (progress: 154/216) | |
| 13/12/09 15:47:09,524 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 155) | |
| 13/12/09 15:47:09,556 INFO cluster.ClusterTaskSetManager: Starting task 1.0:171 as TID 171 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,557 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:171 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:09,557 INFO cluster.ClusterTaskSetManager: Finished TID 149 in 938 ms on ip-10-43-129-89.ec2.internal (progress: 155/216) | |
| 13/12/09 15:47:09,558 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 149) | |
| 13/12/09 15:47:09,573 INFO cluster.ClusterTaskSetManager: Starting task 1.0:172 as TID 172 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,574 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:172 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:09,574 INFO cluster.ClusterTaskSetManager: Finished TID 157 in 578 ms on ip-10-43-129-89.ec2.internal (progress: 156/216) | |
| 13/12/09 15:47:09,575 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 157) | |
| 13/12/09 15:47:09,670 INFO cluster.ClusterTaskSetManager: Starting task 1.0:173 as TID 173 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,671 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:173 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,671 INFO cluster.ClusterTaskSetManager: Finished TID 152 in 792 ms on ip-10-43-129-89.ec2.internal (progress: 157/216) | |
| 13/12/09 15:47:09,671 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 152) | |
| 13/12/09 15:47:09,685 INFO cluster.ClusterTaskSetManager: Starting task 1.0:174 as TID 174 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,685 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:174 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,686 INFO cluster.ClusterTaskSetManager: Finished TID 151 in 861 ms on ip-10-181-0-146.ec2.internal (progress: 158/216) | |
| 13/12/09 15:47:09,686 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 151) | |
| 13/12/09 15:47:09,897 INFO cluster.ClusterTaskSetManager: Starting task 1.0:175 as TID 175 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,897 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:175 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,898 INFO cluster.ClusterTaskSetManager: Finished TID 159 in 866 ms on ip-10-181-0-146.ec2.internal (progress: 159/216) | |
| 13/12/09 15:47:09,898 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 159) | |
| 13/12/09 15:47:09,906 INFO cluster.ClusterTaskSetManager: Starting task 1.0:176 as TID 176 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,907 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:176 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,907 INFO cluster.ClusterTaskSetManager: Finished TID 161 in 792 ms on ip-10-181-0-146.ec2.internal (progress: 160/216) | |
| 13/12/09 15:47:09,908 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 161) | |
| 13/12/09 15:47:09,986 INFO cluster.ClusterTaskSetManager: Starting task 1.0:177 as TID 177 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:09,986 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:177 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:09,987 INFO cluster.ClusterTaskSetManager: Finished TID 165 in 538 ms on ip-10-181-0-146.ec2.internal (progress: 161/216) | |
| 13/12/09 15:47:09,987 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 165) | |
| 13/12/09 15:47:10,007 INFO cluster.ClusterTaskSetManager: Starting task 1.0:178 as TID 178 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,007 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:178 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,008 INFO cluster.ClusterTaskSetManager: Finished TID 166 in 533 ms on ip-10-43-129-89.ec2.internal (progress: 162/216) | |
| 13/12/09 15:47:10,008 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 166) | |
| 13/12/09 15:47:10,040 INFO cluster.ClusterTaskSetManager: Finished TID 160 in 978 ms on ip-10-181-0-146.ec2.internal (progress: 163/216) | |
| 13/12/09 15:47:10,040 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 160) | |
| 13/12/09 15:47:10,041 INFO cluster.ClusterTaskSetManager: Starting task 1.0:179 as TID 179 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,041 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:179 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,042 INFO cluster.ClusterTaskSetManager: Finished TID 169 in 530 ms on ip-10-43-129-89.ec2.internal (progress: 164/216) | |
| 13/12/09 15:47:10,043 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 169) | |
| 13/12/09 15:47:10,043 INFO cluster.ClusterTaskSetManager: Starting task 1.0:180 as TID 180 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,043 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:180 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,044 INFO cluster.ClusterTaskSetManager: Starting task 1.0:181 as TID 181 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,045 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:181 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,045 INFO cluster.ClusterTaskSetManager: Finished TID 162 in 874 ms on ip-10-43-129-89.ec2.internal (progress: 165/216) | |
| 13/12/09 15:47:10,046 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 162) | |
| 13/12/09 15:47:10,046 INFO cluster.ClusterTaskSetManager: Starting task 1.0:182 as TID 182 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,046 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:182 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,047 INFO cluster.ClusterTaskSetManager: Finished TID 168 in 540 ms on ip-10-181-0-146.ec2.internal (progress: 166/216) | |
| 13/12/09 15:47:10,047 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 168) | |
| 13/12/09 15:47:10,065 INFO cluster.ClusterTaskSetManager: Starting task 1.0:183 as TID 183 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,065 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:183 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,066 INFO cluster.ClusterTaskSetManager: Finished TID 167 in 572 ms on ip-10-43-129-89.ec2.internal (progress: 167/216) | |
| 13/12/09 15:47:10,066 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 167) | |
| 13/12/09 15:47:10,093 INFO cluster.ClusterTaskSetManager: Finished TID 170 in 571 ms on ip-10-181-0-146.ec2.internal (progress: 168/216) | |
| 13/12/09 15:47:10,093 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 170) | |
| 13/12/09 15:47:10,093 INFO cluster.ClusterTaskSetManager: Starting task 1.0:184 as TID 184 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,094 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:184 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,150 INFO cluster.ClusterTaskSetManager: Starting task 1.0:185 as TID 185 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,151 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:185 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,151 INFO cluster.ClusterTaskSetManager: Finished TID 164 in 743 ms on ip-10-181-0-146.ec2.internal (progress: 169/216) | |
| 13/12/09 15:47:10,151 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 164) | |
| 13/12/09 15:47:10,241 INFO cluster.ClusterTaskSetManager: Starting task 1.0:186 as TID 186 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,242 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:186 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,243 INFO cluster.ClusterTaskSetManager: Finished TID 163 in 848 ms on ip-10-43-129-89.ec2.internal (progress: 170/216) | |
| 13/12/09 15:47:10,243 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 163) | |
| 13/12/09 15:47:10,329 INFO cluster.ClusterTaskSetManager: Starting task 1.0:187 as TID 187 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,329 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:187 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,330 INFO cluster.ClusterTaskSetManager: Finished TID 172 in 757 ms on ip-10-43-129-89.ec2.internal (progress: 171/216) | |
| 13/12/09 15:47:10,330 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 172) | |
| 13/12/09 15:47:10,398 INFO cluster.ClusterTaskSetManager: Starting task 1.0:188 as TID 188 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,399 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:188 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,399 INFO cluster.ClusterTaskSetManager: Finished TID 171 in 843 ms on ip-10-43-129-89.ec2.internal (progress: 172/216) | |
| 13/12/09 15:47:10,399 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 171) | |
| 13/12/09 15:47:10,488 INFO cluster.ClusterTaskSetManager: Starting task 1.0:189 as TID 189 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,488 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:189 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,489 INFO cluster.ClusterTaskSetManager: Finished TID 174 in 804 ms on ip-10-181-0-146.ec2.internal (progress: 173/216) | |
| 13/12/09 15:47:10,489 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 174) | |
| 13/12/09 15:47:10,489 INFO cluster.ClusterTaskSetManager: Starting task 1.0:190 as TID 190 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,490 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:190 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,490 INFO cluster.ClusterTaskSetManager: Finished TID 177 in 504 ms on ip-10-181-0-146.ec2.internal (progress: 174/216) | |
| 13/12/09 15:47:10,490 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 177) | |
| 13/12/09 15:47:10,497 INFO cluster.ClusterTaskSetManager: Starting task 1.0:191 as TID 191 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,498 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:191 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,498 INFO cluster.ClusterTaskSetManager: Finished TID 173 in 828 ms on ip-10-43-129-89.ec2.internal (progress: 175/216) | |
| 13/12/09 15:47:10,499 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 173) | |
| 13/12/09 15:47:10,499 INFO cluster.ClusterTaskSetManager: Finished TID 178 in 492 ms on ip-10-43-129-89.ec2.internal (progress: 176/216) | |
| 13/12/09 15:47:10,500 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 178) | |
| 13/12/09 15:47:10,500 INFO cluster.ClusterTaskSetManager: Starting task 1.0:192 as TID 192 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,501 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:192 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,534 INFO cluster.ClusterTaskSetManager: Starting task 1.0:193 as TID 193 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,534 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:193 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,535 INFO cluster.ClusterTaskSetManager: Finished TID 182 in 489 ms on ip-10-181-0-146.ec2.internal (progress: 177/216) | |
| 13/12/09 15:47:10,535 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 182) | |
| 13/12/09 15:47:10,583 INFO cluster.ClusterTaskSetManager: Starting task 1.0:194 as TID 194 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,584 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:194 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,584 INFO cluster.ClusterTaskSetManager: Finished TID 180 in 541 ms on ip-10-43-129-89.ec2.internal (progress: 178/216) | |
| 13/12/09 15:47:10,585 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 180) | |
| 13/12/09 15:47:10,589 INFO cluster.ClusterTaskSetManager: Starting task 1.0:195 as TID 195 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,589 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:195 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,590 INFO cluster.ClusterTaskSetManager: Finished TID 179 in 550 ms on ip-10-181-0-146.ec2.internal (progress: 179/216) | |
| 13/12/09 15:47:10,590 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 179) | |
| 13/12/09 15:47:10,609 INFO cluster.ClusterTaskSetManager: Finished TID 181 in 565 ms on ip-10-43-129-89.ec2.internal (progress: 180/216) | |
| 13/12/09 15:47:10,609 INFO cluster.ClusterTaskSetManager: Starting task 1.0:196 as TID 196 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,610 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:196 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,611 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 181) | |
| 13/12/09 15:47:10,664 INFO cluster.ClusterTaskSetManager: Starting task 1.0:197 as TID 197 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,665 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:197 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,666 INFO cluster.ClusterTaskSetManager: Finished TID 175 in 769 ms on ip-10-181-0-146.ec2.internal (progress: 181/216) | |
| 13/12/09 15:47:10,666 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 175) | |
| 13/12/09 15:47:10,679 INFO cluster.ClusterTaskSetManager: Starting task 1.0:198 as TID 198 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,680 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:198 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,681 INFO cluster.ClusterTaskSetManager: Finished TID 176 in 775 ms on ip-10-181-0-146.ec2.internal (progress: 182/216) | |
| 13/12/09 15:47:10,681 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 176) | |
| 13/12/09 15:47:10,884 INFO cluster.ClusterTaskSetManager: Starting task 1.0:199 as TID 199 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,885 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:199 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,885 INFO cluster.ClusterTaskSetManager: Finished TID 183 in 820 ms on ip-10-43-129-89.ec2.internal (progress: 183/216) | |
| 13/12/09 15:47:10,886 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 183) | |
| 13/12/09 15:47:10,921 INFO cluster.ClusterTaskSetManager: Starting task 1.0:200 as TID 200 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,921 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:200 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:10,922 INFO cluster.ClusterTaskSetManager: Finished TID 184 in 829 ms on ip-10-181-0-146.ec2.internal (progress: 184/216) | |
| 13/12/09 15:47:10,922 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 184) | |
| 13/12/09 15:47:10,979 INFO cluster.ClusterTaskSetManager: Starting task 1.0:201 as TID 201 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,980 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:201 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,980 INFO cluster.ClusterTaskSetManager: Finished TID 189 in 493 ms on ip-10-181-0-146.ec2.internal (progress: 185/216) | |
| 13/12/09 15:47:10,981 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 189) | |
| 13/12/09 15:47:10,988 INFO cluster.ClusterTaskSetManager: Starting task 1.0:202 as TID 202 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:10,989 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:202 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:10,989 INFO cluster.ClusterTaskSetManager: Finished TID 191 in 492 ms on ip-10-43-129-89.ec2.internal (progress: 186/216) | |
| 13/12/09 15:47:10,990 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 191) | |
| 13/12/09 15:47:11,000 INFO cluster.ClusterTaskSetManager: Starting task 1.0:203 as TID 203 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,000 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:203 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,001 INFO cluster.ClusterTaskSetManager: Finished TID 186 in 760 ms on ip-10-43-129-89.ec2.internal (progress: 187/216) | |
| 13/12/09 15:47:11,001 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 186) | |
| 13/12/09 15:47:11,002 INFO cluster.ClusterTaskSetManager: Finished TID 190 in 513 ms on ip-10-181-0-146.ec2.internal (progress: 188/216) | |
| 13/12/09 15:47:11,002 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 190) | |
| 13/12/09 15:47:11,002 INFO cluster.ClusterTaskSetManager: Starting task 1.0:204 as TID 204 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,003 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:204 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,008 INFO cluster.ClusterTaskSetManager: Starting task 1.0:205 as TID 205 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,008 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:205 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,009 INFO cluster.ClusterTaskSetManager: Finished TID 192 in 509 ms on ip-10-43-129-89.ec2.internal (progress: 189/216) | |
| 13/12/09 15:47:11,010 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 192) | |
| 13/12/09 15:47:11,016 INFO cluster.ClusterTaskSetManager: Starting task 1.0:206 as TID 206 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,016 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:206 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,017 INFO cluster.ClusterTaskSetManager: Finished TID 185 in 867 ms on ip-10-181-0-146.ec2.internal (progress: 190/216) | |
| 13/12/09 15:47:11,017 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 185) | |
| 13/12/09 15:47:11,064 INFO cluster.ClusterTaskSetManager: Starting task 1.0:207 as TID 207 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,065 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:207 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,066 INFO cluster.ClusterTaskSetManager: Finished TID 194 in 482 ms on ip-10-43-129-89.ec2.internal (progress: 191/216) | |
| 13/12/09 15:47:11,066 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 194) | |
| 13/12/09 15:47:11,142 INFO cluster.ClusterTaskSetManager: Starting task 1.0:208 as TID 208 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,142 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:208 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,143 INFO cluster.ClusterTaskSetManager: Finished TID 187 in 814 ms on ip-10-43-129-89.ec2.internal (progress: 192/216) | |
| 13/12/09 15:47:11,143 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 187) | |
| 13/12/09 15:47:11,157 INFO cluster.ClusterTaskSetManager: Starting task 1.0:209 as TID 209 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,157 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:209 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,158 INFO cluster.ClusterTaskSetManager: Finished TID 193 in 625 ms on ip-10-181-0-146.ec2.internal (progress: 193/216) | |
| 13/12/09 15:47:11,158 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 193) | |
| 13/12/09 15:47:11,242 INFO cluster.ClusterTaskSetManager: Starting task 1.0:210 as TID 210 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,242 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:210 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,243 INFO cluster.ClusterTaskSetManager: Finished TID 188 in 845 ms on ip-10-43-129-89.ec2.internal (progress: 194/216) | |
| 13/12/09 15:47:11,243 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 188) | |
| 13/12/09 15:47:11,391 INFO cluster.ClusterTaskSetManager: Starting task 1.0:211 as TID 211 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,392 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:211 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:11,392 INFO cluster.ClusterTaskSetManager: Finished TID 196 in 783 ms on ip-10-43-129-89.ec2.internal (progress: 195/216) | |
| 13/12/09 15:47:11,393 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 196) | |
| 13/12/09 15:47:11,475 INFO cluster.ClusterTaskSetManager: Starting task 1.0:212 as TID 212 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,476 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:212 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,477 INFO cluster.ClusterTaskSetManager: Finished TID 202 in 489 ms on ip-10-43-129-89.ec2.internal (progress: 196/216) | |
| 13/12/09 15:47:11,477 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 202) | |
| 13/12/09 15:47:11,479 INFO cluster.ClusterTaskSetManager: Finished TID 195 in 890 ms on ip-10-181-0-146.ec2.internal (progress: 197/216) | |
| 13/12/09 15:47:11,479 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 195) | |
| 13/12/09 15:47:11,479 INFO cluster.ClusterTaskSetManager: Starting task 1.0:213 as TID 213 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,480 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:213 as 2083 bytes in 0 ms | |
| 13/12/09 15:47:11,485 INFO cluster.ClusterTaskSetManager: Starting task 1.0:214 as TID 214 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,486 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:214 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:11,486 INFO cluster.ClusterTaskSetManager: Finished TID 201 in 507 ms on ip-10-181-0-146.ec2.internal (progress: 198/216) | |
| 13/12/09 15:47:11,487 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 201) | |
| 13/12/09 15:47:11,500 INFO cluster.ClusterTaskSetManager: Starting task 1.0:215 as TID 215 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:11,501 INFO cluster.ClusterTaskSetManager: Serialized task 1.0:215 as 2083 bytes in 1 ms | |
| 13/12/09 15:47:11,501 INFO cluster.ClusterTaskSetManager: Finished TID 197 in 837 ms on ip-10-181-0-146.ec2.internal (progress: 199/216) | |
| 13/12/09 15:47:11,502 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 197) | |
| 13/12/09 15:47:11,512 INFO cluster.ClusterTaskSetManager: Finished TID 206 in 496 ms on ip-10-181-0-146.ec2.internal (progress: 200/216) | |
| 13/12/09 15:47:11,512 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 206) | |
| 13/12/09 15:47:11,528 INFO cluster.ClusterTaskSetManager: Finished TID 205 in 520 ms on ip-10-43-129-89.ec2.internal (progress: 201/216) | |
| 13/12/09 15:47:11,529 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 205) | |
| 13/12/09 15:47:11,539 INFO cluster.ClusterTaskSetManager: Finished TID 203 in 540 ms on ip-10-43-129-89.ec2.internal (progress: 202/216) | |
| 13/12/09 15:47:11,539 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 203) | |
| 13/12/09 15:47:11,547 INFO cluster.ClusterTaskSetManager: Finished TID 204 in 545 ms on ip-10-181-0-146.ec2.internal (progress: 203/216) | |
| 13/12/09 15:47:11,548 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 204) | |
| 13/12/09 15:47:11,551 INFO cluster.ClusterTaskSetManager: Finished TID 198 in 872 ms on ip-10-181-0-146.ec2.internal (progress: 204/216) | |
| 13/12/09 15:47:11,551 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 198) | |
| 13/12/09 15:47:11,596 INFO cluster.ClusterTaskSetManager: Finished TID 199 in 712 ms on ip-10-43-129-89.ec2.internal (progress: 205/216) | |
| 13/12/09 15:47:11,597 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 199) | |
| 13/12/09 15:47:11,724 INFO cluster.ClusterTaskSetManager: Finished TID 200 in 803 ms on ip-10-181-0-146.ec2.internal (progress: 206/216) | |
| 13/12/09 15:47:11,724 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 200) | |
| 13/12/09 15:47:11,844 INFO cluster.ClusterTaskSetManager: Finished TID 207 in 780 ms on ip-10-43-129-89.ec2.internal (progress: 207/216) | |
| 13/12/09 15:47:11,845 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 207) | |
| 13/12/09 15:47:11,847 INFO cluster.ClusterTaskSetManager: Finished TID 208 in 706 ms on ip-10-43-129-89.ec2.internal (progress: 208/216) | |
| 13/12/09 15:47:11,847 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 208) | |
| 13/12/09 15:47:11,955 INFO cluster.ClusterTaskSetManager: Finished TID 209 in 798 ms on ip-10-181-0-146.ec2.internal (progress: 209/216) | |
| 13/12/09 15:47:11,955 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 209) | |
| 13/12/09 15:47:11,960 INFO cluster.ClusterTaskSetManager: Finished TID 214 in 475 ms on ip-10-181-0-146.ec2.internal (progress: 210/216) | |
| 13/12/09 15:47:11,961 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 214) | |
| 13/12/09 15:47:11,966 INFO cluster.ClusterTaskSetManager: Finished TID 215 in 465 ms on ip-10-181-0-146.ec2.internal (progress: 211/216) | |
| 13/12/09 15:47:11,966 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 215) | |
| 13/12/09 15:47:12,042 INFO cluster.ClusterTaskSetManager: Finished TID 210 in 800 ms on ip-10-43-129-89.ec2.internal (progress: 212/216) | |
| 13/12/09 15:47:12,043 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 210) | |
| 13/12/09 15:47:12,068 INFO cluster.ClusterTaskSetManager: Finished TID 213 in 589 ms on ip-10-181-0-146.ec2.internal (progress: 213/216) | |
| 13/12/09 15:47:12,069 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 213) | |
| 13/12/09 15:47:12,115 INFO cluster.ClusterTaskSetManager: Finished TID 211 in 724 ms on ip-10-43-129-89.ec2.internal (progress: 214/216) | |
| 13/12/09 15:47:12,116 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 211) | |
| 13/12/09 15:47:12,358 INFO cluster.ClusterTaskSetManager: Finished TID 212 in 883 ms on ip-10-43-129-89.ec2.internal (progress: 215/216) | |
| 13/12/09 15:47:12,359 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 212) | |
| 13/12/09 15:47:12,360 INFO cluster.ClusterScheduler: Remove TaskSet 1.0 from pool | |
| 13/12/09 15:47:12,361 INFO scheduler.DAGScheduler: Stage 1 (keyBy at LogAnalyzer.scala:35) finished in 15.608 s | |
| 13/12/09 15:47:12,361 INFO scheduler.DAGScheduler: looking for newly runnable stages | |
| 13/12/09 15:47:12,362 INFO scheduler.DAGScheduler: running: Set() | |
| 13/12/09 15:47:12,363 INFO scheduler.DAGScheduler: waiting: Set(Stage 0) | |
| 13/12/09 15:47:12,364 INFO scheduler.DAGScheduler: failed: Set() | |
| 13/12/09 15:47:12,377 INFO scheduler.DAGScheduler: Missing parents for Stage 0: List() | |
| 13/12/09 15:47:12,381 INFO scheduler.DAGScheduler: Submitting Stage 0 (MapPartitionsRDD[7] at mapPartitionsWithIndex at Vertica.scala:143), which is now runnable | |
| 13/12/09 15:47:12,474 INFO scheduler.DAGScheduler: Submitting 64 missing tasks from Stage 0 (MapPartitionsRDD[7] at mapPartitionsWithIndex at Vertica.scala:143) | |
| 13/12/09 15:47:12,475 INFO cluster.ClusterScheduler: Adding task set 0.0 with 64 tasks | |
| 13/12/09 15:47:12,477 INFO cluster.ClusterTaskSetManager: Starting task 0.0:0 as TID 216 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,477 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:0 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,478 INFO cluster.ClusterTaskSetManager: Starting task 0.0:1 as TID 217 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,478 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:1 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,479 INFO cluster.ClusterTaskSetManager: Starting task 0.0:2 as TID 218 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,479 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:2 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,479 INFO cluster.ClusterTaskSetManager: Starting task 0.0:3 as TID 219 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,480 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:3 as 8080 bytes in 1 ms | |
| 13/12/09 15:47:12,480 INFO cluster.ClusterTaskSetManager: Starting task 0.0:4 as TID 220 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,480 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:4 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,481 INFO cluster.ClusterTaskSetManager: Starting task 0.0:5 as TID 221 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,481 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:5 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,482 INFO cluster.ClusterTaskSetManager: Starting task 0.0:6 as TID 222 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,482 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:6 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,482 INFO cluster.ClusterTaskSetManager: Starting task 0.0:7 as TID 223 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,483 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:7 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,483 INFO cluster.ClusterTaskSetManager: Starting task 0.0:8 as TID 224 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,484 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:8 as 8080 bytes in 1 ms | |
| 13/12/09 15:47:12,484 INFO cluster.ClusterTaskSetManager: Starting task 0.0:9 as TID 225 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,485 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:9 as 8080 bytes in 1 ms | |
| 13/12/09 15:47:12,485 INFO cluster.ClusterTaskSetManager: Starting task 0.0:10 as TID 226 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,485 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:10 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,486 INFO cluster.ClusterTaskSetManager: Starting task 0.0:11 as TID 227 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,486 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:11 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,487 INFO cluster.ClusterTaskSetManager: Starting task 0.0:12 as TID 228 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,487 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:12 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,487 INFO cluster.ClusterTaskSetManager: Starting task 0.0:13 as TID 229 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,488 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:13 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,489 INFO cluster.ClusterTaskSetManager: Starting task 0.0:14 as TID 230 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,489 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:14 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:12,490 INFO cluster.ClusterTaskSetManager: Starting task 0.0:15 as TID 231 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:47:12,490 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:15 as 8080 bytes in 0 ms | |
| 13/12/09 15:47:13,960 INFO spark.MapOutputTrackerMasterActor: Asked to send map output locations for shuffle 0 to ip-10-43-129-89.ec2.internal:59327 | |
| 13/12/09 15:47:13,974 INFO spark.MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 6266 bytes | |
| 13/12/09 15:47:14,181 INFO spark.MapOutputTrackerMasterActor: Asked to send map output locations for shuffle 0 to ip-10-181-0-146.ec2.internal:47339 | |
| 13/12/09 15:48:18,164 INFO cluster.ClusterTaskSetManager: Starting task 0.0:16 as TID 232 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:18,164 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:16 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:18,167 INFO cluster.ClusterTaskSetManager: Finished TID 218 in 65689 ms on ip-10-43-129-89.ec2.internal (progress: 0/64) | |
| 13/12/09 15:48:18,167 INFO scheduler.DAGScheduler: Completed ResultTask(0, 2) | |
| 13/12/09 15:48:19,147 INFO cluster.ClusterTaskSetManager: Starting task 0.0:17 as TID 233 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:19,148 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:17 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:19,149 INFO cluster.ClusterTaskSetManager: Finished TID 230 in 66660 ms on ip-10-43-129-89.ec2.internal (progress: 1/64) | |
| 13/12/09 15:48:19,149 INFO scheduler.DAGScheduler: Completed ResultTask(0, 14) | |
| 13/12/09 15:48:19,367 INFO cluster.ClusterTaskSetManager: Starting task 0.0:18 as TID 234 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:19,368 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:18 as 8080 bytes in 1 ms | |
| 13/12/09 15:48:19,368 INFO cluster.ClusterTaskSetManager: Finished TID 216 in 66891 ms on ip-10-43-129-89.ec2.internal (progress: 2/64) | |
| 13/12/09 15:48:19,368 INFO scheduler.DAGScheduler: Completed ResultTask(0, 0) | |
| 13/12/09 15:48:19,398 INFO cluster.ClusterTaskSetManager: Starting task 0.0:19 as TID 235 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:19,398 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:19 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:19,399 INFO cluster.ClusterTaskSetManager: Finished TID 226 in 66914 ms on ip-10-43-129-89.ec2.internal (progress: 3/64) | |
| 13/12/09 15:48:19,399 INFO scheduler.DAGScheduler: Completed ResultTask(0, 10) | |
| 13/12/09 15:48:19,736 INFO cluster.ClusterTaskSetManager: Starting task 0.0:20 as TID 236 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:19,736 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:20 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:19,737 INFO cluster.ClusterTaskSetManager: Finished TID 228 in 67251 ms on ip-10-43-129-89.ec2.internal (progress: 4/64) | |
| 13/12/09 15:48:19,737 INFO scheduler.DAGScheduler: Completed ResultTask(0, 12) | |
| 13/12/09 15:48:19,847 INFO cluster.ClusterTaskSetManager: Finished TID 220 in 67367 ms on ip-10-43-129-89.ec2.internal (progress: 5/64) | |
| 13/12/09 15:48:19,847 INFO scheduler.DAGScheduler: Completed ResultTask(0, 4) | |
| 13/12/09 15:48:19,847 INFO cluster.ClusterTaskSetManager: Starting task 0.0:21 as TID 237 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:19,848 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:21 as 8080 bytes in 1 ms | |
| 13/12/09 15:48:19,953 INFO cluster.ClusterTaskSetManager: Finished TID 224 in 67470 ms on ip-10-43-129-89.ec2.internal (progress: 6/64) | |
| 13/12/09 15:48:19,953 INFO scheduler.DAGScheduler: Completed ResultTask(0, 8) | |
| 13/12/09 15:48:19,954 INFO cluster.ClusterTaskSetManager: Starting task 0.0:22 as TID 238 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:19,954 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:22 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:20,213 INFO cluster.ClusterTaskSetManager: Starting task 0.0:23 as TID 239 on executor 0: ip-10-43-129-89.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:20,213 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:23 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:20,214 INFO cluster.ClusterTaskSetManager: Finished TID 222 in 67733 ms on ip-10-43-129-89.ec2.internal (progress: 7/64) | |
| 13/12/09 15:48:20,214 INFO scheduler.DAGScheduler: Completed ResultTask(0, 6) | |
| 13/12/09 15:48:21,141 INFO cluster.ClusterTaskSetManager: Starting task 0.0:24 as TID 240 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:21,142 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:24 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:21,142 INFO cluster.ClusterTaskSetManager: Finished TID 227 in 68656 ms on ip-10-181-0-146.ec2.internal (progress: 8/64) | |
| 13/12/09 15:48:21,142 INFO scheduler.DAGScheduler: Completed ResultTask(0, 11) | |
| 13/12/09 15:48:21,380 INFO cluster.ClusterTaskSetManager: Starting task 0.0:25 as TID 241 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:21,380 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:25 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:21,381 INFO cluster.ClusterTaskSetManager: Finished TID 217 in 68902 ms on ip-10-181-0-146.ec2.internal (progress: 9/64) | |
| 13/12/09 15:48:21,381 INFO scheduler.DAGScheduler: Completed ResultTask(0, 1) | |
| 13/12/09 15:48:22,127 INFO cluster.ClusterTaskSetManager: Starting task 0.0:26 as TID 242 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:22,128 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:26 as 8080 bytes in 1 ms | |
| 13/12/09 15:48:22,128 INFO cluster.ClusterTaskSetManager: Finished TID 225 in 69644 ms on ip-10-181-0-146.ec2.internal (progress: 10/64) | |
| 13/12/09 15:48:22,128 INFO scheduler.DAGScheduler: Completed ResultTask(0, 9) | |
| 13/12/09 15:48:22,705 INFO cluster.ClusterTaskSetManager: Starting task 0.0:27 as TID 243 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:22,706 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:27 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:22,706 INFO cluster.ClusterTaskSetManager: Finished TID 231 in 70216 ms on ip-10-181-0-146.ec2.internal (progress: 11/64) | |
| 13/12/09 15:48:22,707 INFO scheduler.DAGScheduler: Completed ResultTask(0, 15) | |
| 13/12/09 15:48:22,798 INFO cluster.ClusterTaskSetManager: Starting task 0.0:28 as TID 244 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:22,798 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:28 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:22,799 INFO cluster.ClusterTaskSetManager: Finished TID 229 in 70312 ms on ip-10-181-0-146.ec2.internal (progress: 12/64) | |
| 13/12/09 15:48:22,799 INFO scheduler.DAGScheduler: Completed ResultTask(0, 13) | |
| 13/12/09 15:48:22,920 INFO cluster.ClusterTaskSetManager: Starting task 0.0:29 as TID 245 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:22,920 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:29 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:22,921 INFO cluster.ClusterTaskSetManager: Finished TID 219 in 70442 ms on ip-10-181-0-146.ec2.internal (progress: 13/64) | |
| 13/12/09 15:48:22,921 INFO scheduler.DAGScheduler: Completed ResultTask(0, 3) | |
| 13/12/09 15:48:23,040 INFO cluster.ClusterTaskSetManager: Starting task 0.0:30 as TID 246 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:23,040 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:30 as 8080 bytes in 0 ms | |
| 13/12/09 15:48:23,041 INFO cluster.ClusterTaskSetManager: Finished TID 221 in 70560 ms on ip-10-181-0-146.ec2.internal (progress: 14/64) | |
| 13/12/09 15:48:23,041 INFO scheduler.DAGScheduler: Completed ResultTask(0, 5) | |
| 13/12/09 15:48:23,438 INFO cluster.ClusterTaskSetManager: Starting task 0.0:31 as TID 247 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:48:23,439 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:31 as 8080 bytes in 1 ms | |
| 13/12/09 15:48:23,439 INFO cluster.ClusterTaskSetManager: Finished TID 223 in 70957 ms on ip-10-181-0-146.ec2.internal (progress: 15/64) | |
| 13/12/09 15:48:23,440 INFO scheduler.DAGScheduler: Completed ResultTask(0, 7) | |
| 13/12/09 15:48:44,903 INFO client.Client$ClientActor: Executor updated: app-20131209154538-0001/0 is now LOST (worker lost) | |
| 13/12/09 15:48:44,904 INFO cluster.SparkDeploySchedulerBackend: Executor app-20131209154538-0001/0 removed: worker lost | |
| 13/12/09 15:48:44,906 INFO cluster.SparkDeploySchedulerBackend: Executor 0 disconnected, so removing it | |
| 13/12/09 15:48:44,908 INFO cluster.ClusterTaskSetManager: Re-queueing tasks for 0 from TaskSet 0.0 | |
| 13/12/09 15:48:44,915 INFO scheduler.DAGScheduler: Executor lost: 0 (epoch 1) | |
| 13/12/09 15:48:44,916 INFO storage.BlockManagerMasterActor: Trying to remove executor 0 from BlockManagerMaster. | |
| 13/12/09 15:48:44,917 INFO storage.BlockManagerMaster: Removed 0 successfully in removeExecutor | |
| 13/12/09 15:48:44,928 INFO scheduler.Stage: Stage 1 is now unavailable on executor 0 (108/216, false) | |
| 13/12/09 15:49:25,092 INFO cluster.ClusterTaskSetManager: Starting task 0.0:20 as TID 248 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:25,092 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:20 as 8080 bytes in 0 ms | |
| 13/12/09 15:49:25,093 INFO cluster.ClusterTaskSetManager: Finished TID 241 in 63713 ms on ip-10-181-0-146.ec2.internal (progress: 16/64) | |
| 13/12/09 15:49:25,093 INFO scheduler.DAGScheduler: Completed ResultTask(0, 25) | |
| 13/12/09 15:49:25,190 INFO cluster.ClusterTaskSetManager: Starting task 0.0:17 as TID 249 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:25,191 INFO cluster.ClusterTaskSetManager: Serialized task 0.0:17 as 8080 bytes in 1 ms | |
| 13/12/09 15:49:25,193 INFO cluster.ClusterScheduler: Remove TaskSet 0.0 from pool | |
| 13/12/09 15:49:25,194 INFO scheduler.DAGScheduler: Marking Stage 0 (foreach at Vertica.scala:143) for resubmision due to a fetch failure | |
| 13/12/09 15:49:25,197 INFO scheduler.DAGScheduler: The failed fetch was from Stage 1 (keyBy at LogAnalyzer.scala:35); marking it for resubmission | |
| 13/12/09 15:49:25,197 INFO cluster.ClusterScheduler: Ignoring update from TID 249 because its task set is gone | |
| 13/12/09 15:49:25,277 INFO scheduler.DAGScheduler: Resubmitting failed stages | |
| 13/12/09 15:49:25,282 INFO cluster.ClusterScheduler: Ignoring update from TID 249 because its task set is gone | |
| 13/12/09 15:49:25,304 INFO scheduler.DAGScheduler: Submitting Stage 1 (MappedRDD[2] at keyBy at LogAnalyzer.scala:35), which has no missing parents | |
| 13/12/09 15:49:25,312 INFO scheduler.DAGScheduler: Submitting 108 missing tasks from Stage 1 (MappedRDD[2] at keyBy at LogAnalyzer.scala:35) | |
| 13/12/09 15:49:25,312 INFO cluster.ClusterScheduler: Adding task set 1.1 with 108 tasks | |
| 13/12/09 15:49:25,313 INFO cluster.ClusterTaskSetManager: Starting task 1.1:0 as TID 250 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:25,314 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:0 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:25,384 INFO cluster.ClusterScheduler: Ignoring update from TID 240 because its task set is gone | |
| 13/12/09 15:49:25,384 INFO cluster.ClusterTaskSetManager: Starting task 1.1:1 as TID 251 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:25,384 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:1 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:25,939 INFO cluster.ClusterTaskSetManager: Starting task 1.1:2 as TID 252 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:25,940 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:2 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:25,940 INFO cluster.ClusterTaskSetManager: Finished TID 250 in 627 ms on ip-10-181-0-146.ec2.internal (progress: 0/108) | |
| 13/12/09 15:49:25,941 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 0) | |
| 13/12/09 15:49:26,029 INFO cluster.ClusterTaskSetManager: Starting task 1.1:3 as TID 253 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:26,030 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:3 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:26,030 INFO cluster.ClusterTaskSetManager: Finished TID 251 in 646 ms on ip-10-181-0-146.ec2.internal (progress: 1/108) | |
| 13/12/09 15:49:26,031 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 2) | |
| 13/12/09 15:49:26,854 INFO cluster.ClusterTaskSetManager: Starting task 1.1:4 as TID 254 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:26,854 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:4 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:26,855 INFO cluster.ClusterTaskSetManager: Finished TID 252 in 916 ms on ip-10-181-0-146.ec2.internal (progress: 2/108) | |
| 13/12/09 15:49:26,855 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 4) | |
| 13/12/09 15:49:26,927 INFO cluster.ClusterTaskSetManager: Starting task 1.1:5 as TID 255 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:26,928 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:5 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:26,928 INFO cluster.ClusterTaskSetManager: Finished TID 253 in 899 ms on ip-10-181-0-146.ec2.internal (progress: 3/108) | |
| 13/12/09 15:49:26,929 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 6) | |
| 13/12/09 15:49:27,300 INFO cluster.ClusterScheduler: Ignoring update from TID 243 because its task set is gone | |
| 13/12/09 15:49:27,300 INFO cluster.ClusterTaskSetManager: Starting task 1.1:6 as TID 256 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,301 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:6 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:27,474 INFO cluster.ClusterTaskSetManager: Starting task 1.1:7 as TID 257 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,475 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:7 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:27,475 INFO cluster.ClusterTaskSetManager: Finished TID 255 in 548 ms on ip-10-181-0-146.ec2.internal (progress: 4/108) | |
| 13/12/09 15:49:27,476 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 10) | |
| 13/12/09 15:49:27,633 INFO cluster.ClusterTaskSetManager: Starting task 1.1:8 as TID 258 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,634 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:8 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:27,634 INFO cluster.ClusterTaskSetManager: Finished TID 254 in 781 ms on ip-10-181-0-146.ec2.internal (progress: 5/108) | |
| 13/12/09 15:49:27,635 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 8) | |
| 13/12/09 15:49:27,778 INFO cluster.ClusterScheduler: Ignoring update from TID 242 because its task set is gone | |
| 13/12/09 15:49:27,778 INFO cluster.ClusterTaskSetManager: Starting task 1.1:9 as TID 259 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,779 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:9 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:27,822 INFO cluster.ClusterScheduler: Ignoring update from TID 246 because its task set is gone | |
| 13/12/09 15:49:27,823 INFO cluster.ClusterTaskSetManager: Starting task 1.1:10 as TID 260 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,823 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:10 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:27,837 INFO cluster.ClusterTaskSetManager: Finished TID 256 in 537 ms on ip-10-181-0-146.ec2.internal (progress: 6/108) | |
| 13/12/09 15:49:27,837 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 12) | |
| 13/12/09 15:49:27,838 INFO cluster.ClusterTaskSetManager: Starting task 1.1:11 as TID 261 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,838 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:11 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:27,852 INFO cluster.ClusterScheduler: Ignoring update from TID 244 because its task set is gone | |
| 13/12/09 15:49:27,853 INFO cluster.ClusterTaskSetManager: Starting task 1.1:12 as TID 262 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,853 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:12 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:27,933 INFO cluster.ClusterScheduler: Ignoring update from TID 245 because its task set is gone | |
| 13/12/09 15:49:27,933 INFO cluster.ClusterTaskSetManager: Starting task 1.1:13 as TID 263 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:27,934 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:13 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,078 INFO cluster.ClusterTaskSetManager: Starting task 1.1:14 as TID 264 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,079 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:14 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:28,080 INFO cluster.ClusterTaskSetManager: Finished TID 257 in 605 ms on ip-10-181-0-146.ec2.internal (progress: 7/108) | |
| 13/12/09 15:49:28,080 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 14) | |
| 13/12/09 15:49:28,548 INFO cluster.ClusterTaskSetManager: Starting task 1.1:15 as TID 265 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,548 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:15 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,549 INFO cluster.ClusterTaskSetManager: Finished TID 258 in 916 ms on ip-10-181-0-146.ec2.internal (progress: 8/108) | |
| 13/12/09 15:49:28,549 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 16) | |
| 13/12/09 15:49:28,619 INFO cluster.ClusterTaskSetManager: Starting task 1.1:16 as TID 266 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,619 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:16 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,620 INFO cluster.ClusterTaskSetManager: Finished TID 264 in 542 ms on ip-10-181-0-146.ec2.internal (progress: 9/108) | |
| 13/12/09 15:49:28,620 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 26) | |
| 13/12/09 15:49:28,708 INFO cluster.ClusterTaskSetManager: Starting task 1.1:17 as TID 267 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,708 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:17 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,709 INFO cluster.ClusterTaskSetManager: Finished TID 262 in 857 ms on ip-10-181-0-146.ec2.internal (progress: 10/108) | |
| 13/12/09 15:49:28,709 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 20) | |
| 13/12/09 15:49:28,753 INFO cluster.ClusterTaskSetManager: Starting task 1.1:18 as TID 268 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,753 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:18 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,754 INFO cluster.ClusterTaskSetManager: Finished TID 263 in 821 ms on ip-10-181-0-146.ec2.internal (progress: 11/108) | |
| 13/12/09 15:49:28,754 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 25) | |
| 13/12/09 15:49:28,805 INFO cluster.ClusterTaskSetManager: Starting task 1.1:19 as TID 269 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,806 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:19 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:28,806 INFO cluster.ClusterTaskSetManager: Finished TID 260 in 983 ms on ip-10-181-0-146.ec2.internal (progress: 12/108) | |
| 13/12/09 15:49:28,806 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 18) | |
| 13/12/09 15:49:28,832 INFO cluster.ClusterTaskSetManager: Starting task 1.1:20 as TID 270 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,832 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:20 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,833 INFO cluster.ClusterTaskSetManager: Finished TID 261 in 996 ms on ip-10-181-0-146.ec2.internal (progress: 13/108) | |
| 13/12/09 15:49:28,833 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 19) | |
| 13/12/09 15:49:28,907 INFO cluster.ClusterScheduler: Ignoring update from TID 247 because its task set is gone | |
| 13/12/09 15:49:28,908 INFO cluster.ClusterTaskSetManager: Starting task 1.1:21 as TID 271 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,908 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:21 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,956 INFO cluster.ClusterTaskSetManager: Starting task 1.1:22 as TID 272 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:28,956 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:22 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:28,957 INFO cluster.ClusterTaskSetManager: Finished TID 259 in 1179 ms on ip-10-181-0-146.ec2.internal (progress: 14/108) | |
| 13/12/09 15:49:28,957 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 17) | |
| 13/12/09 15:49:29,288 INFO cluster.ClusterTaskSetManager: Starting task 1.1:23 as TID 273 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:29,288 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:23 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:29,289 INFO cluster.ClusterTaskSetManager: Finished TID 266 in 670 ms on ip-10-181-0-146.ec2.internal (progress: 15/108) | |
| 13/12/09 15:49:29,289 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 36) | |
| 13/12/09 15:49:29,294 INFO cluster.ClusterTaskSetManager: Starting task 1.1:24 as TID 274 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:29,295 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:24 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:29,295 INFO cluster.ClusterTaskSetManager: Finished TID 267 in 587 ms on ip-10-181-0-146.ec2.internal (progress: 16/108) | |
| 13/12/09 15:49:29,295 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 37) | |
| 13/12/09 15:49:29,445 INFO cluster.ClusterTaskSetManager: Finished TID 268 in 691 ms on ip-10-181-0-146.ec2.internal (progress: 17/108) | |
| 13/12/09 15:49:29,445 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 38) | |
| 13/12/09 15:49:29,445 INFO cluster.ClusterTaskSetManager: Starting task 1.1:25 as TID 275 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:29,445 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:25 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:29,607 INFO cluster.ClusterTaskSetManager: Finished TID 265 in 1059 ms on ip-10-181-0-146.ec2.internal (progress: 18/108) | |
| 13/12/09 15:49:29,608 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 27) | |
| 13/12/09 15:49:29,608 INFO cluster.ClusterTaskSetManager: Starting task 1.1:26 as TID 276 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:29,608 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:26 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:29,923 INFO cluster.ClusterTaskSetManager: Starting task 1.1:27 as TID 277 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:29,923 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:27 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:29,924 INFO cluster.ClusterTaskSetManager: Finished TID 274 in 630 ms on ip-10-181-0-146.ec2.internal (progress: 19/108) | |
| 13/12/09 15:49:29,924 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 49) | |
| 13/12/09 15:49:29,961 INFO cluster.ClusterTaskSetManager: Starting task 1.1:28 as TID 278 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:29,961 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:28 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:29,961 INFO cluster.ClusterTaskSetManager: Finished TID 269 in 1156 ms on ip-10-181-0-146.ec2.internal (progress: 20/108) | |
| 13/12/09 15:49:29,962 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 39) | |
| 13/12/09 15:49:29,967 INFO cluster.ClusterTaskSetManager: Finished TID 273 in 679 ms on ip-10-181-0-146.ec2.internal (progress: 21/108) | |
| 13/12/09 15:49:29,967 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 45) | |
| 13/12/09 15:49:29,967 INFO cluster.ClusterTaskSetManager: Starting task 1.1:29 as TID 279 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:29,968 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:29 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:30,002 INFO cluster.ClusterTaskSetManager: Finished TID 270 in 1170 ms on ip-10-181-0-146.ec2.internal (progress: 22/108) | |
| 13/12/09 15:49:30,003 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 40) | |
| 13/12/09 15:49:30,003 INFO cluster.ClusterTaskSetManager: Starting task 1.1:30 as TID 280 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,003 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:30 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:30,053 INFO cluster.ClusterTaskSetManager: Starting task 1.1:31 as TID 281 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,054 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:31 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:30,054 INFO cluster.ClusterTaskSetManager: Finished TID 272 in 1098 ms on ip-10-181-0-146.ec2.internal (progress: 23/108) | |
| 13/12/09 15:49:30,055 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 42) | |
| 13/12/09 15:49:30,058 INFO cluster.ClusterTaskSetManager: Starting task 1.1:32 as TID 282 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,058 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:32 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:30,059 INFO cluster.ClusterTaskSetManager: Finished TID 271 in 1151 ms on ip-10-181-0-146.ec2.internal (progress: 24/108) | |
| 13/12/09 15:49:30,059 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 41) | |
| 13/12/09 15:49:30,476 INFO cluster.ClusterTaskSetManager: Starting task 1.1:33 as TID 283 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,477 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:33 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:30,477 INFO cluster.ClusterTaskSetManager: Finished TID 275 in 1032 ms on ip-10-181-0-146.ec2.internal (progress: 25/108) | |
| 13/12/09 15:49:30,478 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 51) | |
| 13/12/09 15:49:30,559 INFO cluster.ClusterTaskSetManager: Starting task 1.1:34 as TID 284 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,560 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:34 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:30,560 INFO cluster.ClusterTaskSetManager: Finished TID 278 in 600 ms on ip-10-181-0-146.ec2.internal (progress: 26/108) | |
| 13/12/09 15:49:30,561 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 59) | |
| 13/12/09 15:49:30,586 INFO cluster.ClusterTaskSetManager: Starting task 1.1:35 as TID 285 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,587 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:35 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:30,587 INFO cluster.ClusterTaskSetManager: Finished TID 279 in 620 ms on ip-10-181-0-146.ec2.internal (progress: 27/108) | |
| 13/12/09 15:49:30,587 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 60) | |
| 13/12/09 15:49:30,617 INFO cluster.ClusterTaskSetManager: Starting task 1.1:36 as TID 286 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,617 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:36 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:30,618 INFO cluster.ClusterTaskSetManager: Finished TID 280 in 615 ms on ip-10-181-0-146.ec2.internal (progress: 28/108) | |
| 13/12/09 15:49:30,618 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 61) | |
| 13/12/09 15:49:30,707 INFO cluster.ClusterTaskSetManager: Starting task 1.1:37 as TID 287 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,707 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:37 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:30,708 INFO cluster.ClusterTaskSetManager: Finished TID 276 in 1100 ms on ip-10-181-0-146.ec2.internal (progress: 29/108) | |
| 13/12/09 15:49:30,708 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 54) | |
| 13/12/09 15:49:30,948 INFO cluster.ClusterTaskSetManager: Starting task 1.1:38 as TID 288 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:30,948 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:38 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:30,949 INFO cluster.ClusterTaskSetManager: Finished TID 277 in 1026 ms on ip-10-181-0-146.ec2.internal (progress: 30/108) | |
| 13/12/09 15:49:30,949 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 55) | |
| 13/12/09 15:49:31,025 INFO cluster.ClusterTaskSetManager: Starting task 1.1:39 as TID 289 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,026 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:39 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:31,026 INFO cluster.ClusterTaskSetManager: Finished TID 281 in 973 ms on ip-10-181-0-146.ec2.internal (progress: 31/108) | |
| 13/12/09 15:49:31,027 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 63) | |
| 13/12/09 15:49:31,077 INFO cluster.ClusterTaskSetManager: Starting task 1.1:40 as TID 290 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,078 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:40 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:31,078 INFO cluster.ClusterTaskSetManager: Finished TID 282 in 1020 ms on ip-10-181-0-146.ec2.internal (progress: 32/108) | |
| 13/12/09 15:49:31,078 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 64) | |
| 13/12/09 15:49:31,178 INFO cluster.ClusterTaskSetManager: Starting task 1.1:41 as TID 291 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,179 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:41 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:31,179 INFO cluster.ClusterTaskSetManager: Finished TID 284 in 620 ms on ip-10-181-0-146.ec2.internal (progress: 33/108) | |
| 13/12/09 15:49:31,179 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 70) | |
| 13/12/09 15:49:31,182 INFO cluster.ClusterTaskSetManager: Starting task 1.1:42 as TID 292 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,182 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:42 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:31,183 INFO cluster.ClusterTaskSetManager: Finished TID 286 in 565 ms on ip-10-181-0-146.ec2.internal (progress: 34/108) | |
| 13/12/09 15:49:31,183 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 74) | |
| 13/12/09 15:49:31,205 INFO cluster.ClusterTaskSetManager: Starting task 1.1:43 as TID 293 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,205 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:43 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:31,206 INFO cluster.ClusterTaskSetManager: Finished TID 285 in 620 ms on ip-10-181-0-146.ec2.internal (progress: 35/108) | |
| 13/12/09 15:49:31,206 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 71) | |
| 13/12/09 15:49:31,619 INFO cluster.ClusterTaskSetManager: Starting task 1.1:44 as TID 294 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,619 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:44 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:31,620 INFO cluster.ClusterTaskSetManager: Finished TID 283 in 1144 ms on ip-10-181-0-146.ec2.internal (progress: 36/108) | |
| 13/12/09 15:49:31,620 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 67) | |
| 13/12/09 15:49:31,765 INFO cluster.ClusterTaskSetManager: Starting task 1.1:45 as TID 295 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,765 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:45 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:31,766 INFO cluster.ClusterTaskSetManager: Finished TID 292 in 584 ms on ip-10-181-0-146.ec2.internal (progress: 37/108) | |
| 13/12/09 15:49:31,766 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 84) | |
| 13/12/09 15:49:31,777 INFO cluster.ClusterTaskSetManager: Starting task 1.1:46 as TID 296 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,777 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:46 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:31,778 INFO cluster.ClusterTaskSetManager: Finished TID 291 in 600 ms on ip-10-181-0-146.ec2.internal (progress: 38/108) | |
| 13/12/09 15:49:31,778 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 83) | |
| 13/12/09 15:49:31,785 INFO cluster.ClusterTaskSetManager: Finished TID 287 in 1078 ms on ip-10-181-0-146.ec2.internal (progress: 39/108) | |
| 13/12/09 15:49:31,785 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 76) | |
| 13/12/09 15:49:31,785 INFO cluster.ClusterTaskSetManager: Starting task 1.1:47 as TID 297 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:31,786 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:47 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,015 INFO cluster.ClusterTaskSetManager: Starting task 1.1:48 as TID 298 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,015 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:48 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,015 INFO cluster.ClusterTaskSetManager: Finished TID 288 in 1068 ms on ip-10-181-0-146.ec2.internal (progress: 40/108) | |
| 13/12/09 15:49:32,016 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 77) | |
| 13/12/09 15:49:32,029 INFO cluster.ClusterTaskSetManager: Finished TID 289 in 1004 ms on ip-10-181-0-146.ec2.internal (progress: 41/108) | |
| 13/12/09 15:49:32,030 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 79) | |
| 13/12/09 15:49:32,030 INFO cluster.ClusterTaskSetManager: Starting task 1.1:49 as TID 299 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,030 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:49 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,099 INFO cluster.ClusterTaskSetManager: Starting task 1.1:50 as TID 300 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,099 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:50 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,100 INFO cluster.ClusterTaskSetManager: Finished TID 290 in 1023 ms on ip-10-181-0-146.ec2.internal (progress: 42/108) | |
| 13/12/09 15:49:32,101 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 80) | |
| 13/12/09 15:49:32,232 INFO cluster.ClusterTaskSetManager: Starting task 1.1:51 as TID 301 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,232 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:51 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,232 INFO cluster.ClusterTaskSetManager: Finished TID 293 in 1027 ms on ip-10-181-0-146.ec2.internal (progress: 43/108) | |
| 13/12/09 15:49:32,233 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 87) | |
| 13/12/09 15:49:32,367 INFO cluster.ClusterTaskSetManager: Starting task 1.1:52 as TID 302 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,368 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:52 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,369 INFO cluster.ClusterTaskSetManager: Finished TID 296 in 591 ms on ip-10-181-0-146.ec2.internal (progress: 44/108) | |
| 13/12/09 15:49:32,369 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 96) | |
| 13/12/09 15:49:32,460 INFO cluster.ClusterTaskSetManager: Starting task 1.1:53 as TID 303 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,460 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:53 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,460 INFO cluster.ClusterTaskSetManager: Finished TID 295 in 695 ms on ip-10-181-0-146.ec2.internal (progress: 45/108) | |
| 13/12/09 15:49:32,461 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 94) | |
| 13/12/09 15:49:32,564 INFO cluster.ClusterTaskSetManager: Starting task 1.1:54 as TID 304 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,564 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:54 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,565 INFO cluster.ClusterTaskSetManager: Finished TID 297 in 780 ms on ip-10-181-0-146.ec2.internal (progress: 46/108) | |
| 13/12/09 15:49:32,565 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 97) | |
| 13/12/09 15:49:32,607 INFO cluster.ClusterTaskSetManager: Starting task 1.1:55 as TID 305 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,608 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:55 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,608 INFO cluster.ClusterTaskSetManager: Finished TID 298 in 594 ms on ip-10-181-0-146.ec2.internal (progress: 47/108) | |
| 13/12/09 15:49:32,609 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 98) | |
| 13/12/09 15:49:32,676 INFO cluster.ClusterTaskSetManager: Starting task 1.1:56 as TID 306 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,677 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:56 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:32,677 INFO cluster.ClusterTaskSetManager: Finished TID 294 in 1058 ms on ip-10-181-0-146.ec2.internal (progress: 48/108) | |
| 13/12/09 15:49:32,678 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 89) | |
| 13/12/09 15:49:32,945 INFO cluster.ClusterTaskSetManager: Starting task 1.1:57 as TID 307 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:32,946 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:57 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:32,946 INFO cluster.ClusterTaskSetManager: Finished TID 299 in 916 ms on ip-10-181-0-146.ec2.internal (progress: 49/108) | |
| 13/12/09 15:49:32,947 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 100) | |
| 13/12/09 15:49:33,032 INFO cluster.ClusterTaskSetManager: Starting task 1.1:58 as TID 308 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,033 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:58 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:33,033 INFO cluster.ClusterTaskSetManager: Finished TID 303 in 573 ms on ip-10-181-0-146.ec2.internal (progress: 50/108) | |
| 13/12/09 15:49:33,033 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 105) | |
| 13/12/09 15:49:33,081 INFO cluster.ClusterTaskSetManager: Starting task 1.1:59 as TID 309 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,082 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:59 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:33,082 INFO cluster.ClusterTaskSetManager: Finished TID 300 in 983 ms on ip-10-181-0-146.ec2.internal (progress: 51/108) | |
| 13/12/09 15:49:33,082 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 102) | |
| 13/12/09 15:49:33,124 INFO cluster.ClusterTaskSetManager: Starting task 1.1:60 as TID 310 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,124 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:60 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:33,125 INFO cluster.ClusterTaskSetManager: Finished TID 304 in 561 ms on ip-10-181-0-146.ec2.internal (progress: 52/108) | |
| 13/12/09 15:49:33,125 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 109) | |
| 13/12/09 15:49:33,204 INFO cluster.ClusterTaskSetManager: Starting task 1.1:61 as TID 311 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,204 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:61 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:33,205 INFO cluster.ClusterTaskSetManager: Finished TID 301 in 973 ms on ip-10-181-0-146.ec2.internal (progress: 53/108) | |
| 13/12/09 15:49:33,205 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 103) | |
| 13/12/09 15:49:33,281 INFO cluster.ClusterTaskSetManager: Starting task 1.1:62 as TID 312 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,281 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:62 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:33,282 INFO cluster.ClusterTaskSetManager: Finished TID 305 in 675 ms on ip-10-181-0-146.ec2.internal (progress: 54/108) | |
| 13/12/09 15:49:33,282 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 110) | |
| 13/12/09 15:49:33,342 INFO cluster.ClusterTaskSetManager: Starting task 1.1:63 as TID 313 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,343 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:63 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:33,343 INFO cluster.ClusterTaskSetManager: Finished TID 302 in 976 ms on ip-10-181-0-146.ec2.internal (progress: 55/108) | |
| 13/12/09 15:49:33,343 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 104) | |
| 13/12/09 15:49:33,514 INFO cluster.ClusterTaskSetManager: Starting task 1.1:64 as TID 314 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,515 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:64 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:33,515 INFO cluster.ClusterTaskSetManager: Finished TID 306 in 839 ms on ip-10-181-0-146.ec2.internal (progress: 56/108) | |
| 13/12/09 15:49:33,516 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 111) | |
| 13/12/09 15:49:33,530 INFO cluster.ClusterTaskSetManager: Starting task 1.1:65 as TID 315 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,531 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:65 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:33,531 INFO cluster.ClusterTaskSetManager: Finished TID 308 in 499 ms on ip-10-181-0-146.ec2.internal (progress: 57/108) | |
| 13/12/09 15:49:33,531 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 117) | |
| 13/12/09 15:49:33,693 INFO cluster.ClusterTaskSetManager: Starting task 1.1:66 as TID 316 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,693 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:66 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:33,693 INFO cluster.ClusterTaskSetManager: Finished TID 309 in 612 ms on ip-10-181-0-146.ec2.internal (progress: 58/108) | |
| 13/12/09 15:49:33,694 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 120) | |
| 13/12/09 15:49:33,878 INFO cluster.ClusterTaskSetManager: Starting task 1.1:67 as TID 317 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:33,878 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:67 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:33,878 INFO cluster.ClusterTaskSetManager: Finished TID 307 in 933 ms on ip-10-181-0-146.ec2.internal (progress: 59/108) | |
| 13/12/09 15:49:33,878 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 116) | |
| 13/12/09 15:49:34,032 INFO cluster.ClusterTaskSetManager: Starting task 1.1:68 as TID 318 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,032 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:68 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:34,033 INFO cluster.ClusterTaskSetManager: Finished TID 315 in 503 ms on ip-10-181-0-146.ec2.internal (progress: 60/108) | |
| 13/12/09 15:49:34,033 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 132) | |
| 13/12/09 15:49:34,067 INFO cluster.ClusterTaskSetManager: Starting task 1.1:69 as TID 319 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,068 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:69 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:34,068 INFO cluster.ClusterTaskSetManager: Finished TID 314 in 554 ms on ip-10-181-0-146.ec2.internal (progress: 61/108) | |
| 13/12/09 15:49:34,069 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 131) | |
| 13/12/09 15:49:34,175 INFO cluster.ClusterTaskSetManager: Starting task 1.1:70 as TID 320 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,175 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:70 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:34,175 INFO cluster.ClusterTaskSetManager: Finished TID 312 in 894 ms on ip-10-181-0-146.ec2.internal (progress: 62/108) | |
| 13/12/09 15:49:34,176 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 125) | |
| 13/12/09 15:49:34,200 INFO cluster.ClusterTaskSetManager: Starting task 1.1:71 as TID 321 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,201 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:71 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:34,201 INFO cluster.ClusterTaskSetManager: Finished TID 316 in 508 ms on ip-10-181-0-146.ec2.internal (progress: 63/108) | |
| 13/12/09 15:49:34,201 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 133) | |
| 13/12/09 15:49:34,214 INFO cluster.ClusterTaskSetManager: Starting task 1.1:72 as TID 322 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,215 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:72 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:34,215 INFO cluster.ClusterTaskSetManager: Finished TID 313 in 873 ms on ip-10-181-0-146.ec2.internal (progress: 64/108) | |
| 13/12/09 15:49:34,216 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 128) | |
| 13/12/09 15:49:34,228 INFO cluster.ClusterTaskSetManager: Starting task 1.1:73 as TID 323 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,228 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:73 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:34,229 INFO cluster.ClusterTaskSetManager: Finished TID 311 in 1025 ms on ip-10-181-0-146.ec2.internal (progress: 65/108) | |
| 13/12/09 15:49:34,229 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 123) | |
| 13/12/09 15:49:34,450 INFO cluster.ClusterTaskSetManager: Starting task 1.1:74 as TID 324 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,451 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:74 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:34,451 INFO cluster.ClusterTaskSetManager: Finished TID 310 in 1327 ms on ip-10-181-0-146.ec2.internal (progress: 66/108) | |
| 13/12/09 15:49:34,451 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 122) | |
| 13/12/09 15:49:34,814 INFO cluster.ClusterTaskSetManager: Starting task 1.1:75 as TID 325 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,815 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:75 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:34,815 INFO cluster.ClusterTaskSetManager: Finished TID 322 in 601 ms on ip-10-181-0-146.ec2.internal (progress: 67/108) | |
| 13/12/09 15:49:34,815 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 145) | |
| 13/12/09 15:49:34,823 INFO cluster.ClusterTaskSetManager: Starting task 1.1:76 as TID 326 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,824 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:76 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:34,824 INFO cluster.ClusterTaskSetManager: Finished TID 317 in 947 ms on ip-10-181-0-146.ec2.internal (progress: 68/108) | |
| 13/12/09 15:49:34,824 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 136) | |
| 13/12/09 15:49:34,839 INFO cluster.ClusterTaskSetManager: Starting task 1.1:77 as TID 327 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:34,840 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:77 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:34,840 INFO cluster.ClusterTaskSetManager: Finished TID 321 in 640 ms on ip-10-181-0-146.ec2.internal (progress: 69/108) | |
| 13/12/09 15:49:34,840 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 142) | |
| 13/12/09 15:49:35,101 INFO cluster.ClusterTaskSetManager: Starting task 1.1:78 as TID 328 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,101 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:78 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,102 INFO cluster.ClusterTaskSetManager: Finished TID 319 in 1035 ms on ip-10-181-0-146.ec2.internal (progress: 70/108) | |
| 13/12/09 15:49:35,102 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 139) | |
| 13/12/09 15:49:35,109 INFO cluster.ClusterTaskSetManager: Finished TID 320 in 935 ms on ip-10-181-0-146.ec2.internal (progress: 71/108) | |
| 13/12/09 15:49:35,109 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 140) | |
| 13/12/09 15:49:35,109 INFO cluster.ClusterTaskSetManager: Starting task 1.1:79 as TID 329 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,110 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:79 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,112 INFO cluster.ClusterTaskSetManager: Starting task 1.1:80 as TID 330 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,112 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:80 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,113 INFO cluster.ClusterTaskSetManager: Finished TID 318 in 1081 ms on ip-10-181-0-146.ec2.internal (progress: 72/108) | |
| 13/12/09 15:49:35,114 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 138) | |
| 13/12/09 15:49:35,256 INFO cluster.ClusterTaskSetManager: Starting task 1.1:81 as TID 331 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,256 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:81 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,257 INFO cluster.ClusterTaskSetManager: Finished TID 323 in 1028 ms on ip-10-181-0-146.ec2.internal (progress: 73/108) | |
| 13/12/09 15:49:35,257 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 147) | |
| 13/12/09 15:49:35,325 INFO cluster.ClusterTaskSetManager: Starting task 1.1:82 as TID 332 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,325 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:82 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,325 INFO cluster.ClusterTaskSetManager: Finished TID 327 in 486 ms on ip-10-181-0-146.ec2.internal (progress: 74/108) | |
| 13/12/09 15:49:35,326 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 156) | |
| 13/12/09 15:49:35,413 INFO cluster.ClusterTaskSetManager: Starting task 1.1:83 as TID 333 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,414 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:83 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,415 INFO cluster.ClusterTaskSetManager: Finished TID 326 in 591 ms on ip-10-181-0-146.ec2.internal (progress: 75/108) | |
| 13/12/09 15:49:35,415 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 153) | |
| 13/12/09 15:49:35,434 INFO cluster.ClusterTaskSetManager: Finished TID 324 in 984 ms on ip-10-181-0-146.ec2.internal (progress: 76/108) | |
| 13/12/09 15:49:35,434 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 149) | |
| 13/12/09 15:49:35,434 INFO cluster.ClusterTaskSetManager: Starting task 1.1:84 as TID 334 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,434 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:84 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,585 INFO cluster.ClusterTaskSetManager: Finished TID 328 in 484 ms on ip-10-181-0-146.ec2.internal (progress: 77/108) | |
| 13/12/09 15:49:35,585 INFO cluster.ClusterTaskSetManager: Starting task 1.1:85 as TID 335 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,585 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 157) | |
| 13/12/09 15:49:35,586 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:85 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:35,591 INFO cluster.ClusterTaskSetManager: Finished TID 325 in 777 ms on ip-10-181-0-146.ec2.internal (progress: 78/108) | |
| 13/12/09 15:49:35,591 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 152) | |
| 13/12/09 15:49:35,591 INFO cluster.ClusterTaskSetManager: Starting task 1.1:86 as TID 336 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,592 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:86 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:35,611 INFO cluster.ClusterTaskSetManager: Starting task 1.1:87 as TID 337 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,611 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:87 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,611 INFO cluster.ClusterTaskSetManager: Finished TID 329 in 502 ms on ip-10-181-0-146.ec2.internal (progress: 79/108) | |
| 13/12/09 15:49:35,612 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 158) | |
| 13/12/09 15:49:35,802 INFO cluster.ClusterTaskSetManager: Starting task 1.1:88 as TID 338 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,802 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:88 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,802 INFO cluster.ClusterTaskSetManager: Finished TID 332 in 478 ms on ip-10-181-0-146.ec2.internal (progress: 80/108) | |
| 13/12/09 15:49:35,803 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 166) | |
| 13/12/09 15:49:35,899 INFO cluster.ClusterTaskSetManager: Finished TID 334 in 465 ms on ip-10-181-0-146.ec2.internal (progress: 81/108) | |
| 13/12/09 15:49:35,899 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 169) | |
| 13/12/09 15:49:35,899 INFO cluster.ClusterTaskSetManager: Starting task 1.1:89 as TID 339 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,900 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:89 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,951 INFO cluster.ClusterTaskSetManager: Finished TID 330 in 839 ms on ip-10-181-0-146.ec2.internal (progress: 82/108) | |
| 13/12/09 15:49:35,951 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 162) | |
| 13/12/09 15:49:35,952 INFO cluster.ClusterTaskSetManager: Starting task 1.1:90 as TID 340 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,952 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:90 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,972 INFO cluster.ClusterTaskSetManager: Starting task 1.1:91 as TID 341 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:35,973 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:91 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:35,973 INFO cluster.ClusterTaskSetManager: Finished TID 333 in 560 ms on ip-10-181-0-146.ec2.internal (progress: 83/108) | |
| 13/12/09 15:49:35,974 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 167) | |
| 13/12/09 15:49:36,308 INFO cluster.ClusterTaskSetManager: Starting task 1.1:92 as TID 342 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,308 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:92 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:36,309 INFO cluster.ClusterTaskSetManager: Finished TID 338 in 508 ms on ip-10-181-0-146.ec2.internal (progress: 84/108) | |
| 13/12/09 15:49:36,309 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 178) | |
| 13/12/09 15:49:36,362 INFO cluster.ClusterTaskSetManager: Starting task 1.1:93 as TID 343 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,363 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:93 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:36,363 INFO cluster.ClusterTaskSetManager: Finished TID 336 in 772 ms on ip-10-181-0-146.ec2.internal (progress: 85/108) | |
| 13/12/09 15:49:36,363 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 172) | |
| 13/12/09 15:49:36,448 INFO cluster.ClusterTaskSetManager: Starting task 1.1:94 as TID 344 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,449 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:94 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:36,449 INFO cluster.ClusterTaskSetManager: Finished TID 339 in 550 ms on ip-10-181-0-146.ec2.internal (progress: 86/108) | |
| 13/12/09 15:49:36,449 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 180) | |
| 13/12/09 15:49:36,457 INFO cluster.ClusterTaskSetManager: Finished TID 337 in 847 ms on ip-10-181-0-146.ec2.internal (progress: 87/108) | |
| 13/12/09 15:49:36,457 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 173) | |
| 13/12/09 15:49:36,458 INFO cluster.ClusterTaskSetManager: Starting task 1.1:95 as TID 345 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,458 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:95 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:36,480 INFO cluster.ClusterTaskSetManager: Starting task 1.1:96 as TID 346 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,481 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:96 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:36,481 INFO cluster.ClusterTaskSetManager: Finished TID 340 in 530 ms on ip-10-181-0-146.ec2.internal (progress: 88/108) | |
| 13/12/09 15:49:36,482 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 181) | |
| 13/12/09 15:49:36,511 INFO cluster.ClusterTaskSetManager: Starting task 1.1:97 as TID 347 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,511 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:97 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:36,512 INFO cluster.ClusterTaskSetManager: Finished TID 335 in 927 ms on ip-10-181-0-146.ec2.internal (progress: 89/108) | |
| 13/12/09 15:49:36,512 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 171) | |
| 13/12/09 15:49:36,959 INFO cluster.ClusterTaskSetManager: Starting task 1.1:98 as TID 348 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,960 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:98 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:36,960 INFO cluster.ClusterTaskSetManager: Finished TID 345 in 502 ms on ip-10-181-0-146.ec2.internal (progress: 90/108) | |
| 13/12/09 15:49:36,961 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 191) | |
| 13/12/09 15:49:36,995 INFO cluster.ClusterTaskSetManager: Starting task 1.1:99 as TID 349 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:36,996 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:99 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:36,996 INFO cluster.ClusterTaskSetManager: Finished TID 341 in 1024 ms on ip-10-181-0-146.ec2.internal (progress: 91/108) | |
| 13/12/09 15:49:36,996 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 183) | |
| 13/12/09 15:49:37,022 INFO cluster.ClusterTaskSetManager: Starting task 1.1:100 as TID 350 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,023 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:100 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:37,023 INFO cluster.ClusterTaskSetManager: Finished TID 347 in 512 ms on ip-10-181-0-146.ec2.internal (progress: 92/108) | |
| 13/12/09 15:49:37,023 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 194) | |
| 13/12/09 15:49:37,052 INFO cluster.ClusterTaskSetManager: Starting task 1.1:101 as TID 351 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,053 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:101 as 2083 bytes in 1 ms | |
| 13/12/09 15:49:37,053 INFO cluster.ClusterTaskSetManager: Finished TID 346 in 573 ms on ip-10-181-0-146.ec2.internal (progress: 93/108) | |
| 13/12/09 15:49:37,054 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 192) | |
| 13/12/09 15:49:37,170 INFO cluster.ClusterTaskSetManager: Starting task 1.1:102 as TID 352 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,170 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:102 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:37,171 INFO cluster.ClusterTaskSetManager: Finished TID 342 in 864 ms on ip-10-181-0-146.ec2.internal (progress: 94/108) | |
| 13/12/09 15:49:37,171 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 186) | |
| 13/12/09 15:49:37,201 INFO cluster.ClusterTaskSetManager: Starting task 1.1:103 as TID 353 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,201 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:103 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:37,202 INFO cluster.ClusterTaskSetManager: Finished TID 343 in 840 ms on ip-10-181-0-146.ec2.internal (progress: 95/108) | |
| 13/12/09 15:49:37,202 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 187) | |
| 13/12/09 15:49:37,223 INFO cluster.ClusterTaskSetManager: Starting task 1.1:104 as TID 354 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,223 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:104 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:37,223 INFO cluster.ClusterTaskSetManager: Finished TID 344 in 775 ms on ip-10-181-0-146.ec2.internal (progress: 96/108) | |
| 13/12/09 15:49:37,224 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 188) | |
| 13/12/09 15:49:37,563 INFO cluster.ClusterTaskSetManager: Starting task 1.1:105 as TID 355 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,564 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:105 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:37,565 INFO cluster.ClusterTaskSetManager: Finished TID 350 in 543 ms on ip-10-181-0-146.ec2.internal (progress: 97/108) | |
| 13/12/09 15:49:37,565 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 202) | |
| 13/12/09 15:49:37,673 INFO cluster.ClusterTaskSetManager: Starting task 1.1:106 as TID 356 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,673 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:106 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:37,676 INFO cluster.ClusterTaskSetManager: Finished TID 351 in 624 ms on ip-10-181-0-146.ec2.internal (progress: 98/108) | |
| 13/12/09 15:49:37,676 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 203) | |
| 13/12/09 15:49:37,677 INFO cluster.ClusterTaskSetManager: Starting task 1.1:107 as TID 357 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:37,677 INFO cluster.ClusterTaskSetManager: Serialized task 1.1:107 as 2083 bytes in 0 ms | |
| 13/12/09 15:49:37,678 INFO cluster.ClusterTaskSetManager: Finished TID 352 in 507 ms on ip-10-181-0-146.ec2.internal (progress: 99/108) | |
| 13/12/09 15:49:37,678 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 205) | |
| 13/12/09 15:49:37,747 INFO cluster.ClusterTaskSetManager: Finished TID 349 in 752 ms on ip-10-181-0-146.ec2.internal (progress: 100/108) | |
| 13/12/09 15:49:37,748 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 199) | |
| 13/12/09 15:49:37,834 INFO cluster.ClusterTaskSetManager: Finished TID 331 in 2578 ms on ip-10-181-0-146.ec2.internal (progress: 101/108) | |
| 13/12/09 15:49:37,834 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 163) | |
| 13/12/09 15:49:37,859 INFO cluster.ClusterTaskSetManager: Finished TID 348 in 900 ms on ip-10-181-0-146.ec2.internal (progress: 102/108) | |
| 13/12/09 15:49:37,859 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 196) | |
| 13/12/09 15:49:37,980 INFO cluster.ClusterTaskSetManager: Finished TID 353 in 779 ms on ip-10-181-0-146.ec2.internal (progress: 103/108) | |
| 13/12/09 15:49:37,981 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 207) | |
| 13/12/09 15:49:38,013 INFO cluster.ClusterTaskSetManager: Finished TID 354 in 791 ms on ip-10-181-0-146.ec2.internal (progress: 104/108) | |
| 13/12/09 15:49:38,013 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 208) | |
| 13/12/09 15:49:38,281 INFO cluster.ClusterTaskSetManager: Finished TID 355 in 718 ms on ip-10-181-0-146.ec2.internal (progress: 105/108) | |
| 13/12/09 15:49:38,282 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 210) | |
| 13/12/09 15:49:38,314 INFO cluster.ClusterTaskSetManager: Finished TID 356 in 641 ms on ip-10-181-0-146.ec2.internal (progress: 106/108) | |
| 13/12/09 15:49:38,314 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 211) | |
| 13/12/09 15:49:38,498 INFO cluster.ClusterTaskSetManager: Finished TID 357 in 821 ms on ip-10-181-0-146.ec2.internal (progress: 107/108) | |
| 13/12/09 15:49:38,498 INFO cluster.ClusterScheduler: Remove TaskSet 1.1 from pool | |
| 13/12/09 15:49:38,498 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(1, 212) | |
| 13/12/09 15:49:38,499 INFO scheduler.DAGScheduler: Stage 1 (keyBy at LogAnalyzer.scala:35) finished in 13.184 s | |
| 13/12/09 15:49:38,499 INFO scheduler.DAGScheduler: looking for newly runnable stages | |
| 13/12/09 15:49:38,499 INFO scheduler.DAGScheduler: running: Set() | |
| 13/12/09 15:49:38,499 INFO scheduler.DAGScheduler: waiting: Set(Stage 0) | |
| 13/12/09 15:49:38,499 INFO scheduler.DAGScheduler: failed: Set() | |
| 13/12/09 15:49:38,506 INFO scheduler.DAGScheduler: Missing parents for Stage 0: List() | |
| 13/12/09 15:49:38,506 INFO scheduler.DAGScheduler: Submitting Stage 0 (MapPartitionsRDD[7] at mapPartitionsWithIndex at Vertica.scala:143), which is now runnable | |
| 13/12/09 15:49:38,508 INFO scheduler.DAGScheduler: Submitting 47 missing tasks from Stage 0 (MapPartitionsRDD[7] at mapPartitionsWithIndex at Vertica.scala:143) | |
| 13/12/09 15:49:38,509 INFO cluster.ClusterScheduler: Adding task set 0.1 with 47 tasks | |
| 13/12/09 15:49:38,509 INFO cluster.ClusterTaskSetManager: Starting task 0.1:0 as TID 358 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,510 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:0 as 8080 bytes in 1 ms | |
| 13/12/09 15:49:38,510 INFO cluster.ClusterTaskSetManager: Starting task 0.1:1 as TID 359 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,510 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:1 as 8080 bytes in 0 ms | |
| 13/12/09 15:49:38,511 INFO cluster.ClusterTaskSetManager: Starting task 0.1:2 as TID 360 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,511 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:2 as 8080 bytes in 0 ms | |
| 13/12/09 15:49:38,511 INFO cluster.ClusterTaskSetManager: Starting task 0.1:3 as TID 361 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,512 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:3 as 8080 bytes in 1 ms | |
| 13/12/09 15:49:38,512 INFO cluster.ClusterTaskSetManager: Starting task 0.1:4 as TID 362 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,512 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:4 as 8080 bytes in 0 ms | |
| 13/12/09 15:49:38,513 INFO cluster.ClusterTaskSetManager: Starting task 0.1:5 as TID 363 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,513 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:5 as 8080 bytes in 0 ms | |
| 13/12/09 15:49:38,513 INFO cluster.ClusterTaskSetManager: Starting task 0.1:6 as TID 364 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,514 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:6 as 8080 bytes in 1 ms | |
| 13/12/09 15:49:38,514 INFO cluster.ClusterTaskSetManager: Starting task 0.1:7 as TID 365 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:49:38,514 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:7 as 8080 bytes in 0 ms | |
| 13/12/09 15:49:38,536 INFO spark.MapOutputTrackerMasterActor: Asked to send map output locations for shuffle 0 to ip-10-181-0-146.ec2.internal:47339 | |
| 13/12/09 15:49:38,543 INFO spark.MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 6156 bytes | |
| 13/12/09 15:50:43,076 INFO cluster.ClusterTaskSetManager: Starting task 0.1:8 as TID 366 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:43,077 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:8 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:43,077 INFO cluster.ClusterTaskSetManager: Finished TID 362 in 64565 ms on ip-10-181-0-146.ec2.internal (progress: 0/47) | |
| 13/12/09 15:50:43,078 INFO scheduler.DAGScheduler: Completed ResultTask(0, 20) | |
| 13/12/09 15:50:44,654 INFO cluster.ClusterTaskSetManager: Starting task 0.1:9 as TID 367 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:44,654 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:9 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:44,655 INFO cluster.ClusterTaskSetManager: Finished TID 359 in 66145 ms on ip-10-181-0-146.ec2.internal (progress: 1/47) | |
| 13/12/09 15:50:44,655 INFO scheduler.DAGScheduler: Completed ResultTask(0, 17) | |
| 13/12/09 15:50:45,059 INFO cluster.ClusterTaskSetManager: Starting task 0.1:10 as TID 368 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:45,059 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:10 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:45,060 INFO cluster.ClusterTaskSetManager: Finished TID 364 in 66547 ms on ip-10-181-0-146.ec2.internal (progress: 2/47) | |
| 13/12/09 15:50:45,060 INFO scheduler.DAGScheduler: Completed ResultTask(0, 22) | |
| 13/12/09 15:50:45,384 INFO cluster.ClusterTaskSetManager: Starting task 0.1:11 as TID 369 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:45,384 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:11 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:45,385 INFO cluster.ClusterTaskSetManager: Finished TID 358 in 66876 ms on ip-10-181-0-146.ec2.internal (progress: 3/47) | |
| 13/12/09 15:50:45,385 INFO scheduler.DAGScheduler: Completed ResultTask(0, 16) | |
| 13/12/09 15:50:45,401 INFO cluster.ClusterTaskSetManager: Starting task 0.1:12 as TID 370 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:45,401 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:12 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:45,401 INFO cluster.ClusterTaskSetManager: Finished TID 361 in 66890 ms on ip-10-181-0-146.ec2.internal (progress: 4/47) | |
| 13/12/09 15:50:45,401 INFO scheduler.DAGScheduler: Completed ResultTask(0, 19) | |
| 13/12/09 15:50:45,480 INFO cluster.ClusterTaskSetManager: Starting task 0.1:13 as TID 371 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:45,480 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:13 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:45,480 INFO cluster.ClusterTaskSetManager: Finished TID 360 in 66969 ms on ip-10-181-0-146.ec2.internal (progress: 5/47) | |
| 13/12/09 15:50:45,481 INFO scheduler.DAGScheduler: Completed ResultTask(0, 18) | |
| 13/12/09 15:50:45,642 INFO cluster.ClusterTaskSetManager: Starting task 0.1:14 as TID 372 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:45,642 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:14 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:45,643 INFO cluster.ClusterTaskSetManager: Finished TID 363 in 67130 ms on ip-10-181-0-146.ec2.internal (progress: 6/47) | |
| 13/12/09 15:50:45,643 INFO scheduler.DAGScheduler: Completed ResultTask(0, 21) | |
| 13/12/09 15:50:45,821 INFO cluster.ClusterTaskSetManager: Starting task 0.1:15 as TID 373 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:50:45,822 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:15 as 8080 bytes in 0 ms | |
| 13/12/09 15:50:45,822 INFO cluster.ClusterTaskSetManager: Finished TID 365 in 67308 ms on ip-10-181-0-146.ec2.internal (progress: 7/47) | |
| 13/12/09 15:50:45,822 INFO scheduler.DAGScheduler: Completed ResultTask(0, 23) | |
| 13/12/09 15:51:47,178 INFO cluster.ClusterTaskSetManager: Starting task 0.1:16 as TID 374 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:47,179 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:16 as 8080 bytes in 1 ms | |
| 13/12/09 15:51:47,179 INFO cluster.ClusterTaskSetManager: Finished TID 366 in 64103 ms on ip-10-181-0-146.ec2.internal (progress: 8/47) | |
| 13/12/09 15:51:47,179 INFO scheduler.DAGScheduler: Completed ResultTask(0, 24) | |
| 13/12/09 15:51:49,204 INFO cluster.ClusterTaskSetManager: Starting task 0.1:17 as TID 375 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:49,204 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:17 as 8080 bytes in 0 ms | |
| 13/12/09 15:51:49,204 INFO cluster.ClusterTaskSetManager: Finished TID 367 in 64550 ms on ip-10-181-0-146.ec2.internal (progress: 9/47) | |
| 13/12/09 15:51:49,205 INFO scheduler.DAGScheduler: Completed ResultTask(0, 26) | |
| 13/12/09 15:51:50,649 INFO cluster.ClusterTaskSetManager: Starting task 0.1:18 as TID 376 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:50,650 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:18 as 8080 bytes in 0 ms | |
| 13/12/09 15:51:50,650 INFO cluster.ClusterTaskSetManager: Finished TID 371 in 65170 ms on ip-10-181-0-146.ec2.internal (progress: 10/47) | |
| 13/12/09 15:51:50,651 INFO scheduler.DAGScheduler: Completed ResultTask(0, 30) | |
| 13/12/09 15:51:50,993 INFO cluster.ClusterTaskSetManager: Starting task 0.1:19 as TID 377 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:50,993 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:19 as 8080 bytes in 0 ms | |
| 13/12/09 15:51:50,994 INFO cluster.ClusterTaskSetManager: Finished TID 369 in 65610 ms on ip-10-181-0-146.ec2.internal (progress: 11/47) | |
| 13/12/09 15:51:50,994 INFO scheduler.DAGScheduler: Completed ResultTask(0, 28) | |
| 13/12/09 15:51:51,382 INFO cluster.ClusterTaskSetManager: Starting task 0.1:20 as TID 378 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:51,382 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:20 as 8080 bytes in 0 ms | |
| 13/12/09 15:51:51,383 INFO cluster.ClusterTaskSetManager: Finished TID 368 in 66324 ms on ip-10-181-0-146.ec2.internal (progress: 12/47) | |
| 13/12/09 15:51:51,383 INFO scheduler.DAGScheduler: Completed ResultTask(0, 27) | |
| 13/12/09 15:51:51,476 INFO cluster.ClusterTaskSetManager: Starting task 0.1:21 as TID 379 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:51,476 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:21 as 8080 bytes in 0 ms | |
| 13/12/09 15:51:51,476 INFO cluster.ClusterTaskSetManager: Finished TID 373 in 65655 ms on ip-10-181-0-146.ec2.internal (progress: 13/47) | |
| 13/12/09 15:51:51,477 INFO scheduler.DAGScheduler: Completed ResultTask(0, 32) | |
| 13/12/09 15:51:51,569 INFO cluster.ClusterTaskSetManager: Starting task 0.1:22 as TID 380 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:51,570 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:22 as 8080 bytes in 1 ms | |
| 13/12/09 15:51:51,570 INFO cluster.ClusterTaskSetManager: Finished TID 370 in 66170 ms on ip-10-181-0-146.ec2.internal (progress: 14/47) | |
| 13/12/09 15:51:51,570 INFO scheduler.DAGScheduler: Completed ResultTask(0, 29) | |
| 13/12/09 15:51:52,116 INFO cluster.ClusterTaskSetManager: Starting task 0.1:23 as TID 381 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:51:52,116 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:23 as 8080 bytes in 0 ms | |
| 13/12/09 15:51:52,117 INFO cluster.ClusterTaskSetManager: Finished TID 372 in 66475 ms on ip-10-181-0-146.ec2.internal (progress: 15/47) | |
| 13/12/09 15:51:52,117 INFO scheduler.DAGScheduler: Completed ResultTask(0, 31) | |
| 13/12/09 15:52:55,809 INFO cluster.ClusterTaskSetManager: Starting task 0.1:24 as TID 382 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:52:55,810 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:24 as 8080 bytes in 0 ms | |
| 13/12/09 15:52:55,810 INFO cluster.ClusterTaskSetManager: Finished TID 374 in 68632 ms on ip-10-181-0-146.ec2.internal (progress: 16/47) | |
| 13/12/09 15:52:55,810 INFO scheduler.DAGScheduler: Completed ResultTask(0, 33) | |
| 13/12/09 15:52:57,018 INFO cluster.ClusterTaskSetManager: Starting task 0.1:25 as TID 383 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:52:57,018 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:25 as 8080 bytes in 0 ms | |
| 13/12/09 15:52:57,019 INFO cluster.ClusterTaskSetManager: Finished TID 375 in 67816 ms on ip-10-181-0-146.ec2.internal (progress: 17/47) | |
| 13/12/09 15:52:57,019 INFO scheduler.DAGScheduler: Completed ResultTask(0, 34) | |
| 13/12/09 15:52:58,851 INFO cluster.ClusterTaskSetManager: Starting task 0.1:26 as TID 384 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:52:58,851 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:26 as 8080 bytes in 0 ms | |
| 13/12/09 15:52:58,852 INFO cluster.ClusterTaskSetManager: Finished TID 376 in 68202 ms on ip-10-181-0-146.ec2.internal (progress: 18/47) | |
| 13/12/09 15:52:58,852 INFO scheduler.DAGScheduler: Completed ResultTask(0, 35) | |
| 13/12/09 15:52:58,898 INFO cluster.ClusterTaskSetManager: Starting task 0.1:27 as TID 385 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:52:58,898 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:27 as 8080 bytes in 0 ms | |
| 13/12/09 15:52:58,898 INFO cluster.ClusterTaskSetManager: Finished TID 379 in 67422 ms on ip-10-181-0-146.ec2.internal (progress: 19/47) | |
| 13/12/09 15:52:58,898 INFO scheduler.DAGScheduler: Completed ResultTask(0, 38) | |
| 13/12/09 15:53:00,243 INFO cluster.ClusterTaskSetManager: Starting task 0.1:28 as TID 386 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:53:00,244 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:28 as 8080 bytes in 0 ms | |
| 13/12/09 15:53:00,244 INFO cluster.ClusterTaskSetManager: Finished TID 380 in 68675 ms on ip-10-181-0-146.ec2.internal (progress: 20/47) | |
| 13/12/09 15:53:00,245 INFO scheduler.DAGScheduler: Completed ResultTask(0, 39) | |
| 13/12/09 15:53:00,273 INFO cluster.ClusterTaskSetManager: Starting task 0.1:29 as TID 387 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:53:00,274 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:29 as 8080 bytes in 1 ms | |
| 13/12/09 15:53:00,274 INFO cluster.ClusterTaskSetManager: Finished TID 377 in 69281 ms on ip-10-181-0-146.ec2.internal (progress: 21/47) | |
| 13/12/09 15:53:00,274 INFO scheduler.DAGScheduler: Completed ResultTask(0, 36) | |
| 13/12/09 15:53:00,442 INFO cluster.ClusterTaskSetManager: Starting task 0.1:30 as TID 388 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:53:00,443 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:30 as 8080 bytes in 1 ms | |
| 13/12/09 15:53:00,443 INFO cluster.ClusterTaskSetManager: Finished TID 378 in 69061 ms on ip-10-181-0-146.ec2.internal (progress: 22/47) | |
| 13/12/09 15:53:00,443 INFO scheduler.DAGScheduler: Completed ResultTask(0, 37) | |
| 13/12/09 15:53:00,693 INFO cluster.ClusterTaskSetManager: Starting task 0.1:31 as TID 389 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:53:00,693 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:31 as 8080 bytes in 0 ms | |
| 13/12/09 15:53:00,694 INFO cluster.ClusterTaskSetManager: Finished TID 381 in 68578 ms on ip-10-181-0-146.ec2.internal (progress: 23/47) | |
| 13/12/09 15:53:00,694 INFO scheduler.DAGScheduler: Completed ResultTask(0, 40) | |
| 13/12/09 15:53:57,469 INFO cluster.ClusterTaskSetManager: Starting task 0.1:32 as TID 390 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:53:57,469 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:32 as 8080 bytes in 0 ms | |
| 13/12/09 15:53:57,470 INFO cluster.ClusterTaskSetManager: Finished TID 382 in 61661 ms on ip-10-181-0-146.ec2.internal (progress: 24/47) | |
| 13/12/09 15:53:57,470 INFO scheduler.DAGScheduler: Completed ResultTask(0, 41) | |
| 13/12/09 15:53:58,087 INFO cluster.ClusterTaskSetManager: Starting task 0.1:33 as TID 391 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:53:58,087 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:33 as 8080 bytes in 0 ms | |
| 13/12/09 15:53:58,088 INFO cluster.ClusterTaskSetManager: Finished TID 383 in 61069 ms on ip-10-181-0-146.ec2.internal (progress: 25/47) | |
| 13/12/09 15:53:58,088 INFO scheduler.DAGScheduler: Completed ResultTask(0, 42) | |
| 13/12/09 15:54:01,820 INFO cluster.ClusterTaskSetManager: Starting task 0.1:34 as TID 392 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:01,821 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:34 as 8080 bytes in 1 ms | |
| 13/12/09 15:54:01,821 INFO cluster.ClusterTaskSetManager: Finished TID 385 in 62924 ms on ip-10-181-0-146.ec2.internal (progress: 26/47) | |
| 13/12/09 15:54:01,821 INFO scheduler.DAGScheduler: Completed ResultTask(0, 44) | |
| 13/12/09 15:54:02,787 INFO cluster.ClusterTaskSetManager: Starting task 0.1:35 as TID 393 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:02,788 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:35 as 8080 bytes in 0 ms | |
| 13/12/09 15:54:02,789 INFO cluster.ClusterTaskSetManager: Finished TID 384 in 63939 ms on ip-10-181-0-146.ec2.internal (progress: 27/47) | |
| 13/12/09 15:54:02,789 INFO scheduler.DAGScheduler: Completed ResultTask(0, 43) | |
| 13/12/09 15:54:02,885 INFO cluster.ClusterTaskSetManager: Starting task 0.1:36 as TID 394 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:02,886 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:36 as 8080 bytes in 0 ms | |
| 13/12/09 15:54:02,887 INFO cluster.ClusterTaskSetManager: Finished TID 388 in 62445 ms on ip-10-181-0-146.ec2.internal (progress: 28/47) | |
| 13/12/09 15:54:02,887 INFO scheduler.DAGScheduler: Completed ResultTask(0, 47) | |
| 13/12/09 15:54:03,489 INFO cluster.ClusterTaskSetManager: Starting task 0.1:37 as TID 395 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:03,490 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:37 as 8080 bytes in 0 ms | |
| 13/12/09 15:54:03,490 INFO cluster.ClusterTaskSetManager: Finished TID 389 in 62797 ms on ip-10-181-0-146.ec2.internal (progress: 29/47) | |
| 13/12/09 15:54:03,491 INFO scheduler.DAGScheduler: Completed ResultTask(0, 48) | |
| 13/12/09 15:54:03,672 INFO cluster.ClusterTaskSetManager: Starting task 0.1:38 as TID 396 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:03,672 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:38 as 8080 bytes in 0 ms | |
| 13/12/09 15:54:03,673 INFO cluster.ClusterTaskSetManager: Finished TID 386 in 63429 ms on ip-10-181-0-146.ec2.internal (progress: 30/47) | |
| 13/12/09 15:54:03,673 INFO scheduler.DAGScheduler: Completed ResultTask(0, 45) | |
| 13/12/09 15:54:04,074 INFO cluster.ClusterTaskSetManager: Starting task 0.1:39 as TID 397 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:04,075 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:39 as 8080 bytes in 1 ms | |
| 13/12/09 15:54:04,075 INFO cluster.ClusterTaskSetManager: Finished TID 387 in 63802 ms on ip-10-181-0-146.ec2.internal (progress: 31/47) | |
| 13/12/09 15:54:04,075 INFO scheduler.DAGScheduler: Completed ResultTask(0, 46) | |
| 13/12/09 15:54:56,843 INFO cluster.ClusterTaskSetManager: Starting task 0.1:40 as TID 398 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:56,843 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:40 as 8080 bytes in 0 ms | |
| 13/12/09 15:54:56,844 INFO cluster.ClusterTaskSetManager: Finished TID 390 in 59375 ms on ip-10-181-0-146.ec2.internal (progress: 32/47) | |
| 13/12/09 15:54:56,844 INFO scheduler.DAGScheduler: Completed ResultTask(0, 49) | |
| 13/12/09 15:54:58,077 INFO cluster.ClusterTaskSetManager: Starting task 0.1:41 as TID 399 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:54:58,078 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:41 as 8080 bytes in 0 ms | |
| 13/12/09 15:54:58,079 INFO cluster.ClusterTaskSetManager: Finished TID 391 in 59992 ms on ip-10-181-0-146.ec2.internal (progress: 33/47) | |
| 13/12/09 15:54:58,079 INFO scheduler.DAGScheduler: Completed ResultTask(0, 50) | |
| 13/12/09 15:55:01,648 INFO cluster.ClusterTaskSetManager: Starting task 0.1:42 as TID 400 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:55:01,648 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:42 as 8080 bytes in 0 ms | |
| 13/12/09 15:55:01,649 INFO cluster.ClusterTaskSetManager: Finished TID 392 in 59828 ms on ip-10-181-0-146.ec2.internal (progress: 34/47) | |
| 13/12/09 15:55:01,649 INFO scheduler.DAGScheduler: Completed ResultTask(0, 51) | |
| 13/12/09 15:55:02,858 INFO cluster.ClusterTaskSetManager: Starting task 0.1:43 as TID 401 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:55:02,858 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:43 as 8080 bytes in 0 ms | |
| 13/12/09 15:55:02,859 INFO cluster.ClusterTaskSetManager: Finished TID 394 in 59974 ms on ip-10-181-0-146.ec2.internal (progress: 35/47) | |
| 13/12/09 15:55:02,860 INFO scheduler.DAGScheduler: Completed ResultTask(0, 53) | |
| 13/12/09 15:55:04,308 INFO cluster.ClusterTaskSetManager: Starting task 0.1:44 as TID 402 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:55:04,309 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:44 as 8080 bytes in 1 ms | |
| 13/12/09 15:55:04,310 INFO cluster.ClusterTaskSetManager: Finished TID 393 in 61523 ms on ip-10-181-0-146.ec2.internal (progress: 36/47) | |
| 13/12/09 15:55:04,310 INFO scheduler.DAGScheduler: Completed ResultTask(0, 52) | |
| 13/12/09 15:55:04,377 INFO cluster.ClusterTaskSetManager: Starting task 0.1:45 as TID 403 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:55:04,377 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:45 as 8080 bytes in 0 ms | |
| 13/12/09 15:55:04,378 INFO cluster.ClusterTaskSetManager: Finished TID 396 in 60707 ms on ip-10-181-0-146.ec2.internal (progress: 37/47) | |
| 13/12/09 15:55:04,378 INFO scheduler.DAGScheduler: Completed ResultTask(0, 55) | |
| 13/12/09 15:55:07,222 INFO cluster.ClusterTaskSetManager: Starting task 0.1:46 as TID 404 on executor 1: ip-10-181-0-146.ec2.internal (PROCESS_LOCAL) | |
| 13/12/09 15:55:07,223 INFO cluster.ClusterTaskSetManager: Serialized task 0.1:46 as 8080 bytes in 1 ms | |
| 13/12/09 15:55:07,223 INFO cluster.ClusterTaskSetManager: Finished TID 395 in 63734 ms on ip-10-181-0-146.ec2.internal (progress: 38/47) | |
| 13/12/09 15:55:07,223 INFO scheduler.DAGScheduler: Completed ResultTask(0, 54) | |
| 13/12/09 15:55:07,603 INFO cluster.ClusterTaskSetManager: Finished TID 397 in 63528 ms on ip-10-181-0-146.ec2.internal (progress: 39/47) | |
| 13/12/09 15:55:07,603 INFO scheduler.DAGScheduler: Completed ResultTask(0, 56) | |
| 13/12/09 15:55:56,517 INFO cluster.ClusterTaskSetManager: Finished TID 398 in 59675 ms on ip-10-181-0-146.ec2.internal (progress: 40/47) | |
| 13/12/09 15:55:56,517 INFO scheduler.DAGScheduler: Completed ResultTask(0, 57) | |
| 13/12/09 15:55:56,827 INFO cluster.ClusterTaskSetManager: Finished TID 399 in 58750 ms on ip-10-181-0-146.ec2.internal (progress: 41/47) | |
| 13/12/09 15:55:56,827 INFO scheduler.DAGScheduler: Completed ResultTask(0, 58) | |
| 13/12/09 15:56:00,688 INFO cluster.ClusterTaskSetManager: Finished TID 400 in 59041 ms on ip-10-181-0-146.ec2.internal (progress: 42/47) | |
| 13/12/09 15:56:00,688 INFO scheduler.DAGScheduler: Completed ResultTask(0, 59) | |
| 13/12/09 15:56:02,001 INFO cluster.ClusterTaskSetManager: Finished TID 401 in 59143 ms on ip-10-181-0-146.ec2.internal (progress: 43/47) | |
| 13/12/09 15:56:02,001 INFO scheduler.DAGScheduler: Completed ResultTask(0, 60) | |
| 13/12/09 15:56:02,383 INFO cluster.ClusterTaskSetManager: Finished TID 403 in 58006 ms on ip-10-181-0-146.ec2.internal (progress: 44/47) | |
| 13/12/09 15:56:02,383 INFO scheduler.DAGScheduler: Completed ResultTask(0, 62) | |
| 13/12/09 15:56:03,367 INFO cluster.ClusterTaskSetManager: Finished TID 402 in 59059 ms on ip-10-181-0-146.ec2.internal (progress: 45/47) | |
| 13/12/09 15:56:03,367 INFO scheduler.DAGScheduler: Completed ResultTask(0, 61) | |
| 13/12/09 15:56:04,288 INFO cluster.ClusterTaskSetManager: Finished TID 404 in 57066 ms on ip-10-181-0-146.ec2.internal (progress: 46/47) | |
| 13/12/09 15:56:04,288 INFO cluster.ClusterScheduler: Remove TaskSet 0.1 from pool | |
| 13/12/09 15:56:04,288 INFO scheduler.DAGScheduler: Completed ResultTask(0, 63) | |
| 13/12/09 15:56:04,288 INFO scheduler.DAGScheduler: Stage 0 (foreach at Vertica.scala:143) finished in 385.779 s | |
| 13/12/09 15:56:04,301 INFO spark.SparkContext: Job finished: foreach at Vertica.scala:143, took 549.656763309 s | |
| 13/12/09 15:56:04,302 INFO vertica.Vertica: Inserting to temporary tables finished in 549.716 seconds | |
| 13/12/09 15:56:04,303 INFO vertica.Vertica: Copying to final tables started | |
| 13/12/09 15:56:04,305 INFO vertica.Vertica: - sessions... | |
| 13/12/09 15:56:11,839 INFO vertica.Vertica: - 860795 rows affected. | |
| 13/12/09 15:56:11,839 INFO vertica.Vertica: - experimentTags... | |
| 13/12/09 15:56:12,126 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:56:12,127 INFO vertica.Vertica: - customSegments... | |
| 13/12/09 15:56:12,375 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:56:12,375 INFO vertica.Vertica: - unitViews... | |
| 13/12/09 15:56:26,452 INFO vertica.Vertica: - 790931 rows affected. | |
| 13/12/09 15:56:26,452 INFO vertica.Vertica: - screenViews... | |
| 13/12/09 15:56:47,324 INFO vertica.Vertica: - 895482 rows affected. | |
| 13/12/09 15:56:47,324 INFO vertica.Vertica: - tweetPageOpens... | |
| 13/12/09 15:56:47,689 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:56:47,689 INFO vertica.Vertica: - customEventOccurrences... | |
| 13/12/09 15:56:50,475 INFO vertica.Vertica: - 24950 rows affected. | |
| 13/12/09 15:56:50,476 INFO vertica.Vertica: - storeOpens... | |
| 13/12/09 15:56:51,419 INFO vertica.Vertica: - 5 rows affected. | |
| 13/12/09 15:56:51,419 INFO vertica.Vertica: - pinterestPinAttempts... | |
| 13/12/09 15:56:51,778 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:56:51,778 INFO vertica.Vertica: - phoneCalls... | |
| 13/12/09 15:56:53,949 INFO vertica.Vertica: - 248 rows affected. | |
| 13/12/09 15:56:53,949 INFO vertica.Vertica: - videoSessions... | |
| 13/12/09 15:56:56,399 INFO vertica.Vertica: - 5167 rows affected. | |
| 13/12/09 15:56:56,399 INFO vertica.Vertica: - formSubmissionSuccesses... | |
| 13/12/09 15:56:56,753 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:56:56,753 INFO vertica.Vertica: - facebookLikes... | |
| 13/12/09 15:56:57,118 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:56:57,118 INFO vertica.Vertica: - formSubmissionAttempts... | |
| 13/12/09 15:56:57,473 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:56:57,473 INFO vertica.Vertica: - urlOpens... | |
| 13/12/09 15:56:59,971 INFO vertica.Vertica: - 2631 rows affected. | |
| 13/12/09 15:56:59,971 INFO vertica.Vertica: - facebookShares... | |
| 13/12/09 15:57:00,455 INFO vertica.Vertica: - 1 rows affected. | |
| 13/12/09 15:57:00,455 INFO vertica.Vertica: - twitterProfileOpens... | |
| 13/12/09 15:57:00,820 INFO vertica.Vertica: - 0 rows affected. | |
| 13/12/09 15:57:00,820 INFO vertica.Vertica: - videoSegmentViews... | |
| 13/12/09 15:57:03,375 INFO vertica.Vertica: - 1456 rows affected. | |
| 13/12/09 15:57:03,376 INFO vertica.Vertica: All tables processed. | |
| 13/12/09 15:57:03,376 INFO vertica.Vertica: Copying to final tables finished in 59.073 seconds | |
| 13/12/09 15:57:03,377 INFO vertica.Vertica: Commiting transaction... | |
| 13/12/09 15:57:03,446 INFO vertica.Vertica: Dropping temporary tables... | |
| 13/12/09 15:57:04,149 INFO analyzer.App: Done! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment