Created
March 26, 2013 21:20
-
-
Save stephenh/5249368 to your computer and use it in GitHub Desktop.
registrar not found
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| SLF4J: This version of SLF4J requires log4j version 1.2.12 or later. See also http://www.slf4j.org/codes.html#log4j_version | |
| 13/03/26 20:19:54 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started | |
| 13/03/26 20:19:54 INFO actor.ActorSystemImpl: RemoteServerStarted@akka://spark@10.224.6.227:52400 | |
| 13/03/26 20:19:54 INFO spark.SparkEnv: Registering BlockManagerMaster | |
| 13/03/26 20:19:54 INFO storage.MemoryStore: MemoryStore started with capacity 323.9 MB. | |
| 13/03/26 20:19:54 INFO storage.DiskStore: Created local directory at /mnt/spark/local/spark-local-20130326201954-696e | |
| 13/03/26 20:19:55 INFO network.ConnectionManager: Bound socket to port 41101 with id = ConnectionManagerId(ip-10-224-6-227.ec2.internal,41101) | |
| 13/03/26 20:19:55 INFO storage.BlockManagerMaster: Trying to register BlockManager | |
| 13/03/26 20:19:55 INFO storage.BlockManagerMaster: Registered BlockManager | |
| 13/03/26 20:19:55 INFO server.Server: jetty-7.5.3.v20111011 | |
| 13/03/26 20:19:55 INFO server.AbstractConnector: Started SocketConnector@0.0.0.0:59322 STARTING | |
| 13/03/26 20:19:55 INFO broadcast.HttpBroadcast: Broadcast server started at http://10.224.6.227:59322 | |
| 13/03/26 20:19:55 INFO spark.SparkEnv: Registering MapOutputTracker | |
| 13/03/26 20:19:55 INFO spark.HttpFileServer: HTTP File server directory is /tmp/spark-bded4545-c549-4eb5-9f58-08b7eacafb32 | |
| 13/03/26 20:19:55 INFO server.Server: jetty-7.5.3.v20111011 | |
| 13/03/26 20:19:55 INFO server.AbstractConnector: Started SocketConnector@0.0.0.0:55932 STARTING | |
| 13/03/26 20:19:55 INFO io.IoWorker: IoWorker thread 'spray-io-worker-0' started | |
| 13/03/26 20:19:55 INFO server.HttpServer: akka://spark/user/BlockManagerHTTPServer started on /0.0.0.0:42838 | |
| 13/03/26 20:19:55 INFO storage.BlockManagerUI: Started BlockManager web UI at http://ip-10-224-6-227.ec2.internal:42838 | |
| 13/03/26 20:19:55 INFO client.Client$ClientActor: Connecting to master spark://10.224.6.227:7077 | |
| 13/03/26 20:19:55 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkMaster@10.224.6.227:7077 | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Connected to Spark cluster with app ID app-20130326201956-0000 | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/0 on worker-20130326201816-ip-10-98-95-218.ec2.internal-54515 (ip-10-98-95-218.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/0 on host ip-10-98-95-218.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/1 on worker-20130326201816-ip-10-83-74-179.ec2.internal-41456 (ip-10-83-74-179.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/1 on host ip-10-83-74-179.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/2 on worker-20130326201805-ip-10-40-187-172.ec2.internal-33056 (ip-10-40-187-172.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/2 on host ip-10-40-187-172.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/3 on worker-20130326201812-ip-10-118-97-63.ec2.internal-60663 (ip-10-118-97-63.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/3 on host ip-10-118-97-63.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/4 on worker-20130326201811-ip-10-116-191-1.ec2.internal-33830 (ip-10-116-191-1.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/4 on host ip-10-116-191-1.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/5 on worker-20130326201853-ip-10-101-58-116.ec2.internal-35647 (ip-10-101-58-116.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/5 on host ip-10-101-58-116.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/6 on worker-20130326201809-ip-10-83-61-103.ec2.internal-55548 (ip-10-83-61-103.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/6 on host ip-10-83-61-103.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/7 on worker-20130326201805-ip-10-212-66-3.ec2.internal-41518 (ip-10-212-66-3.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/7 on host ip-10-212-66-3.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/8 on worker-20130326201811-ip-10-60-57-114.ec2.internal-51436 (ip-10-60-57-114.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/8 on host ip-10-60-57-114.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/9 on worker-20130326201807-ip-10-35-90-71.ec2.internal-43702 (ip-10-35-90-71.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/9 on host ip-10-35-90-71.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/10 on worker-20130326201813-ip-10-32-83-193.ec2.internal-55367 (ip-10-32-83-193.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/10 on host ip-10-32-83-193.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/11 on worker-20130326201812-ip-10-82-243-247.ec2.internal-43484 (ip-10-82-243-247.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/11 on host ip-10-82-243-247.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/12 on worker-20130326201822-ip-10-116-222-45.ec2.internal-60425 (ip-10-116-222-45.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/12 on host ip-10-116-222-45.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/13 on worker-20130326201820-ip-10-78-193-188.ec2.internal-35540 (ip-10-78-193-188.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/13 on host ip-10-78-193-188.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/14 on worker-20130326201812-ip-10-62-87-64.ec2.internal-53850 (ip-10-62-87-64.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/14 on host ip-10-62-87-64.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/15 on worker-20130326201803-ip-10-10-43-140.ec2.internal-36671 (ip-10-10-43-140.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/15 on host ip-10-10-43-140.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/16 on worker-20130326201813-ip-10-98-82-214.ec2.internal-43926 (ip-10-98-82-214.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/16 on host ip-10-98-82-214.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/17 on worker-20130326201819-ip-10-118-138-26.ec2.internal-38351 (ip-10-118-138-26.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/17 on host ip-10-118-138-26.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/18 on worker-20130326201807-ip-10-77-59-181.ec2.internal-52344 (ip-10-77-59-181.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/18 on host ip-10-77-59-181.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/19 on worker-20130326201811-ip-10-101-3-102.ec2.internal-48166 (ip-10-101-3-102.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/19 on host ip-10-101-3-102.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/20 on worker-20130326201810-ip-10-204-151-227.ec2.internal-43703 (ip-10-204-151-227.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/20 on host ip-10-204-151-227.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/21 on worker-20130326201807-ip-10-80-14-64.ec2.internal-44350 (ip-10-80-14-64.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/21 on host ip-10-80-14-64.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/22 on worker-20130326201814-ip-10-40-29-13.ec2.internal-47665 (ip-10-40-29-13.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/22 on host ip-10-40-29-13.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/23 on worker-20130326201807-ip-10-98-131-10.ec2.internal-48713 (ip-10-98-131-10.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/23 on host ip-10-98-131-10.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/24 on worker-20130326201939-ip-10-202-7-40.ec2.internal-52381 (ip-10-202-7-40.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/24 on host ip-10-202-7-40.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/25 on worker-20130326201822-ip-10-101-38-191.ec2.internal-56226 (ip-10-101-38-191.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/25 on host ip-10-101-38-191.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/26 on worker-20130326201813-ip-10-12-77-64.ec2.internal-50376 (ip-10-12-77-64.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/26 on host ip-10-12-77-64.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/27 on worker-20130326201805-ip-10-80-189-211.ec2.internal-37103 (ip-10-80-189-211.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/27 on host ip-10-80-189-211.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO fullfunnel.VisitorAcquisitionDebugJob$: Running for 2013-3-4 [2012-12-5, 2013-3-3]/[2012-12-5, 2013-3-4] attempt 13-debug-dc-dec5-cogroup-nocoalesce | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor added: app-20130326201956-0000/28 on worker-20130326201807-ip-10-32-69-77.ec2.internal-47591 (ip-10-32-69-77.ec2.internal) with 2 cores | |
| 13/03/26 20:19:56 INFO cluster.SparkDeploySchedulerBackend: Granted executor ID app-20130326201956-0000/28 on host ip-10-32-69-77.ec2.internal with 2 cores, 6.3 GB RAM | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/1 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/2 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/14 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/20 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/15 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/7 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/13 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/12 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/5 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/18 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/19 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/8 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/0 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/3 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/23 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/11 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/25 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/26 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/22 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/9 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/21 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/16 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/10 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/24 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/6 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/17 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/27 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/4 is now RUNNING | |
| 13/03/26 20:19:56 INFO client.Client$ClientActor: Executor updated: app-20130326201956-0000/28 is now RUNNING | |
| 13/03/26 20:19:57 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-212-66-3.ec2.internal:33921 | |
| 13/03/26 20:19:57 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-212-66-3.ec2.internal:33921/user/Executor] with ID 7 | |
| 13/03/26 20:19:57 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-60-57-114.ec2.internal:35485 | |
| 13/03/26 20:19:57 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-60-57-114.ec2.internal:35485/user/Executor] with ID 8 | |
| 13/03/26 20:19:57 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-10-43-140.ec2.internal:43583 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-98-131-10.ec2.internal:38762 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-40-187-172.ec2.internal:51590 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-10-43-140.ec2.internal:43583/user/Executor] with ID 15 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-98-131-10.ec2.internal:38762/user/Executor] with ID 23 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-40-187-172.ec2.internal:51590/user/Executor] with ID 2 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-204-151-227.ec2.internal:33960 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-204-151-227.ec2.internal:33960/user/Executor] with ID 20 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-40-29-13.ec2.internal:58706 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-212-66-3.ec2.internal:56280 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-212-66-3.ec2.internal:49855 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-62-87-64.ec2.internal:59852 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-40-29-13.ec2.internal:58706/user/Executor] with ID 22 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-12-77-64.ec2.internal:39870 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-62-87-64.ec2.internal:59852/user/Executor] with ID 14 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-60-57-114.ec2.internal:33843 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-60-57-114.ec2.internal:55006 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-12-77-64.ec2.internal:39870/user/Executor] with ID 26 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-10-43-140.ec2.internal:44706 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-10-43-140.ec2.internal:59682 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-40-187-172.ec2.internal:37702 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-40-187-172.ec2.internal:58417 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-98-131-10.ec2.internal:40130 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-98-131-10.ec2.internal:42032 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-204-151-227.ec2.internal:58861 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-204-151-227.ec2.internal:57415 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-40-29-13.ec2.internal:48717 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-40-29-13.ec2.internal:34300 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-62-87-64.ec2.internal:48282 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-62-87-64.ec2.internal:50707 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-12-77-64.ec2.internal:57785 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-12-77-64.ec2.internal:38545 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-98-82-214.ec2.internal:35578 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-98-82-214.ec2.internal:35578/user/Executor] with ID 16 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-118-97-63.ec2.internal:56095 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-118-97-63.ec2.internal:56095/user/Executor] with ID 3 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-32-83-193.ec2.internal:38287 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-101-3-102.ec2.internal:54764 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-101-38-191.ec2.internal:60454 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-116-191-1.ec2.internal:60655 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-32-69-77.ec2.internal:60906 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-35-90-71.ec2.internal:46986 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-116-191-1.ec2.internal:60655/user/Executor] with ID 4 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-83-61-103.ec2.internal:37271 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-32-83-193.ec2.internal:38287/user/Executor] with ID 10 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-78-193-188.ec2.internal:58177 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-82-243-247.ec2.internal:40413 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-101-38-191.ec2.internal:60454/user/Executor] with ID 25 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-32-69-77.ec2.internal:60906/user/Executor] with ID 28 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-78-193-188.ec2.internal:58177/user/Executor] with ID 13 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-98-95-218.ec2.internal:40814 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-101-3-102.ec2.internal:54764/user/Executor] with ID 19 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-77-59-181.ec2.internal:39697 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-83-74-179.ec2.internal:33408 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-202-7-40.ec2.internal:60219 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-98-95-218.ec2.internal:40814/user/Executor] with ID 0 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-82-243-247.ec2.internal:40413/user/Executor] with ID 11 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-35-90-71.ec2.internal:46986/user/Executor] with ID 9 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-80-189-211.ec2.internal:43820 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-83-74-179.ec2.internal:33408/user/Executor] with ID 1 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-80-14-64.ec2.internal:35196 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-118-138-26.ec2.internal:35501 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-77-59-181.ec2.internal:39697/user/Executor] with ID 18 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-116-222-45.ec2.internal:60803 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-83-61-103.ec2.internal:37271/user/Executor] with ID 6 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-202-7-40.ec2.internal:60219/user/Executor] with ID 24 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-118-138-26.ec2.internal:35501/user/Executor] with ID 17 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-80-14-64.ec2.internal:35196/user/Executor] with ID 21 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-116-222-45.ec2.internal:60803/user/Executor] with ID 12 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-80-189-211.ec2.internal:43820/user/Executor] with ID 27 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-98-82-214.ec2.internal:33098 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-98-82-214.ec2.internal:60903 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkExecutor@ip-10-101-58-116.ec2.internal:60130 | |
| 13/03/26 20:19:58 INFO cluster.SparkDeploySchedulerBackend: Registered executor: Actor[akka://sparkExecutor@ip-10-101-58-116.ec2.internal:60130/user/Executor] with ID 5 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-118-97-63.ec2.internal:34249 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-118-97-63.ec2.internal:48286 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-101-3-102.ec2.internal:56646 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-101-3-102.ec2.internal:44935 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-98-95-218.ec2.internal:40619 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-116-191-1.ec2.internal:36082 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-116-191-1.ec2.internal:57868 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-101-38-191.ec2.internal:60743 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-32-69-77.ec2.internal:53700 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-32-69-77.ec2.internal:37267 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-78-193-188.ec2.internal:54548 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-101-38-191.ec2.internal:44323 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-78-193-188.ec2.internal:59335 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-82-243-247.ec2.internal:47782 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-83-74-179.ec2.internal:37406 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-83-74-179.ec2.internal:35250 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-82-243-247.ec2.internal:34592 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-98-95-218.ec2.internal:57058 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-35-90-71.ec2.internal:42613 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-35-90-71.ec2.internal:55547 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-77-59-181.ec2.internal:58940 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-77-59-181.ec2.internal:58278 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-83-61-103.ec2.internal:52110 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-118-138-26.ec2.internal:48582 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-83-61-103.ec2.internal:47537 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-116-222-45.ec2.internal:51618 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-118-138-26.ec2.internal:56662 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-116-222-45.ec2.internal:45042 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-32-83-193.ec2.internal:32869 | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-80-14-64.ec2.internal:39600 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-80-14-64.ec2.internal:41160 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-32-83-193.ec2.internal:47190 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-80-189-211.ec2.internal:49007 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-80-189-211.ec2.internal:60765 with 4.0 GB RAM | |
| 13/03/26 20:19:58 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-101-58-116.ec2.internal:52747 | |
| 13/03/26 20:19:58 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-101-58-116.ec2.internal:47951 with 4.0 GB RAM | |
| 13/03/26 20:19:59 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://spark@ip-10-202-7-40.ec2.internal:58754 | |
| 13/03/26 20:19:59 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager ip-10-202-7-40.ec2.internal:55376 with 4.0 GB RAM | |
| 13/03/26 20:20:00 INFO storage.MemoryStore: ensureFreeSpace(58953) called with curMem=0, maxMem=339585269 | |
| 13/03/26 20:20:00 INFO storage.MemoryStore: Block broadcast_0 stored as values to memory (estimated size 57.6 KB, free 323.8 MB) | |
| 13/03/26 20:20:00 INFO spark.KryoSerializer: Running user registrator: com.bizo.fullfunnel.FullFunnelRegistrar | |
| 13/03/26 20:20:22 INFO storage.MemoryStore: ensureFreeSpace(68281) called with curMem=58953, maxMem=339585269 | |
| 13/03/26 20:20:22 INFO storage.MemoryStore: Block broadcast_1 stored as values to memory (estimated size 66.7 KB, free 323.7 MB) | |
| 13/03/26 20:20:22 INFO storage.MemoryStore: ensureFreeSpace(55873) called with curMem=127234, maxMem=339585269 | |
| 13/03/26 20:20:22 INFO storage.MemoryStore: Block broadcast_2 stored as values to memory (estimated size 54.6 KB, free 323.7 MB) | |
| 13/03/26 20:20:28 INFO storage.MemoryStore: ensureFreeSpace(68425) called with curMem=183107, maxMem=339585269 | |
| 13/03/26 20:20:28 INFO storage.MemoryStore: Block broadcast_3 stored as values to memory (estimated size 66.8 KB, free 323.6 MB) | |
| 13/03/26 20:20:28 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library | |
| 13/03/26 20:20:28 WARN lzo.LzoCodec: Could not find build properties file with revision hash | |
| 13/03/26 20:20:28 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev UNKNOWN] | |
| 13/03/26 20:20:28 WARN snappy.LoadSnappy: Snappy native library is available | |
| 13/03/26 20:20:28 INFO snappy.LoadSnappy: Snappy native library loaded | |
| 13/03/26 20:20:34 INFO mapred.FileInputFormat: Total input paths to process : 2086 | |
| 13/03/26 20:20:57 INFO mapred.FileInputFormat: Total input paths to process : 40065 | |
| 13/03/26 20:20:57 INFO rdd.CoGroupedRDD: Adding shuffle dependency with MappedRDD[18] at collect at VisitorAcquisitionReport.scala:73 | |
| 13/03/26 20:20:57 INFO rdd.CoGroupedRDD: Adding shuffle dependency with MappedRDD[19] at map at VisitorAcquisitionReport.scala:78 | |
| 13/03/26 20:20:58 INFO mapred.FileInputFormat: Total input paths to process : 34 | |
| 13/03/26 20:20:58 INFO rdd.CoGroupedRDD: Adding shuffle dependency with MappedRDD[24] at keyBy at VisitorAcquisitionReport.scala:87 | |
| 13/03/26 20:20:58 INFO rdd.CoGroupedRDD: Adding shuffle dependency with MappedRDD[25] at map at VisitorAcquisitionReport.scala:88 | |
| 13/03/26 20:21:12 INFO mapred.FileInputFormat: Total input paths to process : 4500 | |
| 13/03/26 20:21:12 INFO rdd.CoGroupedRDD: Adding shuffle dependency with MappedRDD[33] at collect at VisitorAcquisitionDebugJob.scala:56 | |
| 13/03/26 20:21:12 INFO rdd.CoGroupedRDD: Adding shuffle dependency with MappedRDD[34] at map at VisitorAcquisitionDebugJob.scala:59 | |
| 13/03/26 20:21:12 INFO fullfunnel.VisitorAcquisitionDebugJob$: RDD: ShuffledRDD[43] at ShuffledRDD at VisitorAcquisitionDebugJob.scala:46 (1 partitions) | |
| MappedRDD[42] at collect at VisitorAcquisitionDebugJob.scala:62 (40065 partitions) | |
| FilteredRDD[41] at collect at VisitorAcquisitionDebugJob.scala:62 (40065 partitions) | |
| MappedRDD[40] at values at VisitorAcquisitionDebugJob.scala:60 (40065 partitions) | |
| FlatMappedValuesRDD[39] at leftOuterJoin at VisitorAcquisitionDebugJob.scala:60 (40065 partitions) | |
| MappedValuesRDD[38] at leftOuterJoin at VisitorAcquisitionDebugJob.scala:60 (40065 partitions) | |
| CoGroupedRDD[37] at leftOuterJoin at VisitorAcquisitionDebugJob.scala:60 (40065 partitions) | |
| MapPartitionsRDD[44] at apply at TraversableLike.scala:233 (40065 partitions) | |
| MappedRDD[33] at collect at VisitorAcquisitionDebugJob.scala:56 (40065 partitions) | |
| FilteredRDD[32] at collect at VisitorAcquisitionDebugJob.scala:56 (40065 partitions) | |
| MappedRDD[31] at values at VisitorAcquisitionReport.scala:89 (40065 partitions) | |
| FlatMappedValuesRDD[30] at join at VisitorAcquisitionReport.scala:89 (40065 partitions) | |
| MappedValuesRDD[29] at join at VisitorAcquisitionReport.scala:89 (40065 partitions) | |
| CoGroupedRDD[28] at join at VisitorAcquisitionReport.scala:89 (40065 partitions) | |
| MapPartitionsRDD[35] at apply at TraversableLike.scala:233 (40065 partitions) | |
| MappedRDD[24] at keyBy at VisitorAcquisitionReport.scala:87 (40065 partitions) | |
| MappedRDD[23] at collect at VisitorAcquisitionReport.scala:80 (40065 partitions) | |
| FilteredRDD[22] at collect at VisitorAcquisitionReport.scala:80 (40065 partitions) | |
| MappedValuesRDD[21] at cogroup at VisitorAcquisitionReport.scala:80 (40065 partitions) | |
| CoGroupedRDD[20] at cogroup at VisitorAcquisitionReport.scala:80 (40065 partitions) | |
| MapPartitionsRDD[26] at apply at TraversableLike.scala:233 (2086 partitions) | |
| MappedRDD[18] at collect at VisitorAcquisitionReport.scala:73 (2086 partitions) | |
| FilteredRDD[17] at collect at VisitorAcquisitionReport.scala:73 (2086 partitions) | |
| MapPartitionsRDD[16] at groupByKey at VisitorAcquisitionReport.scala:73 (2086 partitions) | |
| ShuffledRDD[15] at groupByKey at VisitorAcquisitionReport.scala:73 (2086 partitions) | |
| MapPartitionsRDD[14] at groupByKey at VisitorAcquisitionReport.scala:73 (2086 partitions) | |
| FlatMappedRDD[13] at flatMap at VisitorAcquisitionReport.scala:65 (2086 partitions) | |
| FilteredRDD[12] at filter at VisitorAcquisitionReport.scala:65 (2086 partitions) | |
| MappedRDD[2] at map at DataCollectorLine.scala:44 (2086 partitions) | |
| MappedRDD[1] at textFile at AbstractLineObject.scala:25 (2086 partitions) | |
| HadoopRDD[0] at textFile at AbstractLineObject.scala:25 (2086 partitions) | |
| MapPartitionsRDD[27] at apply at TraversableLike.scala:233 (40065 partitions) | |
| MappedRDD[19] at map at VisitorAcquisitionReport.scala:78 (40065 partitions) | |
| MappedRDD[5] at map at FullFunnelDcSparseLine.scala:29 (40065 partitions) | |
| MappedRDD[4] at textFile at AbstractLineObject.scala:25 (40065 partitions) | |
| HadoopRDD[3] at textFile at AbstractLineObject.scala:25 (40065 partitions) | |
| MapPartitionsRDD[36] at apply at TraversableLike.scala:233 (34 partitions) | |
| MappedRDD[25] at map at VisitorAcquisitionReport.scala:88 (34 partitions) | |
| MappedRDD[8] at map at FanboyAppNexusMapping.scala:33 (34 partitions) | |
| MappedRDD[7] at textFile at AbstractLineObject.scala:25 (34 partitions) | |
| HadoopRDD[6] at textFile at AbstractLineObject.scala:25 (34 partitions) | |
| MapPartitionsRDD[45] at apply at TraversableLike.scala:233 (4500 partitions) | |
| MappedRDD[34] at map at VisitorAcquisitionDebugJob.scala:59 (4500 partitions) | |
| MappedRDD[11] at map at FullFunnelAnSparseLine.scala:41 (4500 partitions) | |
| MappedRDD[10] at textFile at AbstractLineObject.scala:25 (4500 partitions) | |
| HadoopRDD[9] at textFile at AbstractLineObject.scala:25 (4500 partitions) | |
| 13/03/26 20:21:12 INFO spark.PairRDDFunctions: Saving as hadoop file of type (NullWritable, Text) | |
| 13/03/26 20:21:13 INFO s3native.NativeS3FileSystem: Making dir 's3n://com-bizo-reports/full-funnel/visitor-acquisition/13-debug-dc-dec5-cogroup-nocoalesce' in S3 | |
| 13/03/26 20:21:13 INFO s3native.NativeS3FileSystem: Making dir 's3n://com-bizo-reports/full-funnel/visitor-acquisition/13-debug-dc-dec5-cogroup-nocoalesce/2013' in S3 | |
| 13/03/26 20:21:13 INFO s3native.NativeS3FileSystem: Making dir 's3n://com-bizo-reports/full-funnel/visitor-acquisition/13-debug-dc-dec5-cogroup-nocoalesce/2013/03' in S3 | |
| 13/03/26 20:21:13 INFO s3native.NativeS3FileSystem: Making dir 's3n://com-bizo-reports/full-funnel/visitor-acquisition/13-debug-dc-dec5-cogroup-nocoalesce/2013/03/04' in S3 | |
| 13/03/26 20:21:13 INFO s3native.NativeS3FileSystem: Making dir 's3n://com-bizo-reports/full-funnel/visitor-acquisition/13-debug-dc-dec5-cogroup-nocoalesce/2013/03/04/output' in S3 | |
| 13/03/26 20:21:13 INFO s3native.NativeS3FileSystem: Making dir 's3n://com-bizo-reports/full-funnel/visitor-acquisition/13-debug-dc-dec5-cogroup-nocoalesce/2013/03/04/output/_temporary' in S3 | |
| 13/03/26 20:21:13 INFO spark.SparkContext: Starting job: saveAsTextFile at VisitorAcquisitionDebugJob.scala:70 | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 42 (collect at VisitorAcquisitionDebugJob.scala:62) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 44 (apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 35 (apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 26 (apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 14 (groupByKey at VisitorAcquisitionReport.scala:73) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 27 (apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 36 (apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Registering RDD 45 (apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Got job 0 (saveAsTextFile at VisitorAcquisitionDebugJob.scala:70) with 1 output partitions (allowLocal=false) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Final stage: Stage 0 (saveAsTextFile at VisitorAcquisitionDebugJob.scala:70) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Parents of final stage: List(Stage 1) | |
| 13/03/26 20:21:13 INFO scheduler.DAGScheduler: Missing parents: List(Stage 1) | |
| 13/03/26 20:21:17 INFO scheduler.DAGScheduler: Submitting Stage 5 (MapPartitionsRDD[14] at groupByKey at VisitorAcquisitionReport.scala:73), which has no missing parents | |
| 13/03/26 20:21:17 INFO scheduler.DAGScheduler: Submitting 2086 missing tasks from Stage 5 (MapPartitionsRDD[14] at groupByKey at VisitorAcquisitionReport.scala:73) | |
| 13/03/26 20:21:17 INFO cluster.ClusterScheduler: Adding task set 5.0 with 2086 tasks | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:0 as TID 0 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:0 as 2397 bytes in 115 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:1 as TID 1 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:1 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:2 as TID 2 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:2 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:3 as TID 3 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:3 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:4 as TID 4 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:4 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:5 as TID 5 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:5 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:6 as TID 6 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:6 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:7 as TID 7 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:7 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:8 as TID 8 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:8 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:9 as TID 9 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:9 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:10 as TID 10 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:10 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:11 as TID 11 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:11 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:12 as TID 12 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:12 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:13 as TID 13 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:13 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:14 as TID 14 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:14 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:15 as TID 15 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:15 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:16 as TID 16 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:16 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:17 as TID 17 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:17 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:18 as TID 18 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:18 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:19 as TID 19 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:19 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:20 as TID 20 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:20 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:21 as TID 21 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:21 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:22 as TID 22 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:22 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:23 as TID 23 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:23 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:24 as TID 24 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:24 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:25 as TID 25 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:25 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:26 as TID 26 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:26 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:27 as TID 27 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:27 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:28 as TID 28 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:28 as 2405 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:29 as TID 29 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:29 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:30 as TID 30 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:30 as 2400 bytes in 7 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:31 as TID 31 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:31 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:32 as TID 32 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:32 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:33 as TID 33 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:33 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:34 as TID 34 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:34 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:35 as TID 35 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:35 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:36 as TID 36 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:36 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:37 as TID 37 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:37 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:38 as TID 38 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:38 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:39 as TID 39 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:39 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:40 as TID 40 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:40 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:41 as TID 41 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:41 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:42 as TID 42 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:42 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:43 as TID 43 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:43 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:44 as TID 44 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:44 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:45 as TID 45 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:45 as 2385 bytes in 5 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:46 as TID 46 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:46 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:47 as TID 47 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:47 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:48 as TID 48 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:48 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:49 as TID 49 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:49 as 2385 bytes in 1 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:50 as TID 50 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:50 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:51 as TID 51 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:51 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:52 as TID 52 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:52 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:53 as TID 53 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:53 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:54 as TID 54 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:54 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:55 as TID 55 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:55 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:56 as TID 56 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:56 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Starting task 5.0:57 as TID 57 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:17 INFO cluster.TaskSetManager: Serialized task 5.0:57 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:18 INFO scheduler.DAGScheduler: Submitting Stage 6 (MapPartitionsRDD[27] at apply at TraversableLike.scala:233), which has no missing parents | |
| 13/03/26 20:21:18 INFO scheduler.DAGScheduler: Submitting 40065 missing tasks from Stage 6 (MapPartitionsRDD[27] at apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:18 INFO cluster.ClusterScheduler: Adding task set 6.0 with 40065 tasks | |
| 13/03/26 20:21:19 INFO scheduler.DAGScheduler: Submitting Stage 7 (MapPartitionsRDD[36] at apply at TraversableLike.scala:233), which has no missing parents | |
| 13/03/26 20:21:19 INFO scheduler.DAGScheduler: Submitting 34 missing tasks from Stage 7 (MapPartitionsRDD[36] at apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:19 INFO cluster.ClusterScheduler: Adding task set 7.0 with 34 tasks | |
| 13/03/26 20:21:19 INFO scheduler.DAGScheduler: Submitting Stage 8 (MapPartitionsRDD[45] at apply at TraversableLike.scala:233), which has no missing parents | |
| 13/03/26 20:21:19 INFO scheduler.DAGScheduler: Submitting 4500 missing tasks from Stage 8 (MapPartitionsRDD[45] at apply at TraversableLike.scala:233) | |
| 13/03/26 20:21:19 INFO cluster.ClusterScheduler: Adding task set 8.0 with 4500 tasks | |
| 13/03/26 20:21:21 INFO cluster.TaskSetManager: Finished TID 46 in 3664 ms (progress: 1/2086) | |
| 13/03/26 20:21:21 INFO cluster.TaskSetManager: Starting task 5.0:58 as TID 58 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:21 INFO cluster.TaskSetManager: Serialized task 5.0:58 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 46) | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Finished TID 57 in 4399 ms (progress: 2/2086) | |
| 13/03/26 20:21:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 57) | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Starting task 5.0:59 as TID 59 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Serialized task 5.0:59 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Finished TID 22 in 4592 ms (progress: 3/2086) | |
| 13/03/26 20:21:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 22) | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Starting task 5.0:60 as TID 60 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Serialized task 5.0:60 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Finished TID 51 in 4563 ms (progress: 4/2086) | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Starting task 5.0:61 as TID 61 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:22 INFO cluster.TaskSetManager: Serialized task 5.0:61 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 51) | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Finished TID 5 in 5903 ms (progress: 5/2086) | |
| 13/03/26 20:21:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 5) | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Starting task 5.0:62 as TID 62 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Serialized task 5.0:62 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Finished TID 52 in 5890 ms (progress: 6/2086) | |
| 13/03/26 20:21:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 52) | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Starting task 5.0:63 as TID 63 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Serialized task 5.0:63 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Finished TID 17 in 6142 ms (progress: 7/2086) | |
| 13/03/26 20:21:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 17) | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Starting task 5.0:64 as TID 64 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:23 INFO cluster.TaskSetManager: Serialized task 5.0:64 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:24 INFO cluster.TaskSetManager: Finished TID 34 in 6484 ms (progress: 8/2086) | |
| 13/03/26 20:21:24 INFO cluster.TaskSetManager: Starting task 5.0:65 as TID 65 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:24 INFO cluster.TaskSetManager: Serialized task 5.0:65 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 34) | |
| 13/03/26 20:21:24 INFO cluster.TaskSetManager: Finished TID 32 in 6518 ms (progress: 9/2086) | |
| 13/03/26 20:21:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 32) | |
| 13/03/26 20:21:24 INFO cluster.TaskSetManager: Starting task 5.0:66 as TID 66 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:24 INFO cluster.TaskSetManager: Serialized task 5.0:66 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:25 INFO cluster.TaskSetManager: Finished TID 11 in 7875 ms (progress: 10/2086) | |
| 13/03/26 20:21:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 11) | |
| 13/03/26 20:21:25 INFO cluster.TaskSetManager: Starting task 5.0:67 as TID 67 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:25 INFO cluster.TaskSetManager: Serialized task 5.0:67 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:25 INFO cluster.TaskSetManager: Finished TID 55 in 7820 ms (progress: 11/2086) | |
| 13/03/26 20:21:25 INFO cluster.TaskSetManager: Starting task 5.0:68 as TID 68 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 55) | |
| 13/03/26 20:21:25 INFO cluster.TaskSetManager: Serialized task 5.0:68 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Finished TID 41 in 8602 ms (progress: 12/2086) | |
| 13/03/26 20:21:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 41) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Starting task 5.0:69 as TID 69 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Serialized task 5.0:69 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Finished TID 48 in 8685 ms (progress: 13/2086) | |
| 13/03/26 20:21:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 48) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Starting task 5.0:70 as TID 70 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Serialized task 5.0:70 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Finished TID 4 in 8815 ms (progress: 14/2086) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Starting task 5.0:71 as TID 71 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Serialized task 5.0:71 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 4) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Finished TID 14 in 9123 ms (progress: 15/2086) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Starting task 5.0:72 as TID 72 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Serialized task 5.0:72 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Finished TID 43 in 9082 ms (progress: 16/2086) | |
| 13/03/26 20:21:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 14) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Starting task 5.0:73 as TID 73 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:26 INFO cluster.TaskSetManager: Serialized task 5.0:73 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 43) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Finished TID 9 in 9566 ms (progress: 17/2086) | |
| 13/03/26 20:21:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 9) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Starting task 5.0:74 as TID 74 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Serialized task 5.0:74 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Finished TID 23 in 9692 ms (progress: 18/2086) | |
| 13/03/26 20:21:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 23) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Starting task 5.0:75 as TID 75 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Serialized task 5.0:75 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Finished TID 47 in 9662 ms (progress: 19/2086) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Starting task 5.0:76 as TID 76 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Serialized task 5.0:76 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 47) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Finished TID 18 in 9816 ms (progress: 20/2086) | |
| 13/03/26 20:21:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 18) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Starting task 5.0:77 as TID 77 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Serialized task 5.0:77 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Finished TID 0 in 10356 ms (progress: 21/2086) | |
| 13/03/26 20:21:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 0) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Starting task 5.0:78 as TID 78 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:27 INFO cluster.TaskSetManager: Serialized task 5.0:78 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 54 in 10596 ms (progress: 22/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 54) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:79 as TID 79 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:79 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 7 in 10734 ms (progress: 23/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 7) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:80 as TID 80 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:80 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 19 in 10894 ms (progress: 24/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 19) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:81 as TID 81 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:81 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 58 in 7192 ms (progress: 25/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 58) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:82 as TID 82 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:82 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 33 in 10886 ms (progress: 26/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 33) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:83 as TID 83 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:83 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 6 in 11033 ms (progress: 27/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 6) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:84 as TID 84 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:84 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 13 in 11047 ms (progress: 28/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 13) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:85 as TID 85 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:85 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 2 in 11097 ms (progress: 29/2086) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:86 as TID 86 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:86 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 26 in 11077 ms (progress: 30/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 26) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:87 as TID 87 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:87 as 2405 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 3 in 11108 ms (progress: 31/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 3) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:88 as TID 88 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:88 as 2405 bytes in 1 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 56 in 11092 ms (progress: 32/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 56) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:89 as TID 89 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:89 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Finished TID 53 in 11103 ms (progress: 33/2086) | |
| 13/03/26 20:21:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 53) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Starting task 5.0:90 as TID 90 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:28 INFO cluster.TaskSetManager: Serialized task 5.0:90 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 20 in 11243 ms (progress: 34/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 20) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:91 as TID 91 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:91 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 24 in 11242 ms (progress: 35/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 24) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:92 as TID 92 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:92 as 2399 bytes in 3 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 63 in 5427 ms (progress: 36/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 63) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:93 as TID 93 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:93 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 12 in 11473 ms (progress: 37/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 12) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:94 as TID 94 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:94 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 42 in 11455 ms (progress: 38/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 42) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:95 as TID 95 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:95 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 49 in 11493 ms (progress: 39/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 49) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:96 as TID 96 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:96 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 15 in 11579 ms (progress: 40/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 15) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:97 as TID 97 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:97 as 2369 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 21 in 11588 ms (progress: 41/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 21) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:98 as TID 98 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:98 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 44 in 11564 ms (progress: 42/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 44) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:99 as TID 99 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:99 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 31 in 11881 ms (progress: 43/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 31) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:100 as TID 100 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:100 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 59 in 7737 ms (progress: 44/2086) | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 59) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:101 as TID 101 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:101 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 1 in 12219 ms (progress: 45/2086) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:102 as TID 102 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:102 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Finished TID 64 in 6067 ms (progress: 46/2086) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Starting task 5.0:103 as TID 103 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:29 INFO cluster.TaskSetManager: Serialized task 5.0:103 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 64) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 50 in 12268 ms (progress: 47/2086) | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 50) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:104 as TID 104 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:104 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 16 in 12364 ms (progress: 48/2086) | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 16) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:105 as TID 105 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:105 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 97 in 974 ms (progress: 49/2086) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:106 as TID 106 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:106 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 97) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 62 in 6685 ms (progress: 50/2086) | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 62) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:107 as TID 107 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:107 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 45 in 12540 ms (progress: 51/2086) | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 45) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:108 as TID 108 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:108 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 10 in 12597 ms (progress: 52/2086) | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 10) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:109 as TID 109 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:109 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 65 in 6151 ms (progress: 53/2086) | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 65) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:110 as TID 110 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:110 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 29 in 12859 ms (progress: 54/2086) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:111 as TID 111 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:111 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 29) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Finished TID 39 in 12946 ms (progress: 55/2086) | |
| 13/03/26 20:21:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 39) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Starting task 5.0:112 as TID 112 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:30 INFO cluster.TaskSetManager: Serialized task 5.0:112 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 99 in 1750 ms (progress: 56/2086) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:113 as TID 113 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:113 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 99) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 70 in 4700 ms (progress: 57/2086) | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 70) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:114 as TID 114 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:114 as 2385 bytes in 1 ms | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 80 in 2828 ms (progress: 58/2086) | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 80) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:115 as TID 115 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:115 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 75 in 3856 ms (progress: 59/2086) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:116 as TID 116 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:116 as 2385 bytes in 1 ms | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 75) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 96 in 2014 ms (progress: 60/2086) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:117 as TID 117 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:117 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 96) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 86 in 2525 ms (progress: 61/2086) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:118 as TID 118 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:118 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 86) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 71 in 5132 ms (progress: 62/2086) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:119 as TID 119 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:119 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 71) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 101 in 1740 ms (progress: 63/2086) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:120 as TID 120 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:120 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 101) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 103 in 1862 ms (progress: 64/2086) | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 103) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:121 as TID 121 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:121 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 66 in 7577 ms (progress: 65/2086) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:122 as TID 122 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 66) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:122 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 40 in 14092 ms (progress: 66/2086) | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 40) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:123 as TID 123 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:123 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Finished TID 69 in 5529 ms (progress: 67/2086) | |
| 13/03/26 20:21:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 69) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Starting task 5.0:124 as TID 124 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:31 INFO cluster.TaskSetManager: Serialized task 5.0:124 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 119 in 463 ms (progress: 68/2086) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:125 as TID 125 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:125 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 119) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 73 in 5308 ms (progress: 69/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 73) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:126 as TID 126 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:126 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 30 in 14453 ms (progress: 70/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 30) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:127 as TID 127 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:127 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 105 in 2126 ms (progress: 71/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 105) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:128 as TID 128 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:128 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 72 in 5397 ms (progress: 72/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 72) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:129 as TID 129 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:129 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 60 in 10068 ms (progress: 73/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 60) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:130 as TID 130 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:130 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 88 in 3662 ms (progress: 74/2086) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:131 as TID 131 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:131 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 88) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 92 in 3574 ms (progress: 75/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 92) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:132 as TID 132 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:132 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 61 in 10271 ms (progress: 76/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 61) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:133 as TID 133 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:133 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 121 in 968 ms (progress: 77/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 121) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:134 as TID 134 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:134 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 35 in 15074 ms (progress: 78/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 35) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:135 as TID 135 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:135 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 8 in 15176 ms (progress: 79/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 8) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:136 as TID 136 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:136 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 74 in 5656 ms (progress: 80/2086) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:137 as TID 137 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:137 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 74) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Finished TID 36 in 15192 ms (progress: 81/2086) | |
| 13/03/26 20:21:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 36) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Starting task 5.0:138 as TID 138 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:32 INFO cluster.TaskSetManager: Serialized task 5.0:138 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:33 INFO cluster.TaskSetManager: Finished TID 112 in 2836 ms (progress: 82/2086) | |
| 13/03/26 20:21:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 112) | |
| 13/03/26 20:21:33 INFO cluster.TaskSetManager: Starting task 5.0:139 as TID 139 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:33 INFO cluster.TaskSetManager: Serialized task 5.0:139 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 76 in 6529 ms (progress: 83/2086) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 76) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:140 as TID 140 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:140 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 78 in 6186 ms (progress: 84/2086) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 78) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:141 as TID 141 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:141 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 77 in 6646 ms (progress: 85/2086) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 77) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:142 as TID 142 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:142 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 83 in 5555 ms (progress: 86/2086) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 83) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:143 as TID 143 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:143 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 28 in 16578 ms (progress: 87/2086) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 28) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:144 as TID 144 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:144 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 25 in 16745 ms (progress: 88/2086) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 25) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:145 as TID 145 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:145 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 94 in 5471 ms (progress: 89/2086) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:146 as TID 146 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 94) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:146 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Finished TID 117 in 3444 ms (progress: 90/2086) | |
| 13/03/26 20:21:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 117) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Starting task 5.0:147 as TID 147 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:34 INFO cluster.TaskSetManager: Serialized task 5.0:147 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Finished TID 110 in 4571 ms (progress: 91/2086) | |
| 13/03/26 20:21:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 110) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Starting task 5.0:148 as TID 148 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Serialized task 5.0:148 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Finished TID 84 in 6433 ms (progress: 92/2086) | |
| 13/03/26 20:21:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 84) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Starting task 5.0:149 as TID 149 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Serialized task 5.0:149 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Finished TID 82 in 6783 ms (progress: 93/2086) | |
| 13/03/26 20:21:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 82) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Starting task 5.0:150 as TID 150 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Serialized task 5.0:150 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Finished TID 114 in 4272 ms (progress: 94/2086) | |
| 13/03/26 20:21:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 114) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Starting task 5.0:151 as TID 151 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Serialized task 5.0:151 as 2404 bytes in 1 ms | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Finished TID 90 in 6740 ms (progress: 95/2086) | |
| 13/03/26 20:21:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 90) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Starting task 5.0:152 as TID 152 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Serialized task 5.0:152 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Finished TID 116 in 4509 ms (progress: 96/2086) | |
| 13/03/26 20:21:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 116) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Starting task 5.0:153 as TID 153 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:35 INFO cluster.TaskSetManager: Serialized task 5.0:153 as 2405 bytes in 0 ms | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Finished TID 79 in 7623 ms (progress: 97/2086) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Starting task 5.0:154 as TID 154 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Serialized task 5.0:154 as 2405 bytes in 0 ms | |
| 13/03/26 20:21:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 79) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Finished TID 149 in 1133 ms (progress: 98/2086) | |
| 13/03/26 20:21:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 149) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Starting task 5.0:155 as TID 155 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Serialized task 5.0:155 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Finished TID 111 in 6037 ms (progress: 99/2086) | |
| 13/03/26 20:21:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 111) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Starting task 5.0:156 as TID 156 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Serialized task 5.0:156 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Finished TID 67 in 11062 ms (progress: 100/2086) | |
| 13/03/26 20:21:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 67) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Starting task 5.0:157 as TID 157 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Serialized task 5.0:157 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Finished TID 108 in 6435 ms (progress: 101/2086) | |
| 13/03/26 20:21:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 108) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Starting task 5.0:158 as TID 158 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Serialized task 5.0:158 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Finished TID 144 in 2445 ms (progress: 102/2086) | |
| 13/03/26 20:21:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 144) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Starting task 5.0:159 as TID 159 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Serialized task 5.0:159 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Finished TID 109 in 6469 ms (progress: 103/2086) | |
| 13/03/26 20:21:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 109) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Starting task 5.0:160 as TID 160 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:36 INFO cluster.TaskSetManager: Serialized task 5.0:160 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 107 in 6925 ms (progress: 104/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 107) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:161 as TID 161 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:161 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 127 in 5124 ms (progress: 105/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 127) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:162 as TID 162 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:162 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 133 in 4711 ms (progress: 106/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 133) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:163 as TID 163 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:163 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 81 in 8708 ms (progress: 107/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 81) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:164 as TID 164 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:164 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 129 in 5173 ms (progress: 108/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 129) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:165 as TID 165 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:165 as 2400 bytes in 1 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 37 in 19664 ms (progress: 109/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 37) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:166 as TID 166 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:166 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 126 in 5278 ms (progress: 110/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 126) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:167 as TID 167 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:167 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 118 in 6294 ms (progress: 111/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 118) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:168 as TID 168 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:168 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 137 in 4696 ms (progress: 112/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 137) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:169 as TID 169 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:169 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 150 in 2381 ms (progress: 113/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 150) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:170 as TID 170 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:170 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Finished TID 93 in 8746 ms (progress: 114/2086) | |
| 13/03/26 20:21:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 93) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Starting task 5.0:171 as TID 171 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:37 INFO cluster.TaskSetManager: Serialized task 5.0:171 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 125 in 5931 ms (progress: 115/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 125) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:172 as TID 172 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:172 as 2398 bytes in 1 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 115 in 6836 ms (progress: 116/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 115) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:173 as TID 173 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:173 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 123 in 6420 ms (progress: 117/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 123) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:174 as TID 174 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:174 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 134 in 5618 ms (progress: 118/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 134) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:175 as TID 175 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:175 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 122 in 6614 ms (progress: 119/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 122) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:176 as TID 176 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:176 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 124 in 6569 ms (progress: 120/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 124) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:177 as TID 177 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:177 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 159 in 1743 ms (progress: 121/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 159) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:178 as TID 178 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:178 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 27 in 20810 ms (progress: 122/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 27) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:179 as TID 179 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:179 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 158 in 1836 ms (progress: 123/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 158) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:180 as TID 180 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:180 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 68 in 13155 ms (progress: 124/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 68) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:181 as TID 181 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:181 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 120 in 7113 ms (progress: 125/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 120) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:182 as TID 182 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:182 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 139 in 5322 ms (progress: 126/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 139) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:183 as TID 183 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:183 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 131 in 6405 ms (progress: 127/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 131) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:184 as TID 184 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:184 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 132 in 6365 ms (progress: 128/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 132) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:185 as TID 185 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:185 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Finished TID 113 in 7850 ms (progress: 129/2086) | |
| 13/03/26 20:21:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 113) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Starting task 5.0:186 as TID 186 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:38 INFO cluster.TaskSetManager: Serialized task 5.0:186 as 2385 bytes in 1 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 165 in 1551 ms (progress: 130/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 165) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:187 as TID 187 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:187 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 154 in 3072 ms (progress: 131/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 154) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:188 as TID 188 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:188 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 135 in 6265 ms (progress: 132/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 135) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:189 as TID 189 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:189 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 169 in 1541 ms (progress: 133/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 169) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:190 as TID 190 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:190 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 166 in 1763 ms (progress: 134/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 166) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:191 as TID 191 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:191 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 155 in 2910 ms (progress: 135/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 155) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:192 as TID 192 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:192 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 168 in 1765 ms (progress: 136/2086) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:193 as TID 193 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:193 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 168) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 102 in 9494 ms (progress: 137/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 102) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:194 as TID 194 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:194 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 160 in 2651 ms (progress: 138/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 160) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:195 as TID 195 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:195 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 152 in 3917 ms (progress: 139/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 152) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:196 as TID 196 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:196 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 141 in 5466 ms (progress: 140/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 141) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:197 as TID 197 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:197 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 171 in 1758 ms (progress: 141/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 171) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:198 as TID 198 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:198 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 143 in 5529 ms (progress: 142/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 143) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:199 as TID 199 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:199 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 140 in 5782 ms (progress: 143/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 140) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:200 as TID 200 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:200 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Finished TID 175 in 1540 ms (progress: 144/2086) | |
| 13/03/26 20:21:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 175) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Starting task 5.0:201 as TID 201 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:39 INFO cluster.TaskSetManager: Serialized task 5.0:201 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 130 in 7654 ms (progress: 145/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 130) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:202 as TID 202 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:202 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 182 in 1293 ms (progress: 146/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 182) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:203 as TID 203 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:203 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 138 in 7272 ms (progress: 147/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 138) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:204 as TID 204 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:204 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 142 in 6204 ms (progress: 148/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 142) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:205 as TID 205 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:205 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 181 in 1682 ms (progress: 149/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 181) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:206 as TID 206 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:206 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 128 in 8282 ms (progress: 150/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 128) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:207 as TID 207 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:207 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 176 in 2088 ms (progress: 151/2086) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:208 as TID 208 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 176) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:208 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 173 in 2479 ms (progress: 152/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 173) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:209 as TID 209 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:209 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 187 in 1914 ms (progress: 153/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 187) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:210 as TID 210 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:210 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 148 in 5940 ms (progress: 154/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 148) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:211 as TID 211 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:211 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Finished TID 87 in 12108 ms (progress: 155/2086) | |
| 13/03/26 20:21:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 87) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Starting task 5.0:212 as TID 212 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:40 INFO cluster.TaskSetManager: Serialized task 5.0:212 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Finished TID 145 in 6506 ms (progress: 156/2086) | |
| 13/03/26 20:21:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 145) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Starting task 5.0:213 as TID 213 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Serialized task 5.0:213 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Finished TID 178 in 2647 ms (progress: 157/2086) | |
| 13/03/26 20:21:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 178) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Starting task 5.0:214 as TID 214 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Serialized task 5.0:214 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Finished TID 147 in 6699 ms (progress: 158/2086) | |
| 13/03/26 20:21:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 147) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Starting task 5.0:215 as TID 215 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Serialized task 5.0:215 as 2404 bytes in 1 ms | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Finished TID 162 in 4186 ms (progress: 159/2086) | |
| 13/03/26 20:21:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 162) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Starting task 5.0:216 as TID 216 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Serialized task 5.0:216 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Finished TID 146 in 6875 ms (progress: 160/2086) | |
| 13/03/26 20:21:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 146) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Starting task 5.0:217 as TID 217 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:41 INFO cluster.TaskSetManager: Serialized task 5.0:217 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Finished TID 164 in 4854 ms (progress: 161/2086) | |
| 13/03/26 20:21:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 164) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Starting task 5.0:218 as TID 218 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Serialized task 5.0:218 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Finished TID 100 in 12638 ms (progress: 162/2086) | |
| 13/03/26 20:21:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 100) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Starting task 5.0:219 as TID 219 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Serialized task 5.0:219 as 2404 bytes in 1 ms | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Finished TID 192 in 3454 ms (progress: 163/2086) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Starting task 5.0:220 as TID 220 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Serialized task 5.0:220 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 192) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Finished TID 210 in 1934 ms (progress: 164/2086) | |
| 13/03/26 20:21:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 210) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Starting task 5.0:221 as TID 221 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:42 INFO cluster.TaskSetManager: Serialized task 5.0:221 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Finished TID 204 in 2839 ms (progress: 165/2086) | |
| 13/03/26 20:21:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 204) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Starting task 5.0:222 as TID 222 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Serialized task 5.0:222 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Finished TID 209 in 2859 ms (progress: 166/2086) | |
| 13/03/26 20:21:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 209) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Starting task 5.0:223 as TID 223 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Serialized task 5.0:223 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Finished TID 211 in 2575 ms (progress: 167/2086) | |
| 13/03/26 20:21:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 211) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Starting task 5.0:224 as TID 224 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Serialized task 5.0:224 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Finished TID 195 in 4269 ms (progress: 168/2086) | |
| 13/03/26 20:21:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 195) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Starting task 5.0:225 as TID 225 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Serialized task 5.0:225 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Finished TID 180 in 5144 ms (progress: 169/2086) | |
| 13/03/26 20:21:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 180) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Starting task 5.0:226 as TID 226 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Serialized task 5.0:226 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Finished TID 199 in 4163 ms (progress: 170/2086) | |
| 13/03/26 20:21:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 199) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Starting task 5.0:227 as TID 227 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:43 INFO cluster.TaskSetManager: Serialized task 5.0:227 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Finished TID 153 in 8272 ms (progress: 171/2086) | |
| 13/03/26 20:21:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 153) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Starting task 5.0:228 as TID 228 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Serialized task 5.0:228 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Finished TID 198 in 4523 ms (progress: 172/2086) | |
| 13/03/26 20:21:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 198) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Starting task 5.0:229 as TID 229 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Serialized task 5.0:229 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Finished TID 190 in 5488 ms (progress: 173/2086) | |
| 13/03/26 20:21:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 190) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Starting task 5.0:230 as TID 230 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Serialized task 5.0:230 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Finished TID 201 in 4764 ms (progress: 174/2086) | |
| 13/03/26 20:21:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 201) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Starting task 5.0:231 as TID 231 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Serialized task 5.0:231 as 2400 bytes in 1 ms | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Finished TID 203 in 4639 ms (progress: 175/2086) | |
| 13/03/26 20:21:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 203) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Starting task 5.0:232 as TID 232 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Serialized task 5.0:232 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Finished TID 212 in 3846 ms (progress: 176/2086) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Starting task 5.0:233 as TID 233 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Serialized task 5.0:233 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 212) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Finished TID 157 in 8238 ms (progress: 177/2086) | |
| 13/03/26 20:21:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 157) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Starting task 5.0:234 as TID 234 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:44 INFO cluster.TaskSetManager: Serialized task 5.0:234 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 193 in 5701 ms (progress: 178/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 193) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:235 as TID 235 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:235 as 2400 bytes in 1 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 216 in 3615 ms (progress: 179/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 216) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:236 as TID 236 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:236 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 226 in 1445 ms (progress: 180/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 226) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:237 as TID 237 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:237 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 98 in 15851 ms (progress: 181/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 98) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:238 as TID 238 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:238 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 194 in 5986 ms (progress: 182/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 194) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:239 as TID 239 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:239 as 2400 bytes in 1 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 217 in 3954 ms (progress: 183/2086) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:240 as TID 240 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:240 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 217) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 228 in 1550 ms (progress: 184/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 228) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:241 as TID 241 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:241 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 197 in 6200 ms (progress: 185/2086) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:242 as TID 242 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:242 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 197) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 202 in 5883 ms (progress: 186/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 202) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:243 as TID 243 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:243 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 151 in 10520 ms (progress: 187/2086) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:244 as TID 244 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:244 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 151) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Finished TID 200 in 6212 ms (progress: 188/2086) | |
| 13/03/26 20:21:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 200) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Starting task 5.0:245 as TID 245 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:45 INFO cluster.TaskSetManager: Serialized task 5.0:245 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 104 in 16063 ms (progress: 189/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 104) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:246 as TID 246 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:246 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 208 in 5576 ms (progress: 190/2086) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:247 as TID 247 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:247 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 208) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 184 in 7241 ms (progress: 191/2086) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:248 as TID 248 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:248 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 184) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 185 in 7477 ms (progress: 192/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 185) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:249 as TID 249 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:249 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 91 in 17424 ms (progress: 193/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 91) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:250 as TID 250 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:250 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 189 in 7301 ms (progress: 194/2086) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:251 as TID 251 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:251 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 189) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 38 in 28640 ms (progress: 195/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 38) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:252 as TID 252 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:252 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 183 in 7548 ms (progress: 196/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 183) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:253 as TID 253 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:253 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 231 in 1738 ms (progress: 197/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 231) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:254 as TID 254 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:254 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 240 in 1042 ms (progress: 198/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 240) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:255 as TID 255 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:255 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 215 in 5201 ms (progress: 199/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 215) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:256 as TID 256 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:256 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 213 in 5671 ms (progress: 200/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 213) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:257 as TID 257 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:257 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 233 in 2035 ms (progress: 201/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 233) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:258 as TID 258 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:258 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 241 in 1200 ms (progress: 202/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 241) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:259 as TID 259 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:259 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 196 in 7308 ms (progress: 203/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 196) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:260 as TID 260 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:260 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 239 in 1459 ms (progress: 204/2086) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:261 as TID 261 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:261 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 239) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 205 in 6477 ms (progress: 205/2086) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:262 as TID 262 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:262 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 205) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Finished TID 242 in 1089 ms (progress: 206/2086) | |
| 13/03/26 20:21:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 242) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Starting task 5.0:263 as TID 263 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:46 INFO cluster.TaskSetManager: Serialized task 5.0:263 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 219 in 4824 ms (progress: 207/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 219) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:264 as TID 264 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:264 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 161 in 9924 ms (progress: 208/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 161) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:265 as TID 265 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:265 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 85 in 18574 ms (progress: 209/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 85) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:266 as TID 266 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:266 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 172 in 9429 ms (progress: 210/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 172) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:267 as TID 267 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:267 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 186 in 8564 ms (progress: 211/2086) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:268 as TID 268 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:268 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 186) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 188 in 8424 ms (progress: 212/2086) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:269 as TID 269 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:269 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 188) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 167 in 10083 ms (progress: 213/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 167) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:270 as TID 270 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:270 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 253 in 1119 ms (progress: 214/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 253) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:271 as TID 271 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:271 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 254 in 1169 ms (progress: 215/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 254) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:272 as TID 272 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:272 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 237 in 2475 ms (progress: 216/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 237) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:273 as TID 273 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:273 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 257 in 1114 ms (progress: 217/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 257) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:274 as TID 274 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:274 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Finished TID 255 in 1375 ms (progress: 218/2086) | |
| 13/03/26 20:21:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 255) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Starting task 5.0:275 as TID 275 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:47 INFO cluster.TaskSetManager: Serialized task 5.0:275 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Finished TID 267 in 903 ms (progress: 219/2086) | |
| 13/03/26 20:21:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 267) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Starting task 5.0:276 as TID 276 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Serialized task 5.0:276 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Finished TID 174 in 10143 ms (progress: 220/2086) | |
| 13/03/26 20:21:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 174) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Starting task 5.0:277 as TID 277 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Serialized task 5.0:277 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Finished TID 238 in 3356 ms (progress: 221/2086) | |
| 13/03/26 20:21:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 238) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Starting task 5.0:278 as TID 278 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Serialized task 5.0:278 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Finished TID 256 in 1986 ms (progress: 222/2086) | |
| 13/03/26 20:21:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 256) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Starting task 5.0:279 as TID 279 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:48 INFO cluster.TaskSetManager: Serialized task 5.0:279 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Finished TID 177 in 10658 ms (progress: 223/2086) | |
| 13/03/26 20:21:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 177) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Starting task 5.0:280 as TID 280 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Serialized task 5.0:280 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Finished TID 136 in 16683 ms (progress: 224/2086) | |
| 13/03/26 20:21:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 136) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Starting task 5.0:281 as TID 281 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Serialized task 5.0:281 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Finished TID 207 in 9157 ms (progress: 225/2086) | |
| 13/03/26 20:21:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 207) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Starting task 5.0:282 as TID 282 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Serialized task 5.0:282 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Finished TID 206 in 9421 ms (progress: 226/2086) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Starting task 5.0:283 as TID 283 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:49 INFO cluster.TaskSetManager: Serialized task 5.0:283 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 206) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Finished TID 218 in 7878 ms (progress: 227/2086) | |
| 13/03/26 20:21:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 218) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Starting task 5.0:284 as TID 284 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Serialized task 5.0:284 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Finished TID 170 in 12443 ms (progress: 228/2086) | |
| 13/03/26 20:21:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 170) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Starting task 5.0:285 as TID 285 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Serialized task 5.0:285 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Finished TID 244 in 4667 ms (progress: 229/2086) | |
| 13/03/26 20:21:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 244) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Starting task 5.0:286 as TID 286 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Serialized task 5.0:286 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Finished TID 106 in 20356 ms (progress: 230/2086) | |
| 13/03/26 20:21:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 106) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Starting task 5.0:287 as TID 287 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Serialized task 5.0:287 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Finished TID 275 in 2778 ms (progress: 231/2086) | |
| 13/03/26 20:21:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 275) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Starting task 5.0:288 as TID 288 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Serialized task 5.0:288 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Finished TID 271 in 3199 ms (progress: 232/2086) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Starting task 5.0:289 as TID 289 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Serialized task 5.0:289 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 271) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Finished TID 220 in 8200 ms (progress: 233/2086) | |
| 13/03/26 20:21:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 220) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Starting task 5.0:290 as TID 290 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:50 INFO cluster.TaskSetManager: Serialized task 5.0:290 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Finished TID 252 in 4682 ms (progress: 234/2086) | |
| 13/03/26 20:21:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 252) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Starting task 5.0:291 as TID 291 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Serialized task 5.0:291 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Finished TID 224 in 7626 ms (progress: 235/2086) | |
| 13/03/26 20:21:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 224) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Starting task 5.0:292 as TID 292 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Serialized task 5.0:292 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Finished TID 259 in 4550 ms (progress: 236/2086) | |
| 13/03/26 20:21:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 259) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Starting task 5.0:293 as TID 293 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Serialized task 5.0:293 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Finished TID 247 in 5340 ms (progress: 237/2086) | |
| 13/03/26 20:21:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 247) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Starting task 5.0:294 as TID 294 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Serialized task 5.0:294 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Finished TID 290 in 866 ms (progress: 238/2086) | |
| 13/03/26 20:21:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 290) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Starting task 5.0:295 as TID 295 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Serialized task 5.0:295 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Finished TID 221 in 8991 ms (progress: 239/2086) | |
| 13/03/26 20:21:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 221) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Starting task 5.0:296 as TID 296 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Serialized task 5.0:296 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Finished TID 293 in 534 ms (progress: 240/2086) | |
| 13/03/26 20:21:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 293) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Starting task 5.0:297 as TID 297 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:51 INFO cluster.TaskSetManager: Serialized task 5.0:297 as 2400 bytes in 1 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 248 in 5843 ms (progress: 241/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 248) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:298 as TID 298 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:298 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 229 in 7853 ms (progress: 242/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 229) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:299 as TID 299 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:299 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 245 in 6021 ms (progress: 243/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 245) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:300 as TID 300 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:300 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 263 in 5119 ms (progress: 244/2086) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:301 as TID 301 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:301 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 263) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 261 in 5254 ms (progress: 245/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 261) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:302 as TID 302 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:302 as 2385 bytes in 1 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 243 in 6222 ms (progress: 246/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 243) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:303 as TID 303 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:303 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 251 in 5781 ms (progress: 247/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 251) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:304 as TID 304 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:304 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 264 in 5221 ms (progress: 248/2086) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:305 as TID 305 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 264) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:305 as 2386 bytes in 2 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 249 in 5958 ms (progress: 249/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 249) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:306 as TID 306 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:306 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 262 in 5512 ms (progress: 250/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 262) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:307 as TID 307 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:307 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 279 in 3773 ms (progress: 251/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 279) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:308 as TID 308 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:308 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 270 in 4916 ms (progress: 252/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 270) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:309 as TID 309 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:309 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 272 in 4962 ms (progress: 253/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 272) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:310 as TID 310 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:310 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 223 in 9303 ms (progress: 254/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 223) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:311 as TID 311 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:311 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 260 in 6006 ms (progress: 255/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 260) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:312 as TID 312 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:312 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 235 in 7769 ms (progress: 256/2086) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:313 as TID 313 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 235) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:313 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Finished TID 89 in 24030 ms (progress: 257/2086) | |
| 13/03/26 20:21:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 89) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Starting task 5.0:314 as TID 314 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:21:52 INFO cluster.TaskSetManager: Serialized task 5.0:314 as 2384 bytes in 1 ms | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 276 in 4729 ms (progress: 258/2086) | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 276) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:315 as TID 315 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:315 as 2385 bytes in 1 ms | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 265 in 6110 ms (progress: 259/2086) | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 265) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:316 as TID 316 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:316 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 214 in 12159 ms (progress: 260/2086) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:317 as TID 317 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:317 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 214) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 266 in 6017 ms (progress: 261/2086) | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 266) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:318 as TID 318 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:318 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 273 in 5830 ms (progress: 262/2086) | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 273) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:319 as TID 319 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:319 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 269 in 6028 ms (progress: 263/2086) | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 269) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:320 as TID 320 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:320 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 250 in 7228 ms (progress: 264/2086) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:321 as TID 321 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:321 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 250) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 163 in 16365 ms (progress: 265/2086) | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 163) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:322 as TID 322 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:322 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Finished TID 274 in 6016 ms (progress: 266/2086) | |
| 13/03/26 20:21:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 274) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Starting task 5.0:323 as TID 323 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:21:53 INFO cluster.TaskSetManager: Serialized task 5.0:323 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Finished TID 225 in 10290 ms (progress: 267/2086) | |
| 13/03/26 20:21:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 225) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Starting task 5.0:324 as TID 324 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Serialized task 5.0:324 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Finished TID 191 in 15410 ms (progress: 268/2086) | |
| 13/03/26 20:21:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 191) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Starting task 5.0:325 as TID 325 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Serialized task 5.0:325 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Finished TID 95 in 25549 ms (progress: 269/2086) | |
| 13/03/26 20:21:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 95) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Starting task 5.0:326 as TID 326 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Serialized task 5.0:326 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Finished TID 299 in 2865 ms (progress: 270/2086) | |
| 13/03/26 20:21:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 299) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Starting task 5.0:327 as TID 327 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Serialized task 5.0:327 as 2397 bytes in 0 ms | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Finished TID 222 in 11858 ms (progress: 271/2086) | |
| 13/03/26 20:21:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 222) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Starting task 5.0:328 as TID 328 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:54 INFO cluster.TaskSetManager: Serialized task 5.0:328 as 2397 bytes in 1 ms | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Finished TID 304 in 2841 ms (progress: 272/2086) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Starting task 5.0:329 as TID 329 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Serialized task 5.0:329 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 304) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Finished TID 227 in 11461 ms (progress: 273/2086) | |
| 13/03/26 20:21:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 227) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Starting task 5.0:330 as TID 330 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Serialized task 5.0:330 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Finished TID 309 in 2971 ms (progress: 274/2086) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Starting task 5.0:331 as TID 331 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:21:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 309) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Serialized task 5.0:331 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Finished TID 277 in 7329 ms (progress: 275/2086) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Starting task 5.0:332 as TID 332 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:21:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 277) | |
| 13/03/26 20:21:55 INFO cluster.TaskSetManager: Serialized task 5.0:332 as 2404 bytes in 0 ms | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Finished TID 236 in 10880 ms (progress: 276/2086) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Starting task 5.0:333 as TID 333 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Serialized task 5.0:333 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 236) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Finished TID 314 in 3591 ms (progress: 277/2086) | |
| 13/03/26 20:21:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 314) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Starting task 5.0:334 as TID 334 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Serialized task 5.0:334 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Finished TID 310 in 3946 ms (progress: 278/2086) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Starting task 5.0:335 as TID 335 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:21:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 310) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Serialized task 5.0:335 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Finished TID 278 in 8336 ms (progress: 279/2086) | |
| 13/03/26 20:21:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 278) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Starting task 5.0:336 as TID 336 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Serialized task 5.0:336 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Finished TID 230 in 12201 ms (progress: 280/2086) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Starting task 5.0:337 as TID 337 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Serialized task 5.0:337 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 230) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Finished TID 268 in 9390 ms (progress: 281/2086) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Starting task 5.0:338 as TID 338 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:21:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 268) | |
| 13/03/26 20:21:56 INFO cluster.TaskSetManager: Serialized task 5.0:338 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Finished TID 246 in 11210 ms (progress: 282/2086) | |
| 13/03/26 20:21:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 246) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Starting task 5.0:339 as TID 339 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Serialized task 5.0:339 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Finished TID 319 in 3869 ms (progress: 283/2086) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Starting task 5.0:340 as TID 340 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 319) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Serialized task 5.0:340 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Finished TID 280 in 8252 ms (progress: 284/2086) | |
| 13/03/26 20:21:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 280) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Starting task 5.0:341 as TID 341 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Serialized task 5.0:341 as 2400 bytes in 0 ms | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Finished TID 301 in 5372 ms (progress: 285/2086) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Starting task 5.0:342 as TID 342 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:21:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 301) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Serialized task 5.0:342 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Finished TID 315 in 4527 ms (progress: 286/2086) | |
| 13/03/26 20:21:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 315) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Starting task 5.0:343 as TID 343 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Serialized task 5.0:343 as 2399 bytes in 0 ms | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Finished TID 302 in 5675 ms (progress: 287/2086) | |
| 13/03/26 20:21:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 302) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Starting task 5.0:344 as TID 344 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Serialized task 5.0:344 as 2400 bytes in 1 ms | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Finished TID 258 in 11077 ms (progress: 288/2086) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Starting task 5.0:345 as TID 345 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:21:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 258) | |
| 13/03/26 20:21:57 INFO cluster.TaskSetManager: Serialized task 5.0:345 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Finished TID 322 in 4289 ms (progress: 289/2086) | |
| 13/03/26 20:21:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 322) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Starting task 5.0:346 as TID 346 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Serialized task 5.0:346 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Finished TID 305 in 5801 ms (progress: 290/2086) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Starting task 5.0:347 as TID 347 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 305) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Serialized task 5.0:347 as 2399 bytes in 1 ms | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Finished TID 300 in 6163 ms (progress: 291/2086) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Starting task 5.0:348 as TID 348 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 300) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Serialized task 5.0:348 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Finished TID 313 in 5660 ms (progress: 292/2086) | |
| 13/03/26 20:21:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 313) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Starting task 5.0:349 as TID 349 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Serialized task 5.0:349 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Finished TID 347 in 554 ms (progress: 293/2086) | |
| 13/03/26 20:21:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 347) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Starting task 5.0:350 as TID 350 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Serialized task 5.0:350 as 2385 bytes in 1 ms | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Finished TID 282 in 9122 ms (progress: 294/2086) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Starting task 5.0:351 as TID 351 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:21:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 282) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Serialized task 5.0:351 as 2385 bytes in 0 ms | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Finished TID 312 in 5946 ms (progress: 295/2086) | |
| 13/03/26 20:21:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 312) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Starting task 5.0:352 as TID 352 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:58 INFO cluster.TaskSetManager: Serialized task 5.0:352 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Finished TID 311 in 6305 ms (progress: 296/2086) | |
| 13/03/26 20:21:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 311) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Starting task 5.0:353 as TID 353 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Serialized task 5.0:353 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Finished TID 308 in 6685 ms (progress: 297/2086) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Starting task 5.0:354 as TID 354 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:21:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 308) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Serialized task 5.0:354 as 2386 bytes in 0 ms | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Finished TID 318 in 5846 ms (progress: 298/2086) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Starting task 5.0:355 as TID 355 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:21:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 318) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Serialized task 5.0:355 as 2386 bytes in 1 ms | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Finished TID 327 in 4452 ms (progress: 299/2086) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Starting task 5.0:356 as TID 356 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:21:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 327) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Serialized task 5.0:356 as 2398 bytes in 0 ms | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Finished TID 307 in 7007 ms (progress: 300/2086) | |
| 13/03/26 20:21:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 307) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Starting task 5.0:357 as TID 357 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Serialized task 5.0:357 as 2384 bytes in 0 ms | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Finished TID 306 in 7147 ms (progress: 301/2086) | |
| 13/03/26 20:21:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 306) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Starting task 5.0:358 as TID 358 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Serialized task 5.0:358 as 2384 bytes in 1 ms | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Finished TID 328 in 4922 ms (progress: 302/2086) | |
| 13/03/26 20:21:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 328) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Starting task 5.0:359 as TID 359 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:21:59 INFO cluster.TaskSetManager: Serialized task 5.0:359 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Finished TID 324 in 6017 ms (progress: 303/2086) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Starting task 5.0:360 as TID 360 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 324) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Serialized task 5.0:360 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Finished TID 283 in 10506 ms (progress: 304/2086) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Starting task 5.0:361 as TID 361 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 283) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Serialized task 5.0:361 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Finished TID 323 in 6675 ms (progress: 305/2086) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Starting task 5.0:362 as TID 362 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 323) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Serialized task 5.0:362 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Finished TID 289 in 9813 ms (progress: 306/2086) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Starting task 5.0:363 as TID 363 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Serialized task 5.0:363 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 289) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Finished TID 303 in 8558 ms (progress: 307/2086) | |
| 13/03/26 20:22:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 303) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Starting task 5.0:364 as TID 364 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Serialized task 5.0:364 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Finished TID 321 in 7213 ms (progress: 308/2086) | |
| 13/03/26 20:22:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 321) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Starting task 5.0:365 as TID 365 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Serialized task 5.0:365 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Finished TID 320 in 7333 ms (progress: 309/2086) | |
| 13/03/26 20:22:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 320) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Starting task 5.0:366 as TID 366 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:00 INFO cluster.TaskSetManager: Serialized task 5.0:366 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Finished TID 288 in 10324 ms (progress: 310/2086) | |
| 13/03/26 20:22:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 288) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Starting task 5.0:367 as TID 367 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Serialized task 5.0:367 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Finished TID 298 in 9059 ms (progress: 311/2086) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Starting task 5.0:368 as TID 368 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 298) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Serialized task 5.0:368 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Finished TID 326 in 6344 ms (progress: 312/2086) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Starting task 5.0:369 as TID 369 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 326) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Serialized task 5.0:369 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Finished TID 287 in 10573 ms (progress: 313/2086) | |
| 13/03/26 20:22:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 287) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Starting task 5.0:370 as TID 370 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Serialized task 5.0:370 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Finished TID 317 in 7987 ms (progress: 314/2086) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Starting task 5.0:371 as TID 371 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 317) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Serialized task 5.0:371 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Finished TID 297 in 10053 ms (progress: 315/2086) | |
| 13/03/26 20:22:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 297) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Starting task 5.0:372 as TID 372 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:01 INFO cluster.TaskSetManager: Serialized task 5.0:372 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Finished TID 281 in 12479 ms (progress: 316/2086) | |
| 13/03/26 20:22:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 281) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Starting task 5.0:373 as TID 373 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Serialized task 5.0:373 as 2404 bytes in 1 ms | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Finished TID 285 in 11849 ms (progress: 317/2086) | |
| 13/03/26 20:22:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 285) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Starting task 5.0:374 as TID 374 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Serialized task 5.0:374 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Finished TID 295 in 10587 ms (progress: 318/2086) | |
| 13/03/26 20:22:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 295) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Starting task 5.0:375 as TID 375 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Serialized task 5.0:375 as 2404 bytes in 1 ms | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Finished TID 316 in 9613 ms (progress: 319/2086) | |
| 13/03/26 20:22:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 316) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Starting task 5.0:376 as TID 376 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:02 INFO cluster.TaskSetManager: Serialized task 5.0:376 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Finished TID 369 in 2089 ms (progress: 320/2086) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Starting task 5.0:377 as TID 377 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Serialized task 5.0:377 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 369) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Finished TID 355 in 4239 ms (progress: 321/2086) | |
| 13/03/26 20:22:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 355) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Starting task 5.0:378 as TID 378 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Serialized task 5.0:378 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Finished TID 366 in 2934 ms (progress: 322/2086) | |
| 13/03/26 20:22:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 366) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Starting task 5.0:379 as TID 379 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Serialized task 5.0:379 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Finished TID 334 in 7358 ms (progress: 323/2086) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Starting task 5.0:380 as TID 380 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 334) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Serialized task 5.0:380 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Finished TID 372 in 1943 ms (progress: 324/2086) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Starting task 5.0:381 as TID 381 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 372) | |
| 13/03/26 20:22:03 INFO cluster.TaskSetManager: Serialized task 5.0:381 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 294 in 12501 ms (progress: 325/2086) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 294) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:382 as TID 382 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:382 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 291 in 12926 ms (progress: 326/2086) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:383 as TID 383 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 291) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:383 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 374 in 1981 ms (progress: 327/2086) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:384 as TID 384 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 374) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:384 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 348 in 6029 ms (progress: 328/2086) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 348) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:385 as TID 385 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:385 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 351 in 5448 ms (progress: 329/2086) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:386 as TID 386 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 351) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:386 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 349 in 5897 ms (progress: 330/2086) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 349) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:387 as TID 387 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:387 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 350 in 5765 ms (progress: 331/2086) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:388 as TID 388 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 350) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:388 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 359 in 4676 ms (progress: 332/2086) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:389 as TID 389 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 359) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:389 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 346 in 6669 ms (progress: 333/2086) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 346) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:390 as TID 390 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:390 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 352 in 5852 ms (progress: 334/2086) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:391 as TID 391 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:391 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 352) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 363 in 4164 ms (progress: 335/2086) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:392 as TID 392 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:392 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 363) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Finished TID 356 in 5474 ms (progress: 336/2086) | |
| 13/03/26 20:22:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 356) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Starting task 5.0:393 as TID 393 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:04 INFO cluster.TaskSetManager: Serialized task 5.0:393 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 337 in 8133 ms (progress: 337/2086) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 337) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:394 as TID 394 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:394 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 353 in 5988 ms (progress: 338/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:395 as TID 395 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 353) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:395 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 378 in 1803 ms (progress: 339/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:396 as TID 396 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 378) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:396 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 358 in 5791 ms (progress: 340/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:397 as TID 397 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 358) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:397 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 376 in 2444 ms (progress: 341/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:398 as TID 398 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 376) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:398 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 286 in 14794 ms (progress: 342/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:399 as TID 399 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 286) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:399 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 335 in 9015 ms (progress: 343/2086) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 335) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:400 as TID 400 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:400 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 344 in 7844 ms (progress: 344/2086) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 344) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:401 as TID 401 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:401 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 354 in 6692 ms (progress: 345/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:402 as TID 402 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:402 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 354) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 342 in 8408 ms (progress: 346/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:403 as TID 403 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 342) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:403 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Finished TID 397 in 599 ms (progress: 347/2086) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Starting task 5.0:404 as TID 404 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 397) | |
| 13/03/26 20:22:05 INFO cluster.TaskSetManager: Serialized task 5.0:404 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 360 in 5981 ms (progress: 348/2086) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 360) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:405 as TID 405 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:405 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 292 in 14935 ms (progress: 349/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:406 as TID 406 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 292) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:406 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 380 in 2332 ms (progress: 350/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:407 as TID 407 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 380) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:407 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 340 in 8849 ms (progress: 351/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:408 as TID 408 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 340) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:408 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 232 in 21489 ms (progress: 352/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:409 as TID 409 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 232) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:409 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 330 in 10885 ms (progress: 353/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:410 as TID 410 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 330) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:410 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 362 in 6073 ms (progress: 354/2086) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 362) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:411 as TID 411 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:411 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 396 in 1306 ms (progress: 355/2086) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 396) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:412 as TID 412 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:412 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 368 in 5602 ms (progress: 356/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:413 as TID 413 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 368) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:413 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 398 in 1389 ms (progress: 357/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:414 as TID 414 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 398) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:414 as 2384 bytes in 1 ms | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Finished TID 367 in 5919 ms (progress: 358/2086) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Starting task 5.0:415 as TID 415 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 367) | |
| 13/03/26 20:22:06 INFO cluster.TaskSetManager: Serialized task 5.0:415 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 325 in 12398 ms (progress: 359/2086) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:416 as TID 416 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 325) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:416 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 336 in 10269 ms (progress: 360/2086) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 336) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:417 as TID 417 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:417 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 399 in 1741 ms (progress: 361/2086) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:418 as TID 418 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 399) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:418 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 402 in 1603 ms (progress: 362/2086) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 402) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:419 as TID 419 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:419 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 418 in 388 ms (progress: 363/2086) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 418) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:420 as TID 420 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:420 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 409 in 1410 ms (progress: 364/2086) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:421 as TID 421 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 409) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:421 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 365 in 6839 ms (progress: 365/2086) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 365) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:422 as TID 422 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:422 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Finished TID 401 in 2224 ms (progress: 366/2086) | |
| 13/03/26 20:22:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 401) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Starting task 5.0:423 as TID 423 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:07 INFO cluster.TaskSetManager: Serialized task 5.0:423 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Finished TID 388 in 3576 ms (progress: 367/2086) | |
| 13/03/26 20:22:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 388) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Starting task 5.0:424 as TID 424 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Serialized task 5.0:424 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Finished TID 390 in 3359 ms (progress: 368/2086) | |
| 13/03/26 20:22:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 390) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Starting task 5.0:425 as TID 425 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Serialized task 5.0:425 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Finished TID 414 in 1679 ms (progress: 369/2086) | |
| 13/03/26 20:22:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 414) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Starting task 5.0:426 as TID 426 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Serialized task 5.0:426 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Finished TID 411 in 1946 ms (progress: 370/2086) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Starting task 5.0:427 as TID 427 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 411) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Serialized task 5.0:427 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Finished TID 364 in 7800 ms (progress: 371/2086) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Starting task 5.0:428 as TID 428 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 364) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Serialized task 5.0:428 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Finished TID 339 in 11287 ms (progress: 372/2086) | |
| 13/03/26 20:22:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 339) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Starting task 5.0:429 as TID 429 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Serialized task 5.0:429 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Finished TID 357 in 9478 ms (progress: 373/2086) | |
| 13/03/26 20:22:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 357) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Starting task 5.0:430 as TID 430 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:08 INFO cluster.TaskSetManager: Serialized task 5.0:430 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Finished TID 371 in 8111 ms (progress: 374/2086) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Starting task 5.0:431 as TID 431 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Serialized task 5.0:431 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 371) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Finished TID 332 in 13928 ms (progress: 375/2086) | |
| 13/03/26 20:22:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 332) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Starting task 5.0:432 as TID 432 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Serialized task 5.0:432 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Finished TID 370 in 8488 ms (progress: 376/2086) | |
| 13/03/26 20:22:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 370) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Starting task 5.0:433 as TID 433 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Serialized task 5.0:433 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Finished TID 425 in 1793 ms (progress: 377/2086) | |
| 13/03/26 20:22:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 425) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Starting task 5.0:434 as TID 434 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:09 INFO cluster.TaskSetManager: Serialized task 5.0:434 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 361 in 9766 ms (progress: 378/2086) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:435 as TID 435 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:435 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 361) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 421 in 2759 ms (progress: 379/2086) | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 421) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:436 as TID 436 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:436 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 343 in 12819 ms (progress: 380/2086) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:437 as TID 437 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 343) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:437 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 400 in 5075 ms (progress: 381/2086) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:438 as TID 438 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 400) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:438 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 331 in 15354 ms (progress: 382/2086) | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 331) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:439 as TID 439 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:439 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 406 in 4734 ms (progress: 383/2086) | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 406) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:440 as TID 440 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:440 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 410 in 4644 ms (progress: 384/2086) | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 410) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:441 as TID 441 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:441 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Finished TID 403 in 5127 ms (progress: 385/2086) | |
| 13/03/26 20:22:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 403) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Starting task 5.0:442 as TID 442 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:10 INFO cluster.TaskSetManager: Serialized task 5.0:442 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 341 in 13699 ms (progress: 386/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 341) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:443 as TID 443 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:443 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 405 in 5137 ms (progress: 387/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 405) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:444 as TID 444 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:444 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 431 in 2062 ms (progress: 388/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 431) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:445 as TID 445 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:445 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 333 in 15482 ms (progress: 389/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 333) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:446 as TID 446 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:446 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 404 in 5635 ms (progress: 390/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 404) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:447 as TID 447 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:447 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 427 in 3129 ms (progress: 391/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 427) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:448 as TID 448 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:448 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 384 in 7611 ms (progress: 392/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 384) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:449 as TID 449 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:449 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 381 in 7807 ms (progress: 393/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 381) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:450 as TID 450 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:450 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Finished TID 408 in 5679 ms (progress: 394/2086) | |
| 13/03/26 20:22:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 408) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Starting task 5.0:451 as TID 451 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:11 INFO cluster.TaskSetManager: Serialized task 5.0:451 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 413 in 5340 ms (progress: 395/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 413) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:452 as TID 452 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:452 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 423 in 4187 ms (progress: 396/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 423) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:453 as TID 453 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:453 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 407 in 6061 ms (progress: 397/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 407) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:454 as TID 454 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:454 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 179 in 33766 ms (progress: 398/2086) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:455 as TID 455 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 179) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:455 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 387 in 8192 ms (progress: 399/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 387) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:456 as TID 456 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:456 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 412 in 6101 ms (progress: 400/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 412) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:457 as TID 457 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:457 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 453 in 645 ms (progress: 401/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 453) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:458 as TID 458 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:458 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 432 in 3040 ms (progress: 402/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 432) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:459 as TID 459 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:459 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 415 in 5790 ms (progress: 403/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 415) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:460 as TID 460 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:460 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Finished TID 329 in 17707 ms (progress: 404/2086) | |
| 13/03/26 20:22:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 329) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Starting task 5.0:461 as TID 461 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:12 INFO cluster.TaskSetManager: Serialized task 5.0:461 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Finished TID 394 in 8048 ms (progress: 405/2086) | |
| 13/03/26 20:22:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 394) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Starting task 5.0:462 as TID 462 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Serialized task 5.0:462 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Finished TID 383 in 9307 ms (progress: 406/2086) | |
| 13/03/26 20:22:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 383) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Starting task 5.0:463 as TID 463 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Serialized task 5.0:463 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Finished TID 417 in 6405 ms (progress: 407/2086) | |
| 13/03/26 20:22:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 417) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Starting task 5.0:464 as TID 464 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Serialized task 5.0:464 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Finished TID 284 in 23534 ms (progress: 408/2086) | |
| 13/03/26 20:22:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 284) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Starting task 5.0:465 as TID 465 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Serialized task 5.0:465 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Finished TID 462 in 634 ms (progress: 409/2086) | |
| 13/03/26 20:22:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 462) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Starting task 5.0:466 as TID 466 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Serialized task 5.0:466 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Finished TID 443 in 2794 ms (progress: 410/2086) | |
| 13/03/26 20:22:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 443) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Starting task 5.0:467 as TID 467 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:13 INFO cluster.TaskSetManager: Serialized task 5.0:467 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Finished TID 395 in 9200 ms (progress: 411/2086) | |
| 13/03/26 20:22:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 395) | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Starting task 5.0:468 as TID 468 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Serialized task 5.0:468 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Finished TID 455 in 2081 ms (progress: 412/2086) | |
| 13/03/26 20:22:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 455) | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Starting task 5.0:469 as TID 469 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Serialized task 5.0:469 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Finished TID 391 in 10285 ms (progress: 413/2086) | |
| 13/03/26 20:22:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 391) | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Starting task 5.0:470 as TID 470 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:14 INFO cluster.TaskSetManager: Serialized task 5.0:470 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Finished TID 389 in 10624 ms (progress: 414/2086) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Starting task 5.0:471 as TID 471 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Serialized task 5.0:471 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 389) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Finished TID 422 in 7481 ms (progress: 415/2086) | |
| 13/03/26 20:22:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 422) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Starting task 5.0:472 as TID 472 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Serialized task 5.0:472 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Finished TID 450 in 3645 ms (progress: 416/2086) | |
| 13/03/26 20:22:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 450) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Starting task 5.0:473 as TID 473 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Serialized task 5.0:473 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Finished TID 447 in 3972 ms (progress: 417/2086) | |
| 13/03/26 20:22:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 447) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Starting task 5.0:474 as TID 474 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Serialized task 5.0:474 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Finished TID 419 in 8269 ms (progress: 418/2086) | |
| 13/03/26 20:22:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 419) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Starting task 5.0:475 as TID 475 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Serialized task 5.0:475 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Finished TID 468 in 1573 ms (progress: 419/2086) | |
| 13/03/26 20:22:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 468) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Starting task 5.0:476 as TID 476 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Serialized task 5.0:476 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Finished TID 448 in 4343 ms (progress: 420/2086) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Starting task 5.0:477 as TID 477 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 448) | |
| 13/03/26 20:22:15 INFO cluster.TaskSetManager: Serialized task 5.0:477 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 382 in 12073 ms (progress: 421/2086) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:478 as TID 478 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 382) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:478 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 437 in 5592 ms (progress: 422/2086) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:479 as TID 479 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:479 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 437) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 392 in 11628 ms (progress: 423/2086) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 392) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:480 as TID 480 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:480 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 429 in 7804 ms (progress: 424/2086) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:481 as TID 481 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 429) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:481 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 449 in 4761 ms (progress: 425/2086) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:482 as TID 482 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 449) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:482 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 470 in 1585 ms (progress: 426/2086) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:483 as TID 483 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 470) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:483 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 456 in 3921 ms (progress: 427/2086) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 456) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:484 as TID 484 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:484 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 345 in 18822 ms (progress: 428/2086) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:485 as TID 485 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 345) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:485 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Finished TID 426 in 8320 ms (progress: 429/2086) | |
| 13/03/26 20:22:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 426) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Starting task 5.0:486 as TID 486 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:16 INFO cluster.TaskSetManager: Serialized task 5.0:486 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 466 in 3309 ms (progress: 430/2086) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 466) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:487 as TID 487 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:487 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 472 in 1897 ms (progress: 431/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:488 as TID 488 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 472) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:488 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 459 in 4421 ms (progress: 432/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:489 as TID 489 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 459) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:489 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 457 in 4566 ms (progress: 433/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:490 as TID 490 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 457) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:490 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 446 in 5765 ms (progress: 434/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:491 as TID 491 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 446) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:491 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 445 in 5800 ms (progress: 435/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:492 as TID 492 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 445) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:492 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 464 in 3941 ms (progress: 436/2086) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 464) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:493 as TID 493 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:493 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 379 in 13686 ms (progress: 437/2086) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 379) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:494 as TID 494 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:494 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 474 in 2021 ms (progress: 438/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:495 as TID 495 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 474) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:495 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 452 in 5553 ms (progress: 439/2086) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 452) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:496 as TID 496 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:496 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 442 in 6632 ms (progress: 440/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:497 as TID 497 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 442) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:497 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 386 in 13331 ms (progress: 441/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:498 as TID 498 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 386) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:498 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 487 in 647 ms (progress: 442/2086) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 487) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:499 as TID 499 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:499 as 2395 bytes in 1 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 424 in 9704 ms (progress: 443/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:500 as TID 500 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 424) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:500 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 485 in 1080 ms (progress: 444/2086) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:501 as TID 501 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:501 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 485) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 489 in 651 ms (progress: 445/2086) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 489) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:502 as TID 502 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:502 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Finished TID 451 in 5966 ms (progress: 446/2086) | |
| 13/03/26 20:22:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 451) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Starting task 5.0:503 as TID 503 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:17 INFO cluster.TaskSetManager: Serialized task 5.0:503 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 463 in 4649 ms (progress: 447/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 463) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:504 as TID 504 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:504 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 234 in 33108 ms (progress: 448/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 234) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:505 as TID 505 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:505 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 491 in 798 ms (progress: 449/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 491) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:506 as TID 506 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:506 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 441 in 7197 ms (progress: 450/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 441) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:507 as TID 507 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:507 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 495 in 740 ms (progress: 451/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 495) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:508 as TID 508 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:508 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 440 in 7519 ms (progress: 452/2086) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:509 as TID 509 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 440) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:509 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 465 in 4748 ms (progress: 453/2086) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:510 as TID 510 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 465) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:510 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 454 in 6107 ms (progress: 454/2086) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:511 as TID 511 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 454) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:511 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 500 in 649 ms (progress: 455/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 500) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:512 as TID 512 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:512 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 493 in 889 ms (progress: 456/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 493) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:513 as TID 513 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:513 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 434 in 8685 ms (progress: 457/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 434) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:514 as TID 514 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:514 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 460 in 5901 ms (progress: 458/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 460) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:515 as TID 515 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:515 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 502 in 933 ms (progress: 459/2086) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 502) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:516 as TID 516 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:516 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Finished TID 439 in 8129 ms (progress: 460/2086) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Starting task 5.0:517 as TID 517 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 439) | |
| 13/03/26 20:22:18 INFO cluster.TaskSetManager: Serialized task 5.0:517 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Finished TID 475 in 3776 ms (progress: 461/2086) | |
| 13/03/26 20:22:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 475) | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Starting task 5.0:518 as TID 518 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Serialized task 5.0:518 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Finished TID 373 in 17536 ms (progress: 462/2086) | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Starting task 5.0:519 as TID 519 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 373) | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Serialized task 5.0:519 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Finished TID 461 in 7062 ms (progress: 463/2086) | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Starting task 5.0:520 as TID 520 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 461) | |
| 13/03/26 20:22:19 INFO cluster.TaskSetManager: Serialized task 5.0:520 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 517 in 1185 ms (progress: 464/2086) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:521 as TID 521 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 517) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:521 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 513 in 1764 ms (progress: 465/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 513) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:522 as TID 522 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:522 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 458 in 7514 ms (progress: 466/2086) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:523 as TID 523 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 458) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:523 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 375 in 17952 ms (progress: 467/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 375) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:524 as TID 524 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:524 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 377 in 17091 ms (progress: 468/2086) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:525 as TID 525 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 377) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:525 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 483 in 4004 ms (progress: 469/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 483) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:526 as TID 526 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:526 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 507 in 2475 ms (progress: 470/2086) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:527 as TID 527 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:527 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 507) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 420 in 13120 ms (progress: 471/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 420) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:528 as TID 528 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:528 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 436 in 10379 ms (progress: 472/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 436) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:529 as TID 529 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:529 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 515 in 2171 ms (progress: 473/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 515) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:530 as TID 530 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:530 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 498 in 3312 ms (progress: 474/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 498) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:531 as TID 531 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:531 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Finished TID 338 in 24067 ms (progress: 475/2086) | |
| 13/03/26 20:22:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 338) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Starting task 5.0:532 as TID 532 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:20 INFO cluster.TaskSetManager: Serialized task 5.0:532 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Finished TID 504 in 3165 ms (progress: 476/2086) | |
| 13/03/26 20:22:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 504) | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Starting task 5.0:533 as TID 533 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Serialized task 5.0:533 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Finished TID 385 in 17356 ms (progress: 477/2086) | |
| 13/03/26 20:22:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 385) | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Starting task 5.0:534 as TID 534 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Serialized task 5.0:534 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Finished TID 519 in 2196 ms (progress: 478/2086) | |
| 13/03/26 20:22:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 519) | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Starting task 5.0:535 as TID 535 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:21 INFO cluster.TaskSetManager: Serialized task 5.0:535 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 433 in 12796 ms (progress: 479/2086) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 433) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:536 as TID 536 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:536 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 484 in 6004 ms (progress: 480/2086) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:537 as TID 537 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 484) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:537 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 499 in 4911 ms (progress: 481/2086) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:538 as TID 538 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 499) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:538 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 511 in 4222 ms (progress: 482/2086) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:539 as TID 539 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 511) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:539 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 416 in 15637 ms (progress: 483/2086) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:540 as TID 540 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:540 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 416) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 509 in 4368 ms (progress: 484/2086) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 509) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:541 as TID 541 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:541 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 510 in 4412 ms (progress: 485/2086) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 510) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:542 as TID 542 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:542 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 497 in 5243 ms (progress: 486/2086) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:543 as TID 543 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 497) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:543 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Finished TID 478 in 6789 ms (progress: 487/2086) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Starting task 5.0:544 as TID 544 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 478) | |
| 13/03/26 20:22:22 INFO cluster.TaskSetManager: Serialized task 5.0:544 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 473 in 7683 ms (progress: 488/2086) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:545 as TID 545 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 473) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:545 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 296 in 31389 ms (progress: 489/2086) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 296) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:546 as TID 546 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:546 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 496 in 5685 ms (progress: 490/2086) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:547 as TID 547 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 496) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:547 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 530 in 2433 ms (progress: 491/2086) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:548 as TID 548 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 530) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:548 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 494 in 5866 ms (progress: 492/2086) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:549 as TID 549 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 494) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:549 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 479 in 7293 ms (progress: 493/2086) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 479) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:550 as TID 550 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:550 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 156 in 46860 ms (progress: 494/2086) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:551 as TID 551 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 156) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:551 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 532 in 2599 ms (progress: 495/2086) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:552 as TID 552 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 532) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:552 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 490 in 6580 ms (progress: 496/2086) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 490) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:553 as TID 553 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:553 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Finished TID 508 in 5562 ms (progress: 497/2086) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Starting task 5.0:554 as TID 554 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 508) | |
| 13/03/26 20:22:23 INFO cluster.TaskSetManager: Serialized task 5.0:554 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 482 in 7624 ms (progress: 498/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:555 as TID 555 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 482) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:555 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 505 in 6222 ms (progress: 499/2086) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 505) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:556 as TID 556 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:556 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 476 in 8513 ms (progress: 500/2086) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 476) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:557 as TID 557 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:557 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 534 in 3031 ms (progress: 501/2086) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 534) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:558 as TID 558 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:558 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 538 in 2081 ms (progress: 502/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:559 as TID 559 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 538) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:559 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 543 in 1851 ms (progress: 503/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:560 as TID 560 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 543) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:560 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 541 in 2034 ms (progress: 504/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:561 as TID 561 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 541) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:561 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 492 in 7505 ms (progress: 505/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:562 as TID 562 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 492) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:562 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 545 in 1787 ms (progress: 506/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:563 as TID 563 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 545) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:563 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 488 in 7768 ms (progress: 507/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:564 as TID 564 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 488) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:564 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Finished TID 536 in 2444 ms (progress: 508/2086) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Starting task 5.0:565 as TID 565 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 536) | |
| 13/03/26 20:22:24 INFO cluster.TaskSetManager: Serialized task 5.0:565 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 523 in 4906 ms (progress: 509/2086) | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 523) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:566 as TID 566 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:566 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 527 in 4635 ms (progress: 510/2086) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:567 as TID 567 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 527) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:567 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 486 in 8581 ms (progress: 511/2086) | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 486) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:568 as TID 568 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:568 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 526 in 4937 ms (progress: 512/2086) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:569 as TID 569 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:569 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 526) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 550 in 2134 ms (progress: 513/2086) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:570 as TID 570 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 550) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:570 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 533 in 4578 ms (progress: 514/2086) | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 533) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:571 as TID 571 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:571 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 529 in 5022 ms (progress: 515/2086) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:572 as TID 572 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 529) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:572 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Finished TID 481 in 9379 ms (progress: 516/2086) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Starting task 5.0:573 as TID 573 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 481) | |
| 13/03/26 20:22:25 INFO cluster.TaskSetManager: Serialized task 5.0:573 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 438 in 15425 ms (progress: 517/2086) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:574 as TID 574 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 438) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:574 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 467 in 12190 ms (progress: 518/2086) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:575 as TID 575 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 467) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:575 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 528 in 5411 ms (progress: 519/2086) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:576 as TID 576 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:576 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 528) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 506 in 8244 ms (progress: 520/2086) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:577 as TID 577 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 506) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:577 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 563 in 1480 ms (progress: 521/2086) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:578 as TID 578 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 563) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:578 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 547 in 3387 ms (progress: 522/2086) | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 547) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:579 as TID 579 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:579 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 531 in 5830 ms (progress: 523/2086) | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 531) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:580 as TID 580 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:580 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Finished TID 565 in 1779 ms (progress: 524/2086) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Starting task 5.0:581 as TID 581 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 565) | |
| 13/03/26 20:22:26 INFO cluster.TaskSetManager: Serialized task 5.0:581 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Finished TID 542 in 4503 ms (progress: 525/2086) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Starting task 5.0:582 as TID 582 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Serialized task 5.0:582 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 542) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Finished TID 567 in 2194 ms (progress: 526/2086) | |
| 13/03/26 20:22:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 567) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Starting task 5.0:583 as TID 583 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Serialized task 5.0:583 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Finished TID 546 in 4604 ms (progress: 527/2086) | |
| 13/03/26 20:22:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 546) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Starting task 5.0:584 as TID 584 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Serialized task 5.0:584 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Finished TID 521 in 7771 ms (progress: 528/2086) | |
| 13/03/26 20:22:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 521) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Starting task 5.0:585 as TID 585 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Serialized task 5.0:585 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Finished TID 501 in 10121 ms (progress: 529/2086) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Starting task 5.0:586 as TID 586 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 501) | |
| 13/03/26 20:22:27 INFO cluster.TaskSetManager: Serialized task 5.0:586 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 537 in 5477 ms (progress: 530/2086) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:587 as TID 587 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 537) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:587 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 571 in 2605 ms (progress: 531/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 571) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:588 as TID 588 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:588 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 539 in 5840 ms (progress: 532/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 539) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:589 as TID 589 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:589 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 552 in 4878 ms (progress: 533/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 552) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:590 as TID 590 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:590 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 573 in 2661 ms (progress: 534/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 573) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:591 as TID 591 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:591 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 554 in 4636 ms (progress: 535/2086) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:592 as TID 592 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 554) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:592 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 569 in 2995 ms (progress: 536/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 569) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:593 as TID 593 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:593 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 544 in 5862 ms (progress: 537/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 544) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:594 as TID 594 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:594 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 480 in 12407 ms (progress: 538/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 480) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:595 as TID 595 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:595 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 551 in 5298 ms (progress: 539/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 551) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:596 as TID 596 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:596 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 522 in 8735 ms (progress: 540/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 522) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:597 as TID 597 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:597 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Finished TID 548 in 5706 ms (progress: 541/2086) | |
| 13/03/26 20:22:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 548) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Starting task 5.0:598 as TID 598 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:28 INFO cluster.TaskSetManager: Serialized task 5.0:598 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Finished TID 575 in 2939 ms (progress: 542/2086) | |
| 13/03/26 20:22:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 575) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Starting task 5.0:599 as TID 599 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Serialized task 5.0:599 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Finished TID 512 in 10671 ms (progress: 543/2086) | |
| 13/03/26 20:22:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 512) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Starting task 5.0:600 as TID 600 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Serialized task 5.0:600 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Finished TID 520 in 9382 ms (progress: 544/2086) | |
| 13/03/26 20:22:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 520) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Starting task 5.0:601 as TID 601 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Serialized task 5.0:601 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Finished TID 582 in 1990 ms (progress: 545/2086) | |
| 13/03/26 20:22:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 582) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Starting task 5.0:602 as TID 602 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Serialized task 5.0:602 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Finished TID 549 in 5922 ms (progress: 546/2086) | |
| 13/03/26 20:22:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 549) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Starting task 5.0:603 as TID 603 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Serialized task 5.0:603 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Finished TID 444 in 18298 ms (progress: 547/2086) | |
| 13/03/26 20:22:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 444) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Starting task 5.0:604 as TID 604 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:29 INFO cluster.TaskSetManager: Serialized task 5.0:604 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 577 in 3868 ms (progress: 548/2086) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 577) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:605 as TID 605 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:605 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 572 in 4409 ms (progress: 549/2086) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:606 as TID 606 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 572) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:606 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 584 in 2440 ms (progress: 550/2086) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:607 as TID 607 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 584) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:607 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 525 in 10020 ms (progress: 551/2086) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 525) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:608 as TID 608 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:608 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 570 in 4833 ms (progress: 552/2086) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:609 as TID 609 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 570) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:609 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 535 in 8548 ms (progress: 553/2086) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:610 as TID 610 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 535) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:610 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 430 in 21475 ms (progress: 554/2086) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 430) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:611 as TID 611 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:611 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 568 in 5175 ms (progress: 555/2086) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:612 as TID 612 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 568) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:612 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 578 in 4387 ms (progress: 556/2086) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 578) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:613 as TID 613 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:613 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 580 in 4232 ms (progress: 557/2086) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 580) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:614 as TID 614 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:614 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 503 in 13093 ms (progress: 558/2086) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:615 as TID 615 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 503) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:615 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Finished TID 574 in 4922 ms (progress: 559/2086) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Starting task 5.0:616 as TID 616 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:30 INFO cluster.TaskSetManager: Serialized task 5.0:616 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 574) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Finished TID 566 in 5988 ms (progress: 560/2086) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Starting task 5.0:617 as TID 617 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Serialized task 5.0:617 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 566) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Finished TID 592 in 2745 ms (progress: 561/2086) | |
| 13/03/26 20:22:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 592) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Starting task 5.0:618 as TID 618 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Serialized task 5.0:618 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Finished TID 553 in 7753 ms (progress: 562/2086) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Starting task 5.0:619 as TID 619 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Serialized task 5.0:619 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 553) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Finished TID 595 in 2941 ms (progress: 563/2086) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Starting task 5.0:620 as TID 620 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 595) | |
| 13/03/26 20:22:31 INFO cluster.TaskSetManager: Serialized task 5.0:620 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 518 in 12550 ms (progress: 564/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:621 as TID 621 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 518) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:621 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 524 in 11814 ms (progress: 565/2086) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 524) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:622 as TID 622 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:622 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 583 in 4799 ms (progress: 566/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:623 as TID 623 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 583) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:623 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 579 in 5651 ms (progress: 567/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:624 as TID 624 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 579) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:624 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 393 in 27516 ms (progress: 568/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:625 as TID 625 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 393) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:625 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 612 in 2182 ms (progress: 569/2086) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 612) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:626 as TID 626 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:626 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 589 in 4359 ms (progress: 570/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:627 as TID 627 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 589) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:627 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 540 in 10234 ms (progress: 571/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:628 as TID 628 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 540) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:628 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 585 in 5044 ms (progress: 572/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:629 as TID 629 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 585) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:629 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 581 in 6243 ms (progress: 573/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:630 as TID 630 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:630 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 581) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Finished TID 555 in 8890 ms (progress: 574/2086) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Starting task 5.0:631 as TID 631 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 555) | |
| 13/03/26 20:22:32 INFO cluster.TaskSetManager: Serialized task 5.0:631 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Finished TID 559 in 8433 ms (progress: 575/2086) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Starting task 5.0:632 as TID 632 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 559) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Serialized task 5.0:632 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Finished TID 471 in 18032 ms (progress: 576/2086) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Starting task 5.0:633 as TID 633 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 471) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Serialized task 5.0:633 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Finished TID 588 in 4956 ms (progress: 577/2086) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Starting task 5.0:634 as TID 634 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 588) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Serialized task 5.0:634 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Finished TID 587 in 5421 ms (progress: 578/2086) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Starting task 5.0:635 as TID 635 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Serialized task 5.0:635 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 587) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Finished TID 616 in 2525 ms (progress: 579/2086) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Starting task 5.0:636 as TID 636 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 616) | |
| 13/03/26 20:22:33 INFO cluster.TaskSetManager: Serialized task 5.0:636 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 562 in 9229 ms (progress: 580/2086) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 562) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:637 as TID 637 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:637 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 614 in 3139 ms (progress: 581/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:638 as TID 638 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 614) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:638 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 610 in 3749 ms (progress: 582/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:639 as TID 639 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 610) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:639 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 593 in 5678 ms (progress: 583/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:640 as TID 640 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:640 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 593) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 428 in 25701 ms (progress: 584/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:641 as TID 641 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:641 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 428) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 636 in 821 ms (progress: 585/2086) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 636) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:642 as TID 642 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:642 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 591 in 5913 ms (progress: 586/2086) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 591) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:643 as TID 643 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:643 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 608 in 4147 ms (progress: 587/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:644 as TID 644 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 608) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:644 as 2404 bytes in 1 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 590 in 6052 ms (progress: 588/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:645 as TID 645 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:645 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 590) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 435 in 24576 ms (progress: 589/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:646 as TID 646 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 435) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:646 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 594 in 6097 ms (progress: 590/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:647 as TID 647 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 594) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:647 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Finished TID 613 in 4155 ms (progress: 591/2086) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Starting task 5.0:648 as TID 648 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 613) | |
| 13/03/26 20:22:34 INFO cluster.TaskSetManager: Serialized task 5.0:648 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 607 in 4899 ms (progress: 592/2086) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 607) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:649 as TID 649 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:649 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 609 in 4838 ms (progress: 593/2086) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:650 as TID 650 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 609) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:650 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 606 in 5021 ms (progress: 594/2086) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:651 as TID 651 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 606) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:651 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 556 in 10986 ms (progress: 595/2086) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:652 as TID 652 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 556) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:652 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 624 in 3044 ms (progress: 596/2086) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 624) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:653 as TID 653 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:653 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 641 in 1258 ms (progress: 597/2086) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:654 as TID 654 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 641) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:654 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 601 in 6319 ms (progress: 598/2086) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:655 as TID 655 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 601) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:655 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 620 in 3848 ms (progress: 599/2086) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:656 as TID 656 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:656 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 620) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 586 in 7677 ms (progress: 600/2086) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 586) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:657 as TID 657 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:657 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 560 in 10947 ms (progress: 601/2086) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 560) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:658 as TID 658 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:658 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 622 in 3544 ms (progress: 602/2086) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 622) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:659 as TID 659 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:659 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Finished TID 627 in 2879 ms (progress: 603/2086) | |
| 13/03/26 20:22:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 627) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Starting task 5.0:660 as TID 660 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:35 INFO cluster.TaskSetManager: Serialized task 5.0:660 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:36 INFO cluster.TaskSetManager: Finished TID 631 in 3658 ms (progress: 604/2086) | |
| 13/03/26 20:22:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 631) | |
| 13/03/26 20:22:36 INFO cluster.TaskSetManager: Starting task 5.0:661 as TID 661 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:36 INFO cluster.TaskSetManager: Serialized task 5.0:661 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:36 INFO cluster.TaskSetManager: Finished TID 650 in 1786 ms (progress: 605/2086) | |
| 13/03/26 20:22:36 INFO cluster.TaskSetManager: Starting task 5.0:662 as TID 662 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 650) | |
| 13/03/26 20:22:36 INFO cluster.TaskSetManager: Serialized task 5.0:662 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 617 in 5863 ms (progress: 606/2086) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:663 as TID 663 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 617) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:663 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 623 in 4814 ms (progress: 607/2086) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:664 as TID 664 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 623) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:664 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 618 in 5863 ms (progress: 608/2086) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:665 as TID 665 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 618) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:665 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 625 in 4882 ms (progress: 609/2086) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 625) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:666 as TID 666 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:666 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 626 in 4750 ms (progress: 610/2086) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 626) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:667 as TID 667 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:667 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 576 in 11342 ms (progress: 611/2086) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:668 as TID 668 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 576) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:668 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 602 in 8460 ms (progress: 612/2086) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 602) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:669 as TID 669 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:669 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Finished TID 629 in 4852 ms (progress: 613/2086) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Starting task 5.0:670 as TID 670 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 629) | |
| 13/03/26 20:22:37 INFO cluster.TaskSetManager: Serialized task 5.0:670 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 658 in 2696 ms (progress: 614/2086) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 658) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:671 as TID 671 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:671 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 615 in 7372 ms (progress: 615/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:672 as TID 672 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:672 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 615) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 652 in 3287 ms (progress: 616/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:673 as TID 673 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 652) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:673 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 557 in 14210 ms (progress: 617/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:674 as TID 674 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 557) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:674 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 477 in 22702 ms (progress: 618/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:675 as TID 675 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 477) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:675 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 603 in 9427 ms (progress: 619/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:676 as TID 676 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 603) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:676 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 630 in 5752 ms (progress: 620/2086) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 630) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:677 as TID 677 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:677 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 635 in 5330 ms (progress: 621/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:678 as TID 678 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 635) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:678 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 660 in 3110 ms (progress: 622/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:679 as TID 679 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 660) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:679 as 2384 bytes in 1 ms | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Finished TID 656 in 3240 ms (progress: 623/2086) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Starting task 5.0:680 as TID 680 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 656) | |
| 13/03/26 20:22:38 INFO cluster.TaskSetManager: Serialized task 5.0:680 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Finished TID 599 in 10459 ms (progress: 624/2086) | |
| 13/03/26 20:22:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 599) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Starting task 5.0:681 as TID 681 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Serialized task 5.0:681 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Finished TID 632 in 6426 ms (progress: 625/2086) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Starting task 5.0:682 as TID 682 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 632) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Serialized task 5.0:682 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Finished TID 679 in 845 ms (progress: 626/2086) | |
| 13/03/26 20:22:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 679) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Starting task 5.0:683 as TID 683 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Serialized task 5.0:683 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Finished TID 662 in 2872 ms (progress: 627/2086) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Starting task 5.0:684 as TID 684 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Serialized task 5.0:684 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 662) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Finished TID 664 in 2954 ms (progress: 628/2086) | |
| 13/03/26 20:22:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 664) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Starting task 5.0:685 as TID 685 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:39 INFO cluster.TaskSetManager: Serialized task 5.0:685 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 638 in 6108 ms (progress: 629/2086) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:686 as TID 686 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 638) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:686 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 633 in 7114 ms (progress: 630/2086) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 633) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:687 as TID 687 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:687 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 619 in 8767 ms (progress: 631/2086) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:688 as TID 688 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 619) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:688 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 600 in 11349 ms (progress: 632/2086) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:689 as TID 689 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 600) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:689 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 640 in 6244 ms (progress: 633/2086) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:690 as TID 690 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 640) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:690 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 621 in 8736 ms (progress: 634/2086) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 621) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:691 as TID 691 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:691 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 653 in 5437 ms (progress: 635/2086) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:692 as TID 692 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 653) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:692 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 654 in 5434 ms (progress: 636/2086) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:693 as TID 693 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 654) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:693 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Finished TID 516 in 22204 ms (progress: 637/2086) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Starting task 5.0:694 as TID 694 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 516) | |
| 13/03/26 20:22:40 INFO cluster.TaskSetManager: Serialized task 5.0:694 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 605 in 10951 ms (progress: 638/2086) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:695 as TID 695 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 605) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:695 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 642 in 6886 ms (progress: 639/2086) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:696 as TID 696 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 642) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:696 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 666 in 4068 ms (progress: 640/2086) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:697 as TID 697 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 666) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:697 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 655 in 6103 ms (progress: 641/2086) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 655) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:698 as TID 698 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:698 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 637 in 7628 ms (progress: 642/2086) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:699 as TID 699 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 637) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:699 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 661 in 5048 ms (progress: 643/2086) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:700 as TID 700 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 661) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:700 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 659 in 6092 ms (progress: 644/2086) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:701 as TID 701 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 659) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:701 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 639 in 7695 ms (progress: 645/2086) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 639) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:702 as TID 702 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:702 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Finished TID 670 in 4136 ms (progress: 646/2086) | |
| 13/03/26 20:22:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 670) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Starting task 5.0:703 as TID 703 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:41 INFO cluster.TaskSetManager: Serialized task 5.0:703 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 689 in 1597 ms (progress: 647/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:704 as TID 704 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 689) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:704 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 647 in 7227 ms (progress: 648/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:705 as TID 705 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 647) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:705 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 628 in 9153 ms (progress: 649/2086) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 628) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:706 as TID 706 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:706 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 598 in 13115 ms (progress: 650/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:707 as TID 707 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 598) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:707 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 469 in 28089 ms (progress: 651/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:708 as TID 708 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:708 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 469) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 611 in 12295 ms (progress: 652/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:709 as TID 709 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:709 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 611) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 667 in 5246 ms (progress: 653/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:710 as TID 710 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 667) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:710 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 597 in 13779 ms (progress: 654/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:711 as TID 711 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 597) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:711 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 669 in 4973 ms (progress: 655/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:712 as TID 712 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 669) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:712 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 663 in 5839 ms (progress: 656/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:713 as TID 713 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 663) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:713 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 674 in 4323 ms (progress: 657/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:714 as TID 714 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:714 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 674) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Finished TID 665 in 5825 ms (progress: 658/2086) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Starting task 5.0:715 as TID 715 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 665) | |
| 13/03/26 20:22:42 INFO cluster.TaskSetManager: Serialized task 5.0:715 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Finished TID 646 in 8364 ms (progress: 659/2086) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Starting task 5.0:716 as TID 716 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 646) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Serialized task 5.0:716 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Finished TID 634 in 10124 ms (progress: 660/2086) | |
| 13/03/26 20:22:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 634) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Starting task 5.0:717 as TID 717 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Serialized task 5.0:717 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Finished TID 671 in 5134 ms (progress: 661/2086) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Starting task 5.0:718 as TID 718 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 671) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Serialized task 5.0:718 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Finished TID 651 in 8359 ms (progress: 662/2086) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Starting task 5.0:719 as TID 719 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 651) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Serialized task 5.0:719 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Finished TID 596 in 14793 ms (progress: 663/2086) | |
| 13/03/26 20:22:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 596) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Starting task 5.0:720 as TID 720 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:43 INFO cluster.TaskSetManager: Serialized task 5.0:720 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 561 in 19434 ms (progress: 664/2086) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 561) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:721 as TID 721 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:721 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 682 in 4660 ms (progress: 665/2086) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:722 as TID 722 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 682) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:722 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 657 in 8802 ms (progress: 666/2086) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 657) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:723 as TID 723 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:723 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 678 in 5718 ms (progress: 667/2086) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:724 as TID 724 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 678) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:724 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 677 in 5811 ms (progress: 668/2086) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:725 as TID 725 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 677) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:725 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 680 in 5855 ms (progress: 669/2086) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 680) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:726 as TID 726 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:726 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 684 in 4853 ms (progress: 670/2086) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:727 as TID 727 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 684) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:727 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 685 in 4785 ms (progress: 671/2086) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:728 as TID 728 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 685) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:728 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Finished TID 675 in 6104 ms (progress: 672/2086) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Starting task 5.0:729 as TID 729 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 675) | |
| 13/03/26 20:22:44 INFO cluster.TaskSetManager: Serialized task 5.0:729 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 676 in 6352 ms (progress: 673/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:730 as TID 730 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 676) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:730 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 681 in 5813 ms (progress: 674/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:731 as TID 731 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:731 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 681) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 715 in 2421 ms (progress: 675/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:732 as TID 732 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:732 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 715) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 717 in 2040 ms (progress: 676/2086) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 717) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:733 as TID 733 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:733 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 643 in 11079 ms (progress: 677/2086) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 643) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:734 as TID 734 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:734 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 697 in 4230 ms (progress: 678/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:735 as TID 735 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 697) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:735 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 693 in 4587 ms (progress: 679/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:736 as TID 736 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 693) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:736 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 719 in 1983 ms (progress: 680/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:737 as TID 737 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 719) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:737 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 709 in 2984 ms (progress: 681/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:738 as TID 738 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 709) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:738 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 683 in 6052 ms (progress: 682/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:739 as TID 739 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 683) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:739 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 672 in 7394 ms (progress: 683/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:740 as TID 740 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 672) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:740 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Finished TID 648 in 10868 ms (progress: 684/2086) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Starting task 5.0:741 as TID 741 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 648) | |
| 13/03/26 20:22:45 INFO cluster.TaskSetManager: Serialized task 5.0:741 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 604 in 16612 ms (progress: 685/2086) | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 604) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:742 as TID 742 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:742 as 2384 bytes in 1 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 686 in 5910 ms (progress: 686/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:743 as TID 743 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 686) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:743 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 690 in 5755 ms (progress: 687/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:744 as TID 744 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 690) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:744 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 703 in 4307 ms (progress: 688/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:745 as TID 745 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 703) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:745 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 696 in 5102 ms (progress: 689/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:746 as TID 746 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 696) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:746 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 692 in 5793 ms (progress: 690/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:747 as TID 747 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 692) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:747 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 673 in 8053 ms (progress: 691/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:748 as TID 748 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:748 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 673) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 668 in 9301 ms (progress: 692/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:749 as TID 749 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 668) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:749 as 2395 bytes in 0 ms | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Finished TID 687 in 6596 ms (progress: 693/2086) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Starting task 5.0:750 as TID 750 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:46 INFO cluster.TaskSetManager: Serialized task 5.0:750 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 687) | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Finished TID 700 in 5396 ms (progress: 694/2086) | |
| 13/03/26 20:22:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 700) | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Starting task 5.0:751 as TID 751 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Serialized task 5.0:751 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Finished TID 698 in 5613 ms (progress: 695/2086) | |
| 13/03/26 20:22:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 698) | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Starting task 5.0:752 as TID 752 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Serialized task 5.0:752 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Finished TID 727 in 3139 ms (progress: 696/2086) | |
| 13/03/26 20:22:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 727) | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Starting task 5.0:753 as TID 753 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:47 INFO cluster.TaskSetManager: Serialized task 5.0:753 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 705 in 6012 ms (progress: 697/2086) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 705) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:754 as TID 754 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:754 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 707 in 6002 ms (progress: 698/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:755 as TID 755 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 707) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:755 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 702 in 6489 ms (progress: 699/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:756 as TID 756 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:756 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 702) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 725 in 3844 ms (progress: 700/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:757 as TID 757 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:757 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 725) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 704 in 6423 ms (progress: 701/2086) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 704) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:758 as TID 758 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:758 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 729 in 3716 ms (progress: 702/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:759 as TID 759 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 729) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:759 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 735 in 3038 ms (progress: 703/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:760 as TID 760 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 735) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:760 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 741 in 3019 ms (progress: 704/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:761 as TID 761 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 741) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:761 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 701 in 7082 ms (progress: 705/2086) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 701) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:762 as TID 762 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:762 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 757 in 469 ms (progress: 706/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:763 as TID 763 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 757) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:763 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Finished TID 747 in 2319 ms (progress: 707/2086) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Starting task 5.0:764 as TID 764 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 747) | |
| 13/03/26 20:22:48 INFO cluster.TaskSetManager: Serialized task 5.0:764 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Finished TID 733 in 3733 ms (progress: 708/2086) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Starting task 5.0:765 as TID 765 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 733) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Serialized task 5.0:765 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Finished TID 699 in 7593 ms (progress: 709/2086) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Starting task 5.0:766 as TID 766 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 699) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Serialized task 5.0:766 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Finished TID 691 in 8537 ms (progress: 710/2086) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Starting task 5.0:767 as TID 767 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 691) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Serialized task 5.0:767 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Finished TID 688 in 9066 ms (progress: 711/2086) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Starting task 5.0:768 as TID 768 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 688) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Serialized task 5.0:768 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Finished TID 731 in 4165 ms (progress: 712/2086) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Starting task 5.0:769 as TID 769 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Serialized task 5.0:769 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 731) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Finished TID 708 in 7086 ms (progress: 713/2086) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Starting task 5.0:770 as TID 770 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 708) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Serialized task 5.0:770 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Finished TID 728 in 4841 ms (progress: 714/2086) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Starting task 5.0:771 as TID 771 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 728) | |
| 13/03/26 20:22:49 INFO cluster.TaskSetManager: Serialized task 5.0:771 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 724 in 5535 ms (progress: 715/2086) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:772 as TID 772 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 724) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:772 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 737 in 4546 ms (progress: 716/2086) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:773 as TID 773 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 737) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:773 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 706 in 8237 ms (progress: 717/2086) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:774 as TID 774 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 706) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:774 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 751 in 3497 ms (progress: 718/2086) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 751) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:775 as TID 775 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:775 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 721 in 6476 ms (progress: 719/2086) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:776 as TID 776 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 721) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:776 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 745 in 4538 ms (progress: 720/2086) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:777 as TID 777 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 745) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:777 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 726 in 6132 ms (progress: 721/2086) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:778 as TID 778 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 726) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:778 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Finished TID 695 in 9687 ms (progress: 722/2086) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Starting task 5.0:779 as TID 779 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 695) | |
| 13/03/26 20:22:50 INFO cluster.TaskSetManager: Serialized task 5.0:779 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 730 in 5954 ms (progress: 723/2086) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:780 as TID 780 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 730) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:780 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 732 in 5887 ms (progress: 724/2086) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:781 as TID 781 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:781 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 732) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 746 in 4929 ms (progress: 725/2086) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 746) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:782 as TID 782 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:782 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 736 in 5810 ms (progress: 726/2086) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 736) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:783 as TID 783 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:783 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 645 in 16832 ms (progress: 727/2086) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 645) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:784 as TID 784 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:784 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 711 in 8746 ms (progress: 728/2086) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 711) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:785 as TID 785 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:785 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 749 in 4741 ms (progress: 729/2086) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:786 as TID 786 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:786 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 749) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 720 in 7946 ms (progress: 730/2086) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:787 as TID 787 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 720) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:787 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 734 in 6098 ms (progress: 731/2086) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:788 as TID 788 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 734) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:788 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 564 in 26767 ms (progress: 732/2086) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:789 as TID 789 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 564) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:789 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 739 in 6016 ms (progress: 733/2086) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 739) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:790 as TID 790 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:790 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Finished TID 712 in 9193 ms (progress: 734/2086) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Starting task 5.0:791 as TID 791 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 712) | |
| 13/03/26 20:22:51 INFO cluster.TaskSetManager: Serialized task 5.0:791 as 2397 bytes in 1 ms | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Finished TID 743 in 6013 ms (progress: 735/2086) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Starting task 5.0:792 as TID 792 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Serialized task 5.0:792 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 743) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Finished TID 740 in 6403 ms (progress: 736/2086) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Starting task 5.0:793 as TID 793 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 740) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Serialized task 5.0:793 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Finished TID 744 in 6035 ms (progress: 737/2086) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Starting task 5.0:794 as TID 794 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 744) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Serialized task 5.0:794 as 2397 bytes in 0 ms | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Finished TID 742 in 6289 ms (progress: 738/2086) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Starting task 5.0:795 as TID 795 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 742) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Serialized task 5.0:795 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Finished TID 753 in 4805 ms (progress: 739/2086) | |
| 13/03/26 20:22:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 753) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Starting task 5.0:796 as TID 796 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Serialized task 5.0:796 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Finished TID 760 in 4177 ms (progress: 740/2086) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Starting task 5.0:797 as TID 797 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 760) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Serialized task 5.0:797 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Finished TID 748 in 6331 ms (progress: 741/2086) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Starting task 5.0:798 as TID 798 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 748) | |
| 13/03/26 20:22:52 INFO cluster.TaskSetManager: Serialized task 5.0:798 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 761 in 4277 ms (progress: 742/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:799 as TID 799 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 761) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:799 as 2385 bytes in 1 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 718 in 9617 ms (progress: 743/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:800 as TID 800 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 718) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:800 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 752 in 5939 ms (progress: 744/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:801 as TID 801 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 752) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:801 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 750 in 6489 ms (progress: 745/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:802 as TID 802 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:802 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 750) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 780 in 2538 ms (progress: 746/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:803 as TID 803 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 780) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:803 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 722 in 9444 ms (progress: 747/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:804 as TID 804 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 722) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:804 as 2404 bytes in 0 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 723 in 9218 ms (progress: 748/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:805 as TID 805 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 723) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:805 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 774 in 3461 ms (progress: 749/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:806 as TID 806 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 774) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:806 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 763 in 5072 ms (progress: 750/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:807 as TID 807 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 763) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:807 as 2398 bytes in 1 ms | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Finished TID 758 in 5514 ms (progress: 751/2086) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Starting task 5.0:808 as TID 808 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:53 INFO cluster.TaskSetManager: Serialized task 5.0:808 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 758) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 756 in 5756 ms (progress: 752/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:809 as TID 809 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 756) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:809 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 754 in 6006 ms (progress: 753/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:810 as TID 810 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 754) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:810 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 755 in 6100 ms (progress: 754/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:811 as TID 811 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 755) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:811 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 649 in 19216 ms (progress: 755/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:812 as TID 812 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 649) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:812 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 771 in 4805 ms (progress: 756/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:813 as TID 813 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 771) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:813 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 773 in 4389 ms (progress: 757/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:814 as TID 814 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 773) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:814 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 694 in 13659 ms (progress: 758/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:815 as TID 815 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 694) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:815 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 764 in 5836 ms (progress: 759/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:816 as TID 816 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 764) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:816 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 794 in 2676 ms (progress: 760/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:817 as TID 817 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 794) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:817 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 765 in 5725 ms (progress: 761/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:818 as TID 818 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 765) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:818 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Finished TID 644 in 20474 ms (progress: 762/2086) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Starting task 5.0:819 as TID 819 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 644) | |
| 13/03/26 20:22:54 INFO cluster.TaskSetManager: Serialized task 5.0:819 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 759 in 6589 ms (progress: 763/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:820 as TID 820 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 759) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:820 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 762 in 6284 ms (progress: 764/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:821 as TID 821 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 762) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:821 as 2386 bytes in 1 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 784 in 3829 ms (progress: 765/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:822 as TID 822 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 784) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:822 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 768 in 5836 ms (progress: 766/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:823 as TID 823 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 768) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:823 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 769 in 5829 ms (progress: 767/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:824 as TID 824 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:824 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 769) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 777 in 4589 ms (progress: 768/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:825 as TID 825 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 777) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:825 as 2386 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 775 in 5011 ms (progress: 769/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:826 as TID 826 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 775) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:826 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 772 in 5624 ms (progress: 770/2086) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 772) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:827 as TID 827 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:827 as 2399 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 770 in 6089 ms (progress: 771/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:828 as TID 828 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 770) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:828 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Finished TID 800 in 2685 ms (progress: 772/2086) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Starting task 5.0:829 as TID 829 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 800) | |
| 13/03/26 20:22:55 INFO cluster.TaskSetManager: Serialized task 5.0:829 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Finished TID 776 in 5552 ms (progress: 773/2086) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Starting task 5.0:830 as TID 830 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:22:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 776) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Serialized task 5.0:830 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Finished TID 791 in 4458 ms (progress: 774/2086) | |
| 13/03/26 20:22:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 791) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Starting task 5.0:831 as TID 831 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Serialized task 5.0:831 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Finished TID 788 in 5246 ms (progress: 775/2086) | |
| 13/03/26 20:22:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 788) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Starting task 5.0:832 as TID 832 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Serialized task 5.0:832 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Finished TID 787 in 5276 ms (progress: 776/2086) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Starting task 5.0:833 as TID 833 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:56 INFO cluster.TaskSetManager: Serialized task 5.0:833 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 787) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 778 in 6332 ms (progress: 777/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:834 as TID 834 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 778) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:834 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 797 in 4414 ms (progress: 778/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:835 as TID 835 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 797) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:835 as 2399 bytes in 1 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 809 in 3162 ms (progress: 779/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:836 as TID 836 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 809) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:836 as 2400 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 781 in 6026 ms (progress: 780/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:837 as TID 837 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 781) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:837 as 2400 bytes in 1 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 766 in 8044 ms (progress: 781/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:838 as TID 838 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:838 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 766) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 799 in 4288 ms (progress: 782/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:839 as TID 839 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:839 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 799) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 782 in 6224 ms (progress: 783/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:840 as TID 840 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 782) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:840 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 796 in 4869 ms (progress: 784/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:841 as TID 841 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 796) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:841 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 713 in 14693 ms (progress: 785/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:842 as TID 842 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:842 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 713) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 812 in 3189 ms (progress: 786/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:843 as TID 843 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 812) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:843 as 2385 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 785 in 6271 ms (progress: 787/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:844 as TID 844 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 785) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:844 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 786 in 6308 ms (progress: 788/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:845 as TID 845 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:845 as 2384 bytes in 1 ms | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 786) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 514 in 39366 ms (progress: 789/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:846 as TID 846 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 514) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:846 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 790 in 6184 ms (progress: 790/2086) | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 790) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:847 as TID 847 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:847 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Finished TID 806 in 4190 ms (progress: 791/2086) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Starting task 5.0:848 as TID 848 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:22:57 INFO cluster.TaskSetManager: Serialized task 5.0:848 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 806) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Finished TID 792 in 6033 ms (progress: 792/2086) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Starting task 5.0:849 as TID 849 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:22:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 792) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Serialized task 5.0:849 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Finished TID 783 in 7181 ms (progress: 793/2086) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Starting task 5.0:850 as TID 850 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:22:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 783) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Serialized task 5.0:850 as 2395 bytes in 2 ms | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Finished TID 815 in 3936 ms (progress: 794/2086) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Starting task 5.0:851 as TID 851 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Serialized task 5.0:851 as 2395 bytes in 1 ms | |
| 13/03/26 20:22:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 815) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Finished TID 795 in 6200 ms (progress: 795/2086) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Starting task 5.0:852 as TID 852 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Serialized task 5.0:852 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 795) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Finished TID 825 in 3385 ms (progress: 796/2086) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Starting task 5.0:853 as TID 853 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Serialized task 5.0:853 as 2398 bytes in 0 ms | |
| 13/03/26 20:22:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 825) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Finished TID 818 in 3939 ms (progress: 797/2086) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Starting task 5.0:854 as TID 854 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:22:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 818) | |
| 13/03/26 20:22:58 INFO cluster.TaskSetManager: Serialized task 5.0:854 as 2384 bytes in 1 ms | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Finished TID 738 in 13385 ms (progress: 798/2086) | |
| 13/03/26 20:22:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 738) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Starting task 5.0:855 as TID 855 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Serialized task 5.0:855 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Finished TID 829 in 3423 ms (progress: 799/2086) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Starting task 5.0:856 as TID 856 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:22:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 829) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Serialized task 5.0:856 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Finished TID 798 in 6266 ms (progress: 800/2086) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Starting task 5.0:857 as TID 857 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:22:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 798) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Serialized task 5.0:857 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Finished TID 827 in 3653 ms (progress: 801/2086) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Starting task 5.0:858 as TID 858 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:22:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 827) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Serialized task 5.0:858 as 2384 bytes in 0 ms | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Finished TID 831 in 3047 ms (progress: 802/2086) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Starting task 5.0:859 as TID 859 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:22:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 831) | |
| 13/03/26 20:22:59 INFO cluster.TaskSetManager: Serialized task 5.0:859 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 843 in 2611 ms (progress: 803/2086) | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 843) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:860 as TID 860 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:860 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 835 in 3162 ms (progress: 804/2086) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:861 as TID 861 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 835) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:861 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 833 in 3596 ms (progress: 805/2086) | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 833) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:862 as TID 862 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:862 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 826 in 4957 ms (progress: 806/2086) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:863 as TID 863 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 826) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:863 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 710 in 17940 ms (progress: 807/2086) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:864 as TID 864 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 710) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:864 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 767 in 11664 ms (progress: 808/2086) | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 767) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:865 as TID 865 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:865 as 2385 bytes in 1 ms | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 803 in 7380 ms (progress: 809/2086) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:866 as TID 866 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:866 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 803) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Finished TID 830 in 4770 ms (progress: 810/2086) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Starting task 5.0:867 as TID 867 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:00 INFO cluster.TaskSetManager: Serialized task 5.0:867 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 830) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Finished TID 859 in 1585 ms (progress: 811/2086) | |
| 13/03/26 20:23:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 859) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Starting task 5.0:868 as TID 868 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Serialized task 5.0:868 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Finished TID 824 in 5935 ms (progress: 812/2086) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Starting task 5.0:869 as TID 869 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Serialized task 5.0:869 as 2385 bytes in 1 ms | |
| 13/03/26 20:23:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 824) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Finished TID 802 in 7892 ms (progress: 813/2086) | |
| 13/03/26 20:23:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 802) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Starting task 5.0:870 as TID 870 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Serialized task 5.0:870 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Finished TID 837 in 4193 ms (progress: 814/2086) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Starting task 5.0:871 as TID 871 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 837) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Serialized task 5.0:871 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Finished TID 821 in 6497 ms (progress: 815/2086) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Starting task 5.0:872 as TID 872 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Serialized task 5.0:872 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 821) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Finished TID 822 in 6517 ms (progress: 816/2086) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Starting task 5.0:873 as TID 873 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Serialized task 5.0:873 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 822) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Finished TID 839 in 4486 ms (progress: 817/2086) | |
| 13/03/26 20:23:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 839) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Starting task 5.0:874 as TID 874 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:01 INFO cluster.TaskSetManager: Serialized task 5.0:874 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 714 in 19092 ms (progress: 818/2086) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:875 as TID 875 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:875 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 714) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 828 in 6447 ms (progress: 819/2086) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 828) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:876 as TID 876 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:876 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 808 in 8197 ms (progress: 820/2086) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:877 as TID 877 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 808) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:877 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 853 in 3507 ms (progress: 821/2086) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:878 as TID 878 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 853) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:878 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 841 in 4788 ms (progress: 822/2086) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:879 as TID 879 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 841) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:879 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 836 in 5158 ms (progress: 823/2086) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:880 as TID 880 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 836) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:880 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 789 in 10907 ms (progress: 824/2086) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:881 as TID 881 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 789) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:881 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 820 in 7509 ms (progress: 825/2086) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:882 as TID 882 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 820) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:882 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 849 in 4475 ms (progress: 826/2086) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 849) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:883 as TID 883 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:883 as 2397 bytes in 6 ms | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Finished TID 840 in 5271 ms (progress: 827/2086) | |
| 13/03/26 20:23:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 840) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Starting task 5.0:884 as TID 884 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:02 INFO cluster.TaskSetManager: Serialized task 5.0:884 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Finished TID 834 in 5876 ms (progress: 828/2086) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Starting task 5.0:885 as TID 885 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 834) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Serialized task 5.0:885 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Finished TID 832 in 6260 ms (progress: 829/2086) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Starting task 5.0:886 as TID 886 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 832) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Serialized task 5.0:886 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Finished TID 810 in 9164 ms (progress: 830/2086) | |
| 13/03/26 20:23:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 810) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Starting task 5.0:887 as TID 887 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Serialized task 5.0:887 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Finished TID 813 in 8882 ms (progress: 831/2086) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Starting task 5.0:888 as TID 888 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 813) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Serialized task 5.0:888 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Finished TID 845 in 5770 ms (progress: 832/2086) | |
| 13/03/26 20:23:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 845) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Starting task 5.0:889 as TID 889 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:03 INFO cluster.TaskSetManager: Serialized task 5.0:889 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 847 in 6133 ms (progress: 833/2086) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 847) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:890 as TID 890 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:890 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 823 in 8795 ms (progress: 834/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:891 as TID 891 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 823) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:891 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 793 in 11973 ms (progress: 835/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:892 as TID 892 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 793) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:892 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 779 in 13399 ms (progress: 836/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:893 as TID 893 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 779) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:893 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 844 in 6732 ms (progress: 837/2086) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 844) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:894 as TID 894 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:894 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 838 in 7272 ms (progress: 838/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:895 as TID 895 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 838) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:895 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 852 in 6090 ms (progress: 839/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:896 as TID 896 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 852) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:896 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 882 in 2080 ms (progress: 840/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:897 as TID 897 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 882) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:897 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 876 in 2590 ms (progress: 841/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:898 as TID 898 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:898 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 876) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 856 in 5549 ms (progress: 842/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:899 as TID 899 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:899 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 856) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Finished TID 846 in 7053 ms (progress: 843/2086) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Starting task 5.0:900 as TID 900 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 846) | |
| 13/03/26 20:23:04 INFO cluster.TaskSetManager: Serialized task 5.0:900 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 861 in 4718 ms (progress: 844/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:901 as TID 901 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 861) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:901 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 716 in 21933 ms (progress: 845/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:902 as TID 902 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 716) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:902 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 860 in 4873 ms (progress: 846/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:903 as TID 903 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 860) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:903 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 858 in 5741 ms (progress: 847/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:904 as TID 904 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 858) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:904 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 867 in 4520 ms (progress: 848/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:905 as TID 905 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 867) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:905 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 884 in 2930 ms (progress: 849/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:906 as TID 906 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 884) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:906 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 863 in 5152 ms (progress: 850/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:907 as TID 907 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 863) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:907 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 890 in 1718 ms (progress: 851/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:908 as TID 908 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 890) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:908 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 862 in 5328 ms (progress: 852/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:909 as TID 909 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:909 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 862) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 854 in 6905 ms (progress: 853/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:910 as TID 910 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 854) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:910 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Finished TID 848 in 7858 ms (progress: 854/2086) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Starting task 5.0:911 as TID 911 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:05 INFO cluster.TaskSetManager: Serialized task 5.0:911 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 848) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 816 in 11297 ms (progress: 855/2086) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:912 as TID 912 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 816) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:912 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 874 in 4323 ms (progress: 856/2086) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:913 as TID 913 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 874) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:913 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 902 in 1098 ms (progress: 857/2086) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:914 as TID 914 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:914 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 902) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 868 in 5151 ms (progress: 858/2086) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:915 as TID 915 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 868) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:915 as 2404 bytes in 1 ms | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 558 in 41610 ms (progress: 859/2086) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:916 as TID 916 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:916 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 558) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 842 in 8789 ms (progress: 860/2086) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:917 as TID 917 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 842) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:917 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 871 in 5117 ms (progress: 861/2086) | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 871) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:918 as TID 918 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:918 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 896 in 2212 ms (progress: 862/2086) | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 896) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:919 as TID 919 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:919 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Finished TID 814 in 12376 ms (progress: 863/2086) | |
| 13/03/26 20:23:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 814) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Starting task 5.0:920 as TID 920 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:06 INFO cluster.TaskSetManager: Serialized task 5.0:920 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 870 in 5709 ms (progress: 864/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 870) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:921 as TID 921 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:921 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 879 in 4728 ms (progress: 865/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 879) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:922 as TID 922 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:922 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 878 in 4826 ms (progress: 866/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 878) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:923 as TID 923 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:923 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 850 in 8577 ms (progress: 867/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 850) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:924 as TID 924 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:924 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 869 in 5929 ms (progress: 868/2086) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:925 as TID 925 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 869) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:925 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 866 in 6300 ms (progress: 869/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 866) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:926 as TID 926 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:926 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 880 in 4888 ms (progress: 870/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 880) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:927 as TID 927 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:927 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 873 in 5750 ms (progress: 871/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 873) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:928 as TID 928 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:928 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 877 in 5392 ms (progress: 872/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 877) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:929 as TID 929 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:929 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 908 in 1824 ms (progress: 873/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 908) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:930 as TID 930 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:930 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 865 in 6725 ms (progress: 874/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 865) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:931 as TID 931 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:931 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 804 in 14046 ms (progress: 875/2086) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:932 as TID 932 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:932 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 804) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 875 in 5762 ms (progress: 876/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 875) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:933 as TID 933 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:933 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Finished TID 819 in 12806 ms (progress: 877/2086) | |
| 13/03/26 20:23:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 819) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Starting task 5.0:934 as TID 934 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:07 INFO cluster.TaskSetManager: Serialized task 5.0:934 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Finished TID 888 in 4860 ms (progress: 878/2086) | |
| 13/03/26 20:23:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 888) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Starting task 5.0:935 as TID 935 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Serialized task 5.0:935 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Finished TID 805 in 14619 ms (progress: 879/2086) | |
| 13/03/26 20:23:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 805) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Starting task 5.0:936 as TID 936 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Serialized task 5.0:936 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Finished TID 872 in 6709 ms (progress: 880/2086) | |
| 13/03/26 20:23:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 872) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Starting task 5.0:937 as TID 937 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Serialized task 5.0:937 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Finished TID 883 in 5925 ms (progress: 881/2086) | |
| 13/03/26 20:23:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 883) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Starting task 5.0:938 as TID 938 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Serialized task 5.0:938 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Finished TID 887 in 5662 ms (progress: 882/2086) | |
| 13/03/26 20:23:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 887) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Starting task 5.0:939 as TID 939 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:08 INFO cluster.TaskSetManager: Serialized task 5.0:939 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 885 in 6163 ms (progress: 883/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 885) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:940 as TID 940 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:940 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 851 in 10712 ms (progress: 884/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 851) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:941 as TID 941 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:941 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 901 in 4420 ms (progress: 885/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 901) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:942 as TID 942 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:942 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 914 in 3504 ms (progress: 886/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 914) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:943 as TID 943 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:943 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 889 in 6190 ms (progress: 887/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 889) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:944 as TID 944 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:944 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 886 in 6727 ms (progress: 888/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 886) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:945 as TID 945 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:945 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 899 in 5084 ms (progress: 889/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 899) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:946 as TID 946 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:946 as 2386 bytes in 1 ms | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Finished TID 903 in 4844 ms (progress: 890/2086) | |
| 13/03/26 20:23:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 903) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Starting task 5.0:947 as TID 947 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:09 INFO cluster.TaskSetManager: Serialized task 5.0:947 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 905 in 4737 ms (progress: 891/2086) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 905) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:948 as TID 948 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:948 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 857 in 11105 ms (progress: 892/2086) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 857) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:949 as TID 949 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:949 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 913 in 4251 ms (progress: 893/2086) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 913) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:950 as TID 950 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:950 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 906 in 5190 ms (progress: 894/2086) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 906) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:951 as TID 951 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:951 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 811 in 16681 ms (progress: 895/2086) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 811) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:952 as TID 952 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:952 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 904 in 5837 ms (progress: 896/2086) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 904) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:953 as TID 953 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:953 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 897 in 6226 ms (progress: 897/2086) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:954 as TID 954 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 897) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:954 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Finished TID 907 in 5216 ms (progress: 898/2086) | |
| 13/03/26 20:23:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 907) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Starting task 5.0:955 as TID 955 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:10 INFO cluster.TaskSetManager: Serialized task 5.0:955 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 895 in 6483 ms (progress: 899/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 895) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:956 as TID 956 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:956 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 909 in 5358 ms (progress: 900/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 909) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:957 as TID 957 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:957 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 932 in 3680 ms (progress: 901/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 932) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:958 as TID 958 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:958 as 2399 bytes in 6 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 898 in 6788 ms (progress: 902/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 898) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:959 as TID 959 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:959 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 864 in 11041 ms (progress: 903/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 864) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:960 as TID 960 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:960 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 910 in 6015 ms (progress: 904/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 910) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:961 as TID 961 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:961 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 912 in 5870 ms (progress: 905/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 912) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:962 as TID 962 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:962 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 894 in 7522 ms (progress: 906/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 894) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:963 as TID 963 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:963 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Finished TID 881 in 9440 ms (progress: 907/2086) | |
| 13/03/26 20:23:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 881) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Starting task 5.0:964 as TID 964 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:11 INFO cluster.TaskSetManager: Serialized task 5.0:964 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Finished TID 930 in 4510 ms (progress: 908/2086) | |
| 13/03/26 20:23:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 930) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Starting task 5.0:965 as TID 965 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Serialized task 5.0:965 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Finished TID 926 in 4937 ms (progress: 909/2086) | |
| 13/03/26 20:23:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 926) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Starting task 5.0:966 as TID 966 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Serialized task 5.0:966 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Finished TID 855 in 13207 ms (progress: 910/2086) | |
| 13/03/26 20:23:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 855) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Starting task 5.0:967 as TID 967 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Serialized task 5.0:967 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Finished TID 911 in 6623 ms (progress: 911/2086) | |
| 13/03/26 20:23:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 911) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Starting task 5.0:968 as TID 968 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Serialized task 5.0:968 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Finished TID 936 in 4181 ms (progress: 912/2086) | |
| 13/03/26 20:23:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 936) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Starting task 5.0:969 as TID 969 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Serialized task 5.0:969 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Finished TID 950 in 2585 ms (progress: 913/2086) | |
| 13/03/26 20:23:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 950) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Starting task 5.0:970 as TID 970 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:12 INFO cluster.TaskSetManager: Serialized task 5.0:970 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Finished TID 958 in 1772 ms (progress: 914/2086) | |
| 13/03/26 20:23:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 958) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Starting task 5.0:971 as TID 971 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Serialized task 5.0:971 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Finished TID 955 in 2286 ms (progress: 915/2086) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Starting task 5.0:972 as TID 972 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 955) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Serialized task 5.0:972 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Finished TID 922 in 6347 ms (progress: 916/2086) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Starting task 5.0:973 as TID 973 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 922) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Serialized task 5.0:973 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Finished TID 940 in 4372 ms (progress: 917/2086) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Starting task 5.0:974 as TID 974 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 940) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Serialized task 5.0:974 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Finished TID 942 in 4230 ms (progress: 918/2086) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Starting task 5.0:975 as TID 975 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 942) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Serialized task 5.0:975 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Finished TID 946 in 4110 ms (progress: 919/2086) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Starting task 5.0:976 as TID 976 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 946) | |
| 13/03/26 20:23:13 INFO cluster.TaskSetManager: Serialized task 5.0:976 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 952 in 3366 ms (progress: 920/2086) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:977 as TID 977 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:977 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 952) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 947 in 4565 ms (progress: 921/2086) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:978 as TID 978 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 947) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:978 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 954 in 3570 ms (progress: 922/2086) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:979 as TID 979 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:979 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 954) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 957 in 3374 ms (progress: 923/2086) | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 957) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:980 as TID 980 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:980 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 900 in 9583 ms (progress: 924/2086) | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 900) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:981 as TID 981 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:981 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 979 in 398 ms (progress: 925/2086) | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 979) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:982 as TID 982 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:982 as 2395 bytes in 0 ms | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 934 in 7161 ms (progress: 926/2086) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:983 as TID 983 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 934) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:983 as 2395 bytes in 0 ms | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Finished TID 928 in 7546 ms (progress: 927/2086) | |
| 13/03/26 20:23:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 928) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Starting task 5.0:984 as TID 984 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:14 INFO cluster.TaskSetManager: Serialized task 5.0:984 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 963 in 3129 ms (progress: 928/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 963) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:985 as TID 985 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:985 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 920 in 8221 ms (progress: 929/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 920) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:986 as TID 986 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:986 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 801 in 22079 ms (progress: 930/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 801) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:987 as TID 987 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:987 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 969 in 3175 ms (progress: 931/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 969) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:988 as TID 988 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:988 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 892 in 11640 ms (progress: 932/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 892) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:989 as TID 989 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:989 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 981 in 1235 ms (progress: 933/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 981) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:990 as TID 990 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:990 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 948 in 5689 ms (progress: 934/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 948) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:991 as TID 991 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:991 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 972 in 2748 ms (progress: 935/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 972) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:992 as TID 992 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:992 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Finished TID 951 in 5138 ms (progress: 936/2086) | |
| 13/03/26 20:23:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 951) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Starting task 5.0:993 as TID 993 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:15 INFO cluster.TaskSetManager: Serialized task 5.0:993 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Finished TID 943 in 6500 ms (progress: 937/2086) | |
| 13/03/26 20:23:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 943) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Starting task 5.0:994 as TID 994 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Serialized task 5.0:994 as 2385 bytes in 1 ms | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Finished TID 945 in 6390 ms (progress: 938/2086) | |
| 13/03/26 20:23:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 945) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Starting task 5.0:995 as TID 995 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Serialized task 5.0:995 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Finished TID 944 in 6596 ms (progress: 939/2086) | |
| 13/03/26 20:23:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 944) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Starting task 5.0:996 as TID 996 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Serialized task 5.0:996 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Finished TID 953 in 5536 ms (progress: 940/2086) | |
| 13/03/26 20:23:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 953) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Starting task 5.0:997 as TID 997 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Serialized task 5.0:997 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Finished TID 817 in 21589 ms (progress: 941/2086) | |
| 13/03/26 20:23:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 817) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Starting task 5.0:998 as TID 998 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Serialized task 5.0:998 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Finished TID 980 in 2252 ms (progress: 942/2086) | |
| 13/03/26 20:23:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 980) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Starting task 5.0:999 as TID 999 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:16 INFO cluster.TaskSetManager: Serialized task 5.0:999 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 919 in 10213 ms (progress: 943/2086) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 919) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1000 as TID 1000 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1000 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 956 in 6309 ms (progress: 944/2086) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1001 as TID 1001 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 956) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1001 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 970 in 4478 ms (progress: 945/2086) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1002 as TID 1002 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1002 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 970) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 961 in 5675 ms (progress: 946/2086) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1003 as TID 1003 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 961) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1003 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 923 in 10441 ms (progress: 947/2086) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1004 as TID 1004 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 923) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1004 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 962 in 5703 ms (progress: 948/2086) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 962) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1005 as TID 1005 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1005 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 959 in 6198 ms (progress: 949/2086) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 959) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1006 as TID 1006 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1006 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 921 in 10806 ms (progress: 950/2086) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 921) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1007 as TID 1007 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1007 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 891 in 13768 ms (progress: 951/2086) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 891) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1008 as TID 1008 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1008 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 975 in 4185 ms (progress: 952/2086) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 975) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1009 as TID 1009 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1009 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Finished TID 949 in 7703 ms (progress: 953/2086) | |
| 13/03/26 20:23:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 949) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Starting task 5.0:1010 as TID 1010 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:17 INFO cluster.TaskSetManager: Serialized task 5.0:1010 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Finished TID 993 in 2005 ms (progress: 954/2086) | |
| 13/03/26 20:23:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 993) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Starting task 5.0:1011 as TID 1011 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Serialized task 5.0:1011 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Finished TID 938 in 9499 ms (progress: 955/2086) | |
| 13/03/26 20:23:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 938) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Starting task 5.0:1012 as TID 1012 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Serialized task 5.0:1012 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Finished TID 978 in 3689 ms (progress: 956/2086) | |
| 13/03/26 20:23:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 978) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Starting task 5.0:1013 as TID 1013 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Serialized task 5.0:1013 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Finished TID 973 in 4799 ms (progress: 957/2086) | |
| 13/03/26 20:23:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 973) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Starting task 5.0:1014 as TID 1014 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Serialized task 5.0:1014 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Finished TID 929 in 10777 ms (progress: 958/2086) | |
| 13/03/26 20:23:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 929) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Starting task 5.0:1015 as TID 1015 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Serialized task 5.0:1015 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Finished TID 965 in 6375 ms (progress: 959/2086) | |
| 13/03/26 20:23:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 965) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Starting task 5.0:1016 as TID 1016 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Serialized task 5.0:1016 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Finished TID 985 in 3744 ms (progress: 960/2086) | |
| 13/03/26 20:23:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 985) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Starting task 5.0:1017 as TID 1017 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:18 INFO cluster.TaskSetManager: Serialized task 5.0:1017 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 918 in 12450 ms (progress: 961/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 918) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1018 as TID 1018 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1018 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 976 in 5166 ms (progress: 962/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 976) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1019 as TID 1019 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1019 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 971 in 5974 ms (progress: 963/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 971) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1020 as TID 1020 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1020 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 941 in 9923 ms (progress: 964/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 941) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1021 as TID 1021 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1021 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 966 in 7096 ms (progress: 965/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 966) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1022 as TID 1022 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1022 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 964 in 7416 ms (progress: 966/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 964) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1023 as TID 1023 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1023 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 968 in 7194 ms (progress: 967/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 968) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1024 as TID 1024 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1024 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 974 in 6118 ms (progress: 968/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 974) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1025 as TID 1025 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1025 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 933 in 11904 ms (progress: 969/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 933) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1026 as TID 1026 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1026 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 987 in 4522 ms (progress: 970/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 987) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1027 as TID 1027 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1027 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 986 in 4719 ms (progress: 971/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 986) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1028 as TID 1028 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1028 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 924 in 12746 ms (progress: 972/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 924) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1029 as TID 1029 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1029 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Finished TID 927 in 12689 ms (progress: 973/2086) | |
| 13/03/26 20:23:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 927) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Starting task 5.0:1030 as TID 1030 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:19 INFO cluster.TaskSetManager: Serialized task 5.0:1030 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Finished TID 977 in 5990 ms (progress: 974/2086) | |
| 13/03/26 20:23:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 977) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Starting task 5.0:1031 as TID 1031 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Serialized task 5.0:1031 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Finished TID 1019 in 1566 ms (progress: 975/2086) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Starting task 5.0:1032 as TID 1032 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1019) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Serialized task 5.0:1032 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Finished TID 982 in 5922 ms (progress: 976/2086) | |
| 13/03/26 20:23:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 982) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Starting task 5.0:1033 as TID 1033 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Serialized task 5.0:1033 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Finished TID 992 in 4946 ms (progress: 977/2086) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Starting task 5.0:1034 as TID 1034 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 992) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Serialized task 5.0:1034 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Finished TID 999 in 4180 ms (progress: 978/2086) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Starting task 5.0:1035 as TID 1035 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 999) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Serialized task 5.0:1035 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Finished TID 984 in 5977 ms (progress: 979/2086) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Starting task 5.0:1036 as TID 1036 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:20 INFO cluster.TaskSetManager: Serialized task 5.0:1036 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 984) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 925 in 13925 ms (progress: 980/2086) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1037 as TID 1037 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 925) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1037 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 960 in 9965 ms (progress: 981/2086) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1038 as TID 1038 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 960) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1038 as 2397 bytes in 7 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 939 in 12772 ms (progress: 982/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 939) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1039 as TID 1039 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1039 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 988 in 6081 ms (progress: 983/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 988) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1040 as TID 1040 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1040 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 915 in 15579 ms (progress: 984/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 915) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1041 as TID 1041 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1041 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 1009 in 3891 ms (progress: 985/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1009) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1042 as TID 1042 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1042 as 2385 bytes in 1 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 1002 in 4303 ms (progress: 986/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1002) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1043 as TID 1043 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1043 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 1014 in 3621 ms (progress: 987/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1014) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1044 as TID 1044 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1044 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 1005 in 4237 ms (progress: 988/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1005) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1045 as TID 1045 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1045 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Finished TID 983 in 6917 ms (progress: 989/2086) | |
| 13/03/26 20:23:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 983) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Starting task 5.0:1046 as TID 1046 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:21 INFO cluster.TaskSetManager: Serialized task 5.0:1046 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 937 in 13754 ms (progress: 990/2086) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 937) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1047 as TID 1047 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1047 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 893 in 17961 ms (progress: 991/2086) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 893) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1048 as TID 1048 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1048 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 997 in 5864 ms (progress: 992/2086) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 997) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1049 as TID 1049 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1049 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 998 in 5875 ms (progress: 993/2086) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 998) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1050 as TID 1050 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1050 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 1004 in 4902 ms (progress: 994/2086) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1004) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1051 as TID 1051 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1051 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 931 in 14906 ms (progress: 995/2086) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1052 as TID 1052 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 931) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1052 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 995 in 6377 ms (progress: 996/2086) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1053 as TID 1053 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 995) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1053 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 1003 in 5181 ms (progress: 997/2086) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1054 as TID 1054 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1003) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1054 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Finished TID 996 in 6607 ms (progress: 998/2086) | |
| 13/03/26 20:23:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 996) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Starting task 5.0:1055 as TID 1055 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:22 INFO cluster.TaskSetManager: Serialized task 5.0:1055 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Finished TID 1013 in 4908 ms (progress: 999/2086) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Starting task 5.0:1056 as TID 1056 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1013) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Serialized task 5.0:1056 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Finished TID 1011 in 5111 ms (progress: 1000/2086) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Starting task 5.0:1057 as TID 1057 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Serialized task 5.0:1057 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1011) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Finished TID 1001 in 5817 ms (progress: 1001/2086) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Starting task 5.0:1058 as TID 1058 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Serialized task 5.0:1058 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1001) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Finished TID 994 in 7057 ms (progress: 1002/2086) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Starting task 5.0:1059 as TID 1059 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 994) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Serialized task 5.0:1059 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Finished TID 1000 in 6227 ms (progress: 1003/2086) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Starting task 5.0:1060 as TID 1060 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Serialized task 5.0:1060 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1000) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Finished TID 989 in 7805 ms (progress: 1004/2086) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Starting task 5.0:1061 as TID 1061 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 989) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Serialized task 5.0:1061 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Finished TID 1007 in 6142 ms (progress: 1005/2086) | |
| 13/03/26 20:23:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1007) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Starting task 5.0:1062 as TID 1062 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:23 INFO cluster.TaskSetManager: Serialized task 5.0:1062 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1012 in 5948 ms (progress: 1006/2086) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1063 as TID 1063 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1012) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1063 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1006 in 6329 ms (progress: 1007/2086) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1064 as TID 1064 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1064 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1006) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1010 in 6055 ms (progress: 1008/2086) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1065 as TID 1065 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1065 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1010) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1034 in 3256 ms (progress: 1009/2086) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1066 as TID 1066 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1034) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1066 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1028 in 4480 ms (progress: 1010/2086) | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1028) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1067 as TID 1067 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1067 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1020 in 5406 ms (progress: 1011/2086) | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1020) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1068 as TID 1068 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1068 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1016 in 6160 ms (progress: 1012/2086) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1069 as TID 1069 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1016) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1069 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Finished TID 1024 in 5099 ms (progress: 1013/2086) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Starting task 5.0:1070 as TID 1070 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1024) | |
| 13/03/26 20:23:24 INFO cluster.TaskSetManager: Serialized task 5.0:1070 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 967 in 12783 ms (progress: 1014/2086) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 967) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1071 as TID 1071 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1071 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1018 in 6022 ms (progress: 1015/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1072 as TID 1072 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1018) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1072 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1015 in 6812 ms (progress: 1016/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1073 as TID 1073 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1073 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1015) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1050 in 2840 ms (progress: 1017/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1074 as TID 1074 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1050) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1074 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1026 in 5526 ms (progress: 1018/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1075 as TID 1075 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1026) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1075 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1046 in 3463 ms (progress: 1019/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1076 as TID 1076 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1046) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1076 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1044 in 3574 ms (progress: 1020/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1077 as TID 1077 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1044) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1077 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1017 in 6556 ms (progress: 1021/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1078 as TID 1078 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1017) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1078 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1022 in 6100 ms (progress: 1022/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1079 as TID 1079 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1022) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1079 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 807 in 31490 ms (progress: 1023/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1080 as TID 1080 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 807) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1080 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 917 in 19170 ms (progress: 1024/2086) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 917) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1081 as TID 1081 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1081 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1039 in 3971 ms (progress: 1025/2086) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1039) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1082 as TID 1082 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1082 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1025 in 6003 ms (progress: 1026/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1083 as TID 1083 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1083 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1025) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 991 in 9935 ms (progress: 1027/2086) | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 991) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1084 as TID 1084 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1084 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Finished TID 1042 in 4245 ms (progress: 1028/2086) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Starting task 5.0:1085 as TID 1085 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:25 INFO cluster.TaskSetManager: Serialized task 5.0:1085 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1042) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1030 in 6074 ms (progress: 1029/2086) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1086 as TID 1086 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1086 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1030) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1031 in 5815 ms (progress: 1030/2086) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1087 as TID 1087 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1087 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1031) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1043 in 4375 ms (progress: 1031/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1043) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1088 as TID 1088 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1088 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1041 in 4435 ms (progress: 1032/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1041) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1089 as TID 1089 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1089 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 935 in 18172 ms (progress: 1033/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 935) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1090 as TID 1090 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1090 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1035 in 5411 ms (progress: 1034/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1035) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1091 as TID 1091 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1091 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1066 in 2210 ms (progress: 1035/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1066) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1092 as TID 1092 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1092 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1089 in 295 ms (progress: 1036/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1089) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1093 as TID 1093 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1093 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1067 in 2308 ms (progress: 1037/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1067) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1094 as TID 1094 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1094 as 2386 bytes in 1 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1036 in 5662 ms (progress: 1038/2086) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1095 as TID 1095 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1036) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1095 as 2386 bytes in 1 ms | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Finished TID 1082 in 1228 ms (progress: 1039/2086) | |
| 13/03/26 20:23:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1082) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Starting task 5.0:1096 as TID 1096 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:26 INFO cluster.TaskSetManager: Serialized task 5.0:1096 as 2386 bytes in 1 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 1029 in 7162 ms (progress: 1040/2086) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1029) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1097 as TID 1097 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1097 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 1033 in 6240 ms (progress: 1041/2086) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1033) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1098 as TID 1098 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1098 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 1037 in 6157 ms (progress: 1042/2086) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1037) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1099 as TID 1099 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1099 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 1032 in 6680 ms (progress: 1043/2086) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1100 as TID 1100 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1032) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1100 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 1027 in 7651 ms (progress: 1044/2086) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1101 as TID 1101 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1027) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1101 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 1023 in 8390 ms (progress: 1045/2086) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1023) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1102 as TID 1102 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1102 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 916 in 21591 ms (progress: 1046/2086) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1103 as TID 1103 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 916) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1103 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 1040 in 6141 ms (progress: 1047/2086) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1104 as TID 1104 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1040) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1104 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Finished TID 990 in 12222 ms (progress: 1048/2086) | |
| 13/03/26 20:23:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 990) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Starting task 5.0:1105 as TID 1105 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:27 INFO cluster.TaskSetManager: Serialized task 5.0:1105 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Finished TID 1061 in 4656 ms (progress: 1049/2086) | |
| 13/03/26 20:23:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1061) | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Starting task 5.0:1106 as TID 1106 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Serialized task 5.0:1106 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Finished TID 1021 in 9418 ms (progress: 1050/2086) | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Starting task 5.0:1107 as TID 1107 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Serialized task 5.0:1107 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1021) | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Finished TID 1048 in 6430 ms (progress: 1051/2086) | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Starting task 5.0:1108 as TID 1108 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:28 INFO cluster.TaskSetManager: Serialized task 5.0:1108 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1048) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Finished TID 1054 in 6492 ms (progress: 1052/2086) | |
| 13/03/26 20:23:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1054) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Starting task 5.0:1109 as TID 1109 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Serialized task 5.0:1109 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Finished TID 1063 in 5167 ms (progress: 1053/2086) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Starting task 5.0:1110 as TID 1110 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1063) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Serialized task 5.0:1110 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Finished TID 1008 in 11390 ms (progress: 1054/2086) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Starting task 5.0:1111 as TID 1111 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1008) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Serialized task 5.0:1111 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Finished TID 1065 in 5553 ms (progress: 1055/2086) | |
| 13/03/26 20:23:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1065) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Starting task 5.0:1112 as TID 1112 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Serialized task 5.0:1112 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Finished TID 1069 in 4982 ms (progress: 1056/2086) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Starting task 5.0:1113 as TID 1113 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1069) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Serialized task 5.0:1113 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Finished TID 1097 in 2704 ms (progress: 1057/2086) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Starting task 5.0:1114 as TID 1114 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1097) | |
| 13/03/26 20:23:29 INFO cluster.TaskSetManager: Serialized task 5.0:1114 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1077 in 4724 ms (progress: 1058/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1115 as TID 1115 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1077) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1115 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1052 in 7600 ms (progress: 1059/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1116 as TID 1116 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1052) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1116 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1108 in 1602 ms (progress: 1060/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1117 as TID 1117 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1108) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1117 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1088 in 4127 ms (progress: 1061/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1118 as TID 1118 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1088) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1118 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1085 in 4330 ms (progress: 1062/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1119 as TID 1119 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1085) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1119 as 2395 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1076 in 5167 ms (progress: 1063/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1120 as TID 1120 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1120 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1076) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1056 in 7613 ms (progress: 1064/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1121 as TID 1121 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1056) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1121 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1053 in 8281 ms (progress: 1065/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1122 as TID 1122 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1053) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1122 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1047 in 8777 ms (progress: 1066/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1123 as TID 1123 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1047) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1123 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1114 in 1163 ms (progress: 1067/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1124 as TID 1124 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1114) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1124 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Finished TID 1093 in 4472 ms (progress: 1068/2086) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Starting task 5.0:1125 as TID 1125 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1093) | |
| 13/03/26 20:23:30 INFO cluster.TaskSetManager: Serialized task 5.0:1125 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1060 in 7692 ms (progress: 1069/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1126 as TID 1126 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1060) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1126 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1094 in 4522 ms (progress: 1070/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1127 as TID 1127 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1127 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1094) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1057 in 8279 ms (progress: 1071/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1128 as TID 1128 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1057) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1128 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1092 in 5017 ms (progress: 1072/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1129 as TID 1129 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1092) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1129 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1080 in 6116 ms (progress: 1073/2086) | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1080) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1130 as TID 1130 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1130 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1078 in 6166 ms (progress: 1074/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1131 as TID 1131 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1131 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1078) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1079 in 6287 ms (progress: 1075/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1132 as TID 1132 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1079) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1132 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1083 in 6159 ms (progress: 1076/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1133 as TID 1133 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1083) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1133 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Finished TID 1087 in 5945 ms (progress: 1077/2086) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Starting task 5.0:1134 as TID 1134 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:31 INFO cluster.TaskSetManager: Serialized task 5.0:1134 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1087) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1091 in 5764 ms (progress: 1078/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1135 as TID 1135 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1091) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1135 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1081 in 6698 ms (progress: 1079/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1136 as TID 1136 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1081) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1136 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1090 in 5970 ms (progress: 1080/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1137 as TID 1137 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1090) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1137 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1096 in 5596 ms (progress: 1081/2086) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1096) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1138 as TID 1138 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1138 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1073 in 7397 ms (progress: 1082/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1139 as TID 1139 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1073) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1139 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1084 in 6693 ms (progress: 1083/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1140 as TID 1140 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1084) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1140 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1095 in 6050 ms (progress: 1084/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1141 as TID 1141 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1141 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1095) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1100 in 5396 ms (progress: 1085/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1142 as TID 1142 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1100) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1142 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Finished TID 1038 in 11369 ms (progress: 1086/2086) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Starting task 5.0:1143 as TID 1143 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1038) | |
| 13/03/26 20:23:32 INFO cluster.TaskSetManager: Serialized task 5.0:1143 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1099 in 5869 ms (progress: 1087/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1144 as TID 1144 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1099) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1144 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1072 in 8079 ms (progress: 1088/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1145 as TID 1145 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1072) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1145 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1086 in 7179 ms (progress: 1089/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1146 as TID 1146 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1146 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1062 in 9267 ms (progress: 1090/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1147 as TID 1147 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1062) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1147 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1125 in 2346 ms (progress: 1091/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1148 as TID 1148 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1125) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1148 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1098 in 6493 ms (progress: 1092/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1149 as TID 1149 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1149 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1098) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1142 in 836 ms (progress: 1093/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1150 as TID 1150 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1142) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1150 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1109 in 4624 ms (progress: 1094/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1151 as TID 1151 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1151 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1109) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1147 in 545 ms (progress: 1095/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1152 as TID 1152 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1147) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1152 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1136 in 1676 ms (progress: 1096/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1153 as TID 1153 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1136) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1153 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Finished TID 1104 in 6124 ms (progress: 1097/2086) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Starting task 5.0:1154 as TID 1154 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1104) | |
| 13/03/26 20:23:33 INFO cluster.TaskSetManager: Serialized task 5.0:1154 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1103 in 6323 ms (progress: 1098/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1155 as TID 1155 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1103) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1155 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1045 in 12340 ms (progress: 1099/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1156 as TID 1156 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1045) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1156 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1075 in 9169 ms (progress: 1100/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1157 as TID 1157 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1075) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1157 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1119 in 4103 ms (progress: 1101/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1158 as TID 1158 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1119) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1158 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1118 in 4285 ms (progress: 1102/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1159 as TID 1159 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1118) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1159 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1115 in 4517 ms (progress: 1103/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1160 as TID 1160 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1115) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1160 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1055 in 11782 ms (progress: 1104/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1161 as TID 1161 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1055) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1161 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Finished TID 1058 in 11594 ms (progress: 1105/2086) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Starting task 5.0:1162 as TID 1162 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1058) | |
| 13/03/26 20:23:34 INFO cluster.TaskSetManager: Serialized task 5.0:1162 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1059 in 11806 ms (progress: 1106/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1163 as TID 1163 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1059) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1163 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1101 in 7586 ms (progress: 1107/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1164 as TID 1164 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1101) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1164 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1110 in 5909 ms (progress: 1108/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1165 as TID 1165 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1165 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1110) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1071 in 10265 ms (progress: 1109/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1166 as TID 1166 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1166 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1071) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1121 in 4662 ms (progress: 1110/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1167 as TID 1167 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1121) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1167 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1113 in 6069 ms (progress: 1111/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1168 as TID 1168 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1113) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1168 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1127 in 4540 ms (progress: 1112/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1169 as TID 1169 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1127) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1169 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Finished TID 1106 in 7531 ms (progress: 1113/2086) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Starting task 5.0:1170 as TID 1170 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1106) | |
| 13/03/26 20:23:35 INFO cluster.TaskSetManager: Serialized task 5.0:1170 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Finished TID 1130 in 4583 ms (progress: 1114/2086) | |
| 13/03/26 20:23:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1130) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Starting task 5.0:1171 as TID 1171 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Serialized task 5.0:1171 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Finished TID 1112 in 6535 ms (progress: 1115/2086) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Starting task 5.0:1172 as TID 1172 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1112) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Serialized task 5.0:1172 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Finished TID 1105 in 8200 ms (progress: 1116/2086) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Starting task 5.0:1173 as TID 1173 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Serialized task 5.0:1173 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1105) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Finished TID 1129 in 4939 ms (progress: 1117/2086) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Starting task 5.0:1174 as TID 1174 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1129) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Serialized task 5.0:1174 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Finished TID 1128 in 5181 ms (progress: 1118/2086) | |
| 13/03/26 20:23:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1128) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Starting task 5.0:1175 as TID 1175 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Serialized task 5.0:1175 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Finished TID 1157 in 2243 ms (progress: 1119/2086) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Starting task 5.0:1176 as TID 1176 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1157) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Serialized task 5.0:1176 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Finished TID 1049 in 14407 ms (progress: 1120/2086) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Starting task 5.0:1177 as TID 1177 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1049) | |
| 13/03/26 20:23:36 INFO cluster.TaskSetManager: Serialized task 5.0:1177 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1126 in 6140 ms (progress: 1121/2086) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1126) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1178 as TID 1178 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1178 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1122 in 6320 ms (progress: 1122/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1179 as TID 1179 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1122) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1179 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1148 in 3969 ms (progress: 1123/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1180 as TID 1180 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1148) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1180 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1102 in 9493 ms (progress: 1124/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1181 as TID 1181 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1102) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1181 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1137 in 5076 ms (progress: 1125/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1182 as TID 1182 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1137) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1182 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1140 in 4899 ms (progress: 1126/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1183 as TID 1183 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1140) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1183 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1133 in 6017 ms (progress: 1127/2086) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1133) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1184 as TID 1184 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1184 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1131 in 6357 ms (progress: 1128/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1185 as TID 1185 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1185 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1131) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1132 in 6278 ms (progress: 1129/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1186 as TID 1186 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1186 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1132) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Finished TID 1183 in 521 ms (progress: 1130/2086) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Starting task 5.0:1187 as TID 1187 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1183) | |
| 13/03/26 20:23:37 INFO cluster.TaskSetManager: Serialized task 5.0:1187 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1138 in 5640 ms (progress: 1131/2086) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1138) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1188 as TID 1188 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1188 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1134 in 6272 ms (progress: 1132/2086) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1134) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1189 as TID 1189 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1189 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1124 in 7519 ms (progress: 1133/2086) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1124) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1190 as TID 1190 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1190 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1151 in 4684 ms (progress: 1134/2086) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1191 as TID 1191 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1151) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1191 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1162 in 3863 ms (progress: 1135/2086) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1162) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1192 as TID 1192 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1192 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1070 in 14141 ms (progress: 1136/2086) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1070) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1193 as TID 1193 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1193 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1152 in 5095 ms (progress: 1137/2086) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1194 as TID 1194 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1152) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1194 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1145 in 5770 ms (progress: 1138/2086) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1195 as TID 1195 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1145) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1195 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1158 in 4511 ms (progress: 1139/2086) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1196 as TID 1196 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1158) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1196 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Finished TID 1141 in 6295 ms (progress: 1140/2086) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Starting task 5.0:1197 as TID 1197 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1141) | |
| 13/03/26 20:23:38 INFO cluster.TaskSetManager: Serialized task 5.0:1197 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1123 in 8131 ms (progress: 1141/2086) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1198 as TID 1198 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1123) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1198 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1150 in 5438 ms (progress: 1142/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1150) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1199 as TID 1199 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1199 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1144 in 5944 ms (progress: 1143/2086) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1200 as TID 1200 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1144) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1200 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1159 in 4550 ms (progress: 1144/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1159) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1201 as TID 1201 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1201 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1051 in 16707 ms (progress: 1145/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1051) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1202 as TID 1202 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1202 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1135 in 7107 ms (progress: 1146/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1135) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1203 as TID 1203 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1203 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1160 in 4951 ms (progress: 1147/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1160) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1204 as TID 1204 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1204 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1153 in 5789 ms (progress: 1148/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1153) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1205 as TID 1205 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1205 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1167 in 4442 ms (progress: 1149/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1167) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1206 as TID 1206 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1206 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1149 in 6252 ms (progress: 1150/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1149) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1207 as TID 1207 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1207 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1064 in 15910 ms (progress: 1151/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1064) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1208 as TID 1208 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1208 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Finished TID 1154 in 6022 ms (progress: 1152/2086) | |
| 13/03/26 20:23:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1154) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Starting task 5.0:1209 as TID 1209 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:39 INFO cluster.TaskSetManager: Serialized task 5.0:1209 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1156 in 5833 ms (progress: 1153/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1156) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1210 as TID 1210 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1210 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1139 in 7532 ms (progress: 1154/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1139) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1211 as TID 1211 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1211 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1169 in 4539 ms (progress: 1155/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1169) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1212 as TID 1212 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1212 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1155 in 6206 ms (progress: 1156/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1155) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1213 as TID 1213 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1213 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1146 in 7207 ms (progress: 1157/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1146) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1214 as TID 1214 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1214 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1189 in 2611 ms (progress: 1158/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1189) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1215 as TID 1215 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1215 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1163 in 5867 ms (progress: 1159/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1163) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1216 as TID 1216 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1216 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Finished TID 1172 in 4767 ms (progress: 1160/2086) | |
| 13/03/26 20:23:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1172) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Starting task 5.0:1217 as TID 1217 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:40 INFO cluster.TaskSetManager: Serialized task 5.0:1217 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1180 in 3930 ms (progress: 1161/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1180) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1218 as TID 1218 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1218 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1165 in 6295 ms (progress: 1162/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1165) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1219 as TID 1219 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1219 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1068 in 16995 ms (progress: 1163/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1068) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1220 as TID 1220 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1220 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1177 in 5039 ms (progress: 1164/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1177) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1221 as TID 1221 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1221 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1191 in 3377 ms (progress: 1165/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1191) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1222 as TID 1222 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1222 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1174 in 5515 ms (progress: 1166/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1174) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1223 as TID 1223 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1223 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1168 in 6272 ms (progress: 1167/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1168) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1224 as TID 1224 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1224 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Finished TID 1195 in 3058 ms (progress: 1168/2086) | |
| 13/03/26 20:23:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1195) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Starting task 5.0:1225 as TID 1225 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:41 INFO cluster.TaskSetManager: Serialized task 5.0:1225 as 2386 bytes in 1 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1176 in 5524 ms (progress: 1169/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1176) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1226 as TID 1226 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1226 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1171 in 6061 ms (progress: 1170/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1171) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1227 as TID 1227 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1227 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1201 in 3204 ms (progress: 1171/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1201) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1228 as TID 1228 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1228 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1197 in 3334 ms (progress: 1172/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1197) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1229 as TID 1229 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1229 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1182 in 5031 ms (progress: 1173/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1182) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1230 as TID 1230 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1230 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1107 in 13859 ms (progress: 1174/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1107) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1231 as TID 1231 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1231 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1203 in 3348 ms (progress: 1175/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1203) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1232 as TID 1232 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1232 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1193 in 3728 ms (progress: 1176/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1193) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1233 as TID 1233 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1233 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1175 in 6135 ms (progress: 1177/2086) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1234 as TID 1234 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1175) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1234 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1187 in 4875 ms (progress: 1178/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1187) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1235 as TID 1235 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1235 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1074 in 17660 ms (progress: 1179/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1074) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1236 as TID 1236 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1236 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1143 in 9882 ms (progress: 1180/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1143) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1237 as TID 1237 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1237 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1161 in 8159 ms (progress: 1181/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1161) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1238 as TID 1238 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1238 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1199 in 3917 ms (progress: 1182/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1199) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1239 as TID 1239 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1239 as 2386 bytes in 1 ms | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Finished TID 1178 in 5815 ms (progress: 1183/2086) | |
| 13/03/26 20:23:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1178) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Starting task 5.0:1240 as TID 1240 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:42 INFO cluster.TaskSetManager: Serialized task 5.0:1240 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Finished TID 1164 in 7989 ms (progress: 1184/2086) | |
| 13/03/26 20:23:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1164) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Starting task 5.0:1241 as TID 1241 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Serialized task 5.0:1241 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Finished TID 1179 in 6078 ms (progress: 1185/2086) | |
| 13/03/26 20:23:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1179) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Starting task 5.0:1242 as TID 1242 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Serialized task 5.0:1242 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Finished TID 1170 in 7966 ms (progress: 1186/2086) | |
| 13/03/26 20:23:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1170) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Starting task 5.0:1243 as TID 1243 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Serialized task 5.0:1243 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Finished TID 1207 in 4002 ms (progress: 1187/2086) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Starting task 5.0:1244 as TID 1244 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1207) | |
| 13/03/26 20:23:43 INFO cluster.TaskSetManager: Serialized task 5.0:1244 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1209 in 4138 ms (progress: 1188/2086) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1209) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1245 as TID 1245 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1245 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1221 in 2556 ms (progress: 1189/2086) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1246 as TID 1246 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1221) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1246 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1215 in 3633 ms (progress: 1190/2086) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1215) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1247 as TID 1247 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1247 as 2385 bytes in 1 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1181 in 7332 ms (progress: 1191/2086) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1181) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1248 as TID 1248 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1248 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1227 in 2499 ms (progress: 1192/2086) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1249 as TID 1249 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1227) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1249 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1185 in 6933 ms (progress: 1193/2086) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1250 as TID 1250 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1185) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1250 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1116 in 14739 ms (progress: 1194/2086) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1251 as TID 1251 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1116) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1251 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Finished TID 1213 in 4595 ms (progress: 1195/2086) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Starting task 5.0:1252 as TID 1252 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1213) | |
| 13/03/26 20:23:44 INFO cluster.TaskSetManager: Serialized task 5.0:1252 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Finished TID 1219 in 3643 ms (progress: 1196/2086) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Starting task 5.0:1253 as TID 1253 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1219) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Serialized task 5.0:1253 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Finished TID 1111 in 15839 ms (progress: 1197/2086) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Starting task 5.0:1254 as TID 1254 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1111) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Serialized task 5.0:1254 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Finished TID 1173 in 9047 ms (progress: 1198/2086) | |
| 13/03/26 20:23:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1173) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Starting task 5.0:1255 as TID 1255 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Serialized task 5.0:1255 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Finished TID 1192 in 7001 ms (progress: 1199/2086) | |
| 13/03/26 20:23:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1192) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Starting task 5.0:1256 as TID 1256 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Serialized task 5.0:1256 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Finished TID 1217 in 4783 ms (progress: 1200/2086) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Starting task 5.0:1257 as TID 1257 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1217) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Serialized task 5.0:1257 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Finished TID 1166 in 10527 ms (progress: 1201/2086) | |
| 13/03/26 20:23:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1166) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Starting task 5.0:1258 as TID 1258 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Serialized task 5.0:1258 as 2384 bytes in 1 ms | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Finished TID 1247 in 1413 ms (progress: 1202/2086) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Starting task 5.0:1259 as TID 1259 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1247) | |
| 13/03/26 20:23:45 INFO cluster.TaskSetManager: Serialized task 5.0:1259 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Finished TID 1117 in 15887 ms (progress: 1203/2086) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Starting task 5.0:1260 as TID 1260 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1117) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Serialized task 5.0:1260 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Finished TID 1228 in 4114 ms (progress: 1204/2086) | |
| 13/03/26 20:23:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1228) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Starting task 5.0:1261 as TID 1261 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Serialized task 5.0:1261 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Finished TID 1241 in 3487 ms (progress: 1205/2086) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Starting task 5.0:1262 as TID 1262 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1241) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Serialized task 5.0:1262 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Finished TID 1211 in 6546 ms (progress: 1206/2086) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Starting task 5.0:1263 as TID 1263 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1211) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Serialized task 5.0:1263 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Finished TID 1188 in 8552 ms (progress: 1207/2086) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Starting task 5.0:1264 as TID 1264 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1188) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Serialized task 5.0:1264 as 2395 bytes in 0 ms | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Finished TID 1230 in 4269 ms (progress: 1208/2086) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Starting task 5.0:1265 as TID 1265 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1230) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Serialized task 5.0:1265 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Finished TID 1223 in 4976 ms (progress: 1209/2086) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Starting task 5.0:1266 as TID 1266 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1223) | |
| 13/03/26 20:23:46 INFO cluster.TaskSetManager: Serialized task 5.0:1266 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1120 in 16830 ms (progress: 1210/2086) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1267 as TID 1267 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1120) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1267 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1222 in 5593 ms (progress: 1211/2086) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1268 as TID 1268 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1222) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1268 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1202 in 8340 ms (progress: 1212/2086) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1269 as TID 1269 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1202) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1269 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1226 in 5452 ms (progress: 1213/2086) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1270 as TID 1270 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1226) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1270 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1234 in 4884 ms (progress: 1214/2086) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1234) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1271 as TID 1271 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1271 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1253 in 2639 ms (progress: 1215/2086) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1253) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1272 as TID 1272 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1272 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1225 in 5965 ms (progress: 1216/2086) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1273 as TID 1273 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1225) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1273 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1229 in 5621 ms (progress: 1217/2086) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1274 as TID 1274 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1229) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1274 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Finished TID 1196 in 9012 ms (progress: 1218/2086) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Starting task 5.0:1275 as TID 1275 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1196) | |
| 13/03/26 20:23:47 INFO cluster.TaskSetManager: Serialized task 5.0:1275 as 2384 bytes in 0 ms | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Finished TID 1232 in 5534 ms (progress: 1219/2086) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Starting task 5.0:1276 as TID 1276 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1232) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Serialized task 5.0:1276 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Finished TID 1224 in 6586 ms (progress: 1220/2086) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Starting task 5.0:1277 as TID 1277 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1224) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Serialized task 5.0:1277 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Finished TID 1236 in 5919 ms (progress: 1221/2086) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Starting task 5.0:1278 as TID 1278 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1236) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Serialized task 5.0:1278 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Finished TID 1259 in 2895 ms (progress: 1222/2086) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Starting task 5.0:1279 as TID 1279 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1259) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Serialized task 5.0:1279 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Finished TID 1214 in 8570 ms (progress: 1223/2086) | |
| 13/03/26 20:23:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1214) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Starting task 5.0:1280 as TID 1280 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:48 INFO cluster.TaskSetManager: Serialized task 5.0:1280 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Finished TID 1237 in 6288 ms (progress: 1224/2086) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Starting task 5.0:1281 as TID 1281 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1237) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Serialized task 5.0:1281 as 2385 bytes in 1 ms | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Finished TID 1240 in 6276 ms (progress: 1225/2086) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Starting task 5.0:1282 as TID 1282 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1240) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Serialized task 5.0:1282 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Finished TID 1216 in 8522 ms (progress: 1226/2086) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Starting task 5.0:1283 as TID 1283 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1216) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Serialized task 5.0:1283 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Finished TID 1212 in 9295 ms (progress: 1227/2086) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Starting task 5.0:1284 as TID 1284 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1212) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Serialized task 5.0:1284 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Finished TID 1242 in 6267 ms (progress: 1228/2086) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Starting task 5.0:1285 as TID 1285 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1242) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Serialized task 5.0:1285 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Finished TID 1244 in 5854 ms (progress: 1229/2086) | |
| 13/03/26 20:23:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1244) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Starting task 5.0:1286 as TID 1286 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Serialized task 5.0:1286 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Finished TID 1190 in 11257 ms (progress: 1230/2086) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Starting task 5.0:1287 as TID 1287 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1190) | |
| 13/03/26 20:23:49 INFO cluster.TaskSetManager: Serialized task 5.0:1287 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1256 in 4368 ms (progress: 1231/2086) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1256) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1288 as TID 1288 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1288 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1243 in 6575 ms (progress: 1232/2086) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1243) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1289 as TID 1289 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1289 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1218 in 9162 ms (progress: 1233/2086) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1218) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1290 as TID 1290 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1290 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1206 in 10556 ms (progress: 1234/2086) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1206) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1291 as TID 1291 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1291 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1245 in 6341 ms (progress: 1235/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1292 as TID 1292 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1245) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1292 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1238 in 7587 ms (progress: 1236/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1293 as TID 1293 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1238) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1293 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1252 in 5621 ms (progress: 1237/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1294 as TID 1294 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1252) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1294 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1208 in 10674 ms (progress: 1238/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1295 as TID 1295 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1208) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1295 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1205 in 11124 ms (progress: 1239/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1296 as TID 1296 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1205) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1296 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1265 in 4196 ms (progress: 1240/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1297 as TID 1297 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1297 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1265) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1261 in 4531 ms (progress: 1241/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1298 as TID 1298 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1298 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1261) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1250 in 6106 ms (progress: 1242/2086) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1299 as TID 1299 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1250) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1299 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Finished TID 1233 in 8397 ms (progress: 1243/2086) | |
| 13/03/26 20:23:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1233) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Starting task 5.0:1300 as TID 1300 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:50 INFO cluster.TaskSetManager: Serialized task 5.0:1300 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1246 in 6685 ms (progress: 1244/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1246) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1301 as TID 1301 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1301 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1292 in 546 ms (progress: 1245/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1292) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1302 as TID 1302 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1302 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1239 in 8246 ms (progress: 1246/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1239) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1303 as TID 1303 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1303 as 2397 bytes in 1 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1257 in 5793 ms (progress: 1247/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1257) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1304 as TID 1304 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1304 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1249 in 6847 ms (progress: 1248/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1249) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1305 as TID 1305 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1305 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1235 in 8776 ms (progress: 1249/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1235) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1306 as TID 1306 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1306 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1270 in 4101 ms (progress: 1250/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1270) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1307 as TID 1307 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1307 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1281 in 2638 ms (progress: 1251/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1281) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1308 as TID 1308 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1308 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1266 in 5018 ms (progress: 1252/2086) | |
| 13/03/26 20:23:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1266) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Starting task 5.0:1309 as TID 1309 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Serialized task 5.0:1309 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:51 INFO cluster.TaskSetManager: Finished TID 1220 in 10492 ms (progress: 1253/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1220) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1310 as TID 1310 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1310 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1251 in 7182 ms (progress: 1254/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1251) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1311 as TID 1311 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1311 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1269 in 4708 ms (progress: 1255/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1269) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1312 as TID 1312 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1312 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1287 in 2547 ms (progress: 1256/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1287) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1313 as TID 1313 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1313 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1264 in 5743 ms (progress: 1257/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1264) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1314 as TID 1314 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1314 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1255 in 7407 ms (progress: 1258/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1255) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1315 as TID 1315 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1315 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1275 in 4767 ms (progress: 1259/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1275) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1316 as TID 1316 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1316 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1271 in 5175 ms (progress: 1260/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1271) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1317 as TID 1317 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1317 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Finished TID 1210 in 12958 ms (progress: 1261/2086) | |
| 13/03/26 20:23:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1210) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Starting task 5.0:1318 as TID 1318 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:52 INFO cluster.TaskSetManager: Serialized task 5.0:1318 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Finished TID 1186 in 15063 ms (progress: 1262/2086) | |
| 13/03/26 20:23:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1186) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Starting task 5.0:1319 as TID 1319 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Serialized task 5.0:1319 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Finished TID 1268 in 5665 ms (progress: 1263/2086) | |
| 13/03/26 20:23:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1268) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Starting task 5.0:1320 as TID 1320 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Serialized task 5.0:1320 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Finished TID 1231 in 10641 ms (progress: 1264/2086) | |
| 13/03/26 20:23:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1231) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Starting task 5.0:1321 as TID 1321 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Serialized task 5.0:1321 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Finished TID 1302 in 2559 ms (progress: 1265/2086) | |
| 13/03/26 20:23:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1302) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Starting task 5.0:1322 as TID 1322 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Serialized task 5.0:1322 as 2397 bytes in 0 ms | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Finished TID 1276 in 5670 ms (progress: 1266/2086) | |
| 13/03/26 20:23:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1276) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Starting task 5.0:1323 as TID 1323 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:53 INFO cluster.TaskSetManager: Serialized task 5.0:1323 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1273 in 6099 ms (progress: 1267/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1324 as TID 1324 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1273) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1324 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1194 in 15158 ms (progress: 1268/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1325 as TID 1325 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1194) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1325 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1272 in 6533 ms (progress: 1269/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1326 as TID 1326 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1272) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1326 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1284 in 4996 ms (progress: 1270/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1327 as TID 1327 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1284) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1327 as 2385 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1262 in 8052 ms (progress: 1271/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1328 as TID 1328 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1262) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1328 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1279 in 5745 ms (progress: 1272/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1329 as TID 1329 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1279) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1329 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1277 in 6174 ms (progress: 1273/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1330 as TID 1330 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1277) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1330 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1288 in 4775 ms (progress: 1274/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1331 as TID 1331 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1288) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1331 as 2404 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1258 in 8998 ms (progress: 1275/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1332 as TID 1332 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1258) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1332 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1248 in 10263 ms (progress: 1276/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1333 as TID 1333 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1248) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1333 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1274 in 6941 ms (progress: 1277/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1334 as TID 1334 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1274) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1334 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Finished TID 1283 in 5582 ms (progress: 1278/2086) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Starting task 5.0:1335 as TID 1335 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1283) | |
| 13/03/26 20:23:54 INFO cluster.TaskSetManager: Serialized task 5.0:1335 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Finished TID 1291 in 4772 ms (progress: 1279/2086) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Starting task 5.0:1336 as TID 1336 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1291) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Serialized task 5.0:1336 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Finished TID 1282 in 6259 ms (progress: 1280/2086) | |
| 13/03/26 20:23:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1282) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Starting task 5.0:1337 as TID 1337 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Serialized task 5.0:1337 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Finished TID 1298 in 4595 ms (progress: 1281/2086) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Starting task 5.0:1338 as TID 1338 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1298) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Serialized task 5.0:1338 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Finished TID 1293 in 5142 ms (progress: 1282/2086) | |
| 13/03/26 20:23:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1293) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Starting task 5.0:1339 as TID 1339 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Serialized task 5.0:1339 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Finished TID 1286 in 6074 ms (progress: 1283/2086) | |
| 13/03/26 20:23:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1286) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Starting task 5.0:1340 as TID 1340 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Serialized task 5.0:1340 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Finished TID 1278 in 7119 ms (progress: 1284/2086) | |
| 13/03/26 20:23:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1278) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Starting task 5.0:1341 as TID 1341 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Serialized task 5.0:1341 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Finished TID 1200 in 16883 ms (progress: 1285/2086) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Starting task 5.0:1342 as TID 1342 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1200) | |
| 13/03/26 20:23:55 INFO cluster.TaskSetManager: Serialized task 5.0:1342 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1289 in 6054 ms (progress: 1286/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1343 as TID 1343 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1289) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1343 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1301 in 5369 ms (progress: 1287/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1344 as TID 1344 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1301) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1344 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1312 in 4204 ms (progress: 1288/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1345 as TID 1345 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1312) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1345 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1280 in 7518 ms (progress: 1289/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1346 as TID 1346 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1280) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1346 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1317 in 3770 ms (progress: 1290/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1347 as TID 1347 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1317) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1347 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1307 in 5019 ms (progress: 1291/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1348 as TID 1348 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1307) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1348 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1296 in 5943 ms (progress: 1292/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1349 as TID 1349 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1349 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1296) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1295 in 6099 ms (progress: 1293/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1350 as TID 1350 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1350 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1295) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1260 in 10630 ms (progress: 1294/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1351 as TID 1351 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1260) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1351 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1316 in 4105 ms (progress: 1295/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1352 as TID 1352 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1316) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1352 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1309 in 5025 ms (progress: 1296/2086) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1353 as TID 1353 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1309) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1353 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Finished TID 1329 in 2394 ms (progress: 1297/2086) | |
| 13/03/26 20:23:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1329) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Starting task 5.0:1354 as TID 1354 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:23:56 INFO cluster.TaskSetManager: Serialized task 5.0:1354 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1331 in 2337 ms (progress: 1298/2086) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1331) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1355 as TID 1355 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1355 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1306 in 5545 ms (progress: 1299/2086) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1356 as TID 1356 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1306) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1356 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1310 in 5170 ms (progress: 1300/2086) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1357 as TID 1357 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1310) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1357 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1294 in 6901 ms (progress: 1301/2086) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1294) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1358 as TID 1358 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1358 as 2398 bytes in 0 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1304 in 5974 ms (progress: 1302/2086) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1359 as TID 1359 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1304) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1359 as 2398 bytes in 1 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1285 in 7944 ms (progress: 1303/2086) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1360 as TID 1360 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1360 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1285) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1305 in 6050 ms (progress: 1304/2086) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1361 as TID 1361 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1305) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1361 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1320 in 4626 ms (progress: 1305/2086) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1320) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1362 as TID 1362 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1362 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1263 in 11155 ms (progress: 1306/2086) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1363 as TID 1363 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1263) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1363 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Finished TID 1299 in 6963 ms (progress: 1307/2086) | |
| 13/03/26 20:23:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1299) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Starting task 5.0:1364 as TID 1364 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:23:57 INFO cluster.TaskSetManager: Serialized task 5.0:1364 as 2400 bytes in 1 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1314 in 5762 ms (progress: 1308/2086) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1314) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1365 as TID 1365 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1365 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1297 in 7487 ms (progress: 1309/2086) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1297) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1366 as TID 1366 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1366 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1322 in 4869 ms (progress: 1310/2086) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1367 as TID 1367 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1322) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1367 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1335 in 3559 ms (progress: 1311/2086) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1335) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1368 as TID 1368 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1368 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1290 in 8275 ms (progress: 1312/2086) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1369 as TID 1369 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1290) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1369 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1311 in 6621 ms (progress: 1313/2086) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1370 as TID 1370 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1370 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1311) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1327 in 4215 ms (progress: 1314/2086) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1371 as TID 1371 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1327) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1371 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1323 in 4991 ms (progress: 1315/2086) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1372 as TID 1372 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1323) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1372 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Finished TID 1318 in 5892 ms (progress: 1316/2086) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Starting task 5.0:1373 as TID 1373 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:23:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1318) | |
| 13/03/26 20:23:58 INFO cluster.TaskSetManager: Serialized task 5.0:1373 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1337 in 3613 ms (progress: 1317/2086) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1337) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1374 as TID 1374 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1374 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1319 in 6128 ms (progress: 1318/2086) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1319) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1375 as TID 1375 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1375 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1313 in 7265 ms (progress: 1319/2086) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1313) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1376 as TID 1376 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1376 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1371 in 759 ms (progress: 1320/2086) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1371) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1377 as TID 1377 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1377 as 2399 bytes in 1 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1341 in 3656 ms (progress: 1321/2086) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1378 as TID 1378 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1341) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1378 as 2399 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1300 in 8630 ms (progress: 1322/2086) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1379 as TID 1379 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1300) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1379 as 2400 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1325 in 5851 ms (progress: 1323/2086) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1380 as TID 1380 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1325) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1380 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1343 in 3574 ms (progress: 1324/2086) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1381 as TID 1381 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1343) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1381 as 2386 bytes in 0 ms | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Finished TID 1315 in 7332 ms (progress: 1325/2086) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Starting task 5.0:1382 as TID 1382 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:23:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1315) | |
| 13/03/26 20:23:59 INFO cluster.TaskSetManager: Serialized task 5.0:1382 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Finished TID 1303 in 8897 ms (progress: 1326/2086) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Starting task 5.0:1383 as TID 1383 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1303) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Serialized task 5.0:1383 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Finished TID 1339 in 4542 ms (progress: 1327/2086) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Starting task 5.0:1384 as TID 1384 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1339) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Serialized task 5.0:1384 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Finished TID 1308 in 8487 ms (progress: 1328/2086) | |
| 13/03/26 20:24:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1308) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Starting task 5.0:1385 as TID 1385 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Serialized task 5.0:1385 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Finished TID 1204 in 20741 ms (progress: 1329/2086) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Starting task 5.0:1386 as TID 1386 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1204) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Serialized task 5.0:1386 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Finished TID 1326 in 6209 ms (progress: 1330/2086) | |
| 13/03/26 20:24:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1326) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Starting task 5.0:1387 as TID 1387 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Serialized task 5.0:1387 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Finished TID 1324 in 6461 ms (progress: 1331/2086) | |
| 13/03/26 20:24:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1324) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Starting task 5.0:1388 as TID 1388 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Serialized task 5.0:1388 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Finished TID 1345 in 4352 ms (progress: 1332/2086) | |
| 13/03/26 20:24:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1345) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Starting task 5.0:1389 as TID 1389 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:00 INFO cluster.TaskSetManager: Serialized task 5.0:1389 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Finished TID 1333 in 6148 ms (progress: 1333/2086) | |
| 13/03/26 20:24:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1333) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Starting task 5.0:1390 as TID 1390 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Serialized task 5.0:1390 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Finished TID 1321 in 8298 ms (progress: 1334/2086) | |
| 13/03/26 20:24:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1321) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Starting task 5.0:1391 as TID 1391 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Serialized task 5.0:1391 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Finished TID 1347 in 4954 ms (progress: 1335/2086) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Starting task 5.0:1392 as TID 1392 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Serialized task 5.0:1392 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1347) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Finished TID 1351 in 4775 ms (progress: 1336/2086) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Starting task 5.0:1393 as TID 1393 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1351) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Serialized task 5.0:1393 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Finished TID 1349 in 5156 ms (progress: 1337/2086) | |
| 13/03/26 20:24:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1349) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Starting task 5.0:1394 as TID 1394 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Serialized task 5.0:1394 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Finished TID 1361 in 4343 ms (progress: 1338/2086) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Starting task 5.0:1395 as TID 1395 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:01 INFO cluster.TaskSetManager: Serialized task 5.0:1395 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1361) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Finished TID 1365 in 3890 ms (progress: 1339/2086) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Starting task 5.0:1396 as TID 1396 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1365) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Serialized task 5.0:1396 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Finished TID 1357 in 5101 ms (progress: 1340/2086) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Starting task 5.0:1397 as TID 1397 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1357) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Serialized task 5.0:1397 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Finished TID 1353 in 5413 ms (progress: 1341/2086) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Starting task 5.0:1398 as TID 1398 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1353) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Serialized task 5.0:1398 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Finished TID 1391 in 1071 ms (progress: 1342/2086) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Starting task 5.0:1399 as TID 1399 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1391) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Serialized task 5.0:1399 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Finished TID 1355 in 5864 ms (progress: 1343/2086) | |
| 13/03/26 20:24:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1355) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Starting task 5.0:1400 as TID 1400 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:02 INFO cluster.TaskSetManager: Serialized task 5.0:1400 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Finished TID 1366 in 4830 ms (progress: 1344/2086) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Starting task 5.0:1401 as TID 1401 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1366) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Serialized task 5.0:1401 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Finished TID 1336 in 8177 ms (progress: 1345/2086) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Starting task 5.0:1402 as TID 1402 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1336) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Serialized task 5.0:1402 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Finished TID 1397 in 1177 ms (progress: 1346/2086) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Starting task 5.0:1403 as TID 1403 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1397) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Serialized task 5.0:1403 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Finished TID 1254 in 18518 ms (progress: 1347/2086) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Starting task 5.0:1404 as TID 1404 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1254) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Serialized task 5.0:1404 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Finished TID 1377 in 4144 ms (progress: 1348/2086) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Starting task 5.0:1405 as TID 1405 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Serialized task 5.0:1405 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1377) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Finished TID 1334 in 8968 ms (progress: 1349/2086) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Starting task 5.0:1406 as TID 1406 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1334) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Serialized task 5.0:1406 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Finished TID 1373 in 5080 ms (progress: 1350/2086) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Starting task 5.0:1407 as TID 1407 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:03 INFO cluster.TaskSetManager: Serialized task 5.0:1407 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1373) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1332 in 9364 ms (progress: 1351/2086) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1408 as TID 1408 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1332) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1408 as 2395 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1375 in 5052 ms (progress: 1352/2086) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1409 as TID 1409 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1375) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1409 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1374 in 5392 ms (progress: 1353/2086) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1410 as TID 1410 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1374) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1410 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1385 in 4405 ms (progress: 1354/2086) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1385) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1411 as TID 1411 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1411 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1384 in 4518 ms (progress: 1355/2086) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1384) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1412 as TID 1412 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1412 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1403 in 1291 ms (progress: 1356/2086) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1413 as TID 1413 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1403) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1413 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1368 in 6199 ms (progress: 1357/2086) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1414 as TID 1414 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1368) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1414 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1367 in 6342 ms (progress: 1358/2086) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1415 as TID 1415 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1367) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1415 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Finished TID 1350 in 8261 ms (progress: 1359/2086) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Starting task 5.0:1416 as TID 1416 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1350) | |
| 13/03/26 20:24:04 INFO cluster.TaskSetManager: Serialized task 5.0:1416 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1378 in 5486 ms (progress: 1360/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1417 as TID 1417 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1378) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1417 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1386 in 4813 ms (progress: 1361/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1418 as TID 1418 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1386) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1418 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1370 in 6432 ms (progress: 1362/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1419 as TID 1419 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1370) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1419 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1342 in 9266 ms (progress: 1363/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1420 as TID 1420 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1342) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1420 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1267 in 17953 ms (progress: 1364/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1421 as TID 1421 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1267) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1421 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1338 in 9809 ms (progress: 1365/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1422 as TID 1422 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1338) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1422 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1372 in 6594 ms (progress: 1366/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1423 as TID 1423 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1372) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1423 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Finished TID 1389 in 4762 ms (progress: 1367/2086) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Starting task 5.0:1424 as TID 1424 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1389) | |
| 13/03/26 20:24:05 INFO cluster.TaskSetManager: Serialized task 5.0:1424 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1344 in 9858 ms (progress: 1368/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1425 as TID 1425 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1344) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1425 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1381 in 6349 ms (progress: 1369/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1426 as TID 1426 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1381) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1426 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1380 in 6430 ms (progress: 1370/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1427 as TID 1427 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1380) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1427 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1379 in 6713 ms (progress: 1371/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1428 as TID 1428 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1379) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1428 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1330 in 11647 ms (progress: 1372/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1429 as TID 1429 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1330) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1429 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1387 in 6111 ms (progress: 1373/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1430 as TID 1430 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1430 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1387) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1392 in 5085 ms (progress: 1374/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1431 as TID 1431 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1392) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1431 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1388 in 6121 ms (progress: 1375/2086) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1388) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1432 as TID 1432 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1432 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Finished TID 1360 in 9391 ms (progress: 1376/2086) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Starting task 5.0:1433 as TID 1433 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1360) | |
| 13/03/26 20:24:06 INFO cluster.TaskSetManager: Serialized task 5.0:1433 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1376 in 7663 ms (progress: 1377/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1434 as TID 1434 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1376) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1434 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1393 in 5683 ms (progress: 1378/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1435 as TID 1435 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1393) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1435 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1369 in 8789 ms (progress: 1379/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1436 as TID 1436 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1369) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1436 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1398 in 5156 ms (progress: 1380/2086) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1398) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1437 as TID 1437 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1437 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1400 in 4623 ms (progress: 1381/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1438 as TID 1438 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1400) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1438 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1395 in 5802 ms (progress: 1382/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1439 as TID 1439 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1395) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1439 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1356 in 10583 ms (progress: 1383/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1440 as TID 1440 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1356) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1440 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1431 in 1251 ms (progress: 1384/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1441 as TID 1441 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1431) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1441 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1390 in 6816 ms (progress: 1385/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1442 as TID 1442 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1390) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1442 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1396 in 5786 ms (progress: 1386/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1443 as TID 1443 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1443 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1396) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Finished TID 1405 in 4239 ms (progress: 1387/2086) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Starting task 5.0:1444 as TID 1444 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1405) | |
| 13/03/26 20:24:07 INFO cluster.TaskSetManager: Serialized task 5.0:1444 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1401 in 4941 ms (progress: 1388/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1445 as TID 1445 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1401) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1445 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1425 in 2004 ms (progress: 1389/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1446 as TID 1446 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1425) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1446 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1402 in 4954 ms (progress: 1390/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1447 as TID 1447 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1402) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1447 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1346 in 11753 ms (progress: 1391/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1448 as TID 1448 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1346) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1448 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1359 in 10914 ms (progress: 1392/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1449 as TID 1449 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1359) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1449 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1412 in 4086 ms (progress: 1393/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1450 as TID 1450 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1412) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1450 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1394 in 6906 ms (progress: 1394/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1451 as TID 1451 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1394) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1451 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Finished TID 1414 in 4180 ms (progress: 1395/2086) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Starting task 5.0:1452 as TID 1452 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1414) | |
| 13/03/26 20:24:08 INFO cluster.TaskSetManager: Serialized task 5.0:1452 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1407 in 5101 ms (progress: 1396/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1453 as TID 1453 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1407) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1453 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1363 in 11403 ms (progress: 1397/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1454 as TID 1454 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1363) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1454 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1409 in 5020 ms (progress: 1398/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1455 as TID 1455 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1409) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1455 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1413 in 4557 ms (progress: 1399/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1456 as TID 1456 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1413) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1456 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1383 in 9297 ms (progress: 1400/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1457 as TID 1457 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1383) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1457 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1422 in 4255 ms (progress: 1401/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1458 as TID 1458 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1422) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1458 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1358 in 12170 ms (progress: 1402/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1459 as TID 1459 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1358) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1459 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1354 in 12690 ms (progress: 1403/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1460 as TID 1460 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1354) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1460 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1408 in 5522 ms (progress: 1404/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1461 as TID 1461 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1461 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1408) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1399 in 7251 ms (progress: 1405/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1462 as TID 1462 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1399) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1462 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Finished TID 1382 in 9895 ms (progress: 1406/2086) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Starting task 5.0:1463 as TID 1463 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1382) | |
| 13/03/26 20:24:09 INFO cluster.TaskSetManager: Serialized task 5.0:1463 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1418 in 4944 ms (progress: 1407/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1464 as TID 1464 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1418) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1464 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1406 in 6317 ms (progress: 1408/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1465 as TID 1465 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1406) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1465 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1423 in 5042 ms (progress: 1409/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1466 as TID 1466 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1423) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1466 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1415 in 5770 ms (progress: 1410/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1467 as TID 1467 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1415) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1467 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1419 in 5531 ms (progress: 1411/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1468 as TID 1468 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1468 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1419) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1417 in 5773 ms (progress: 1412/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1469 as TID 1469 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1417) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1469 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1410 in 6324 ms (progress: 1413/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1470 as TID 1470 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1410) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1470 as 2404 bytes in 0 ms | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1424 in 5336 ms (progress: 1414/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1471 as TID 1471 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1471 as 2404 bytes in 1 ms | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1424) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Finished TID 1362 in 13213 ms (progress: 1415/2086) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Starting task 5.0:1472 as TID 1472 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1362) | |
| 13/03/26 20:24:10 INFO cluster.TaskSetManager: Serialized task 5.0:1472 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Finished TID 1420 in 5836 ms (progress: 1416/2086) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Starting task 5.0:1473 as TID 1473 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1420) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Serialized task 5.0:1473 as 2400 bytes in 1 ms | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Finished TID 1364 in 13451 ms (progress: 1417/2086) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Starting task 5.0:1474 as TID 1474 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1364) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Serialized task 5.0:1474 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Finished TID 1416 in 6460 ms (progress: 1418/2086) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Starting task 5.0:1475 as TID 1475 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1416) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Serialized task 5.0:1475 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Finished TID 1449 in 3248 ms (progress: 1419/2086) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Starting task 5.0:1476 as TID 1476 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1449) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Serialized task 5.0:1476 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Finished TID 1440 in 4080 ms (progress: 1420/2086) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Starting task 5.0:1477 as TID 1477 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1440) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Serialized task 5.0:1477 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Finished TID 1459 in 2282 ms (progress: 1421/2086) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Starting task 5.0:1478 as TID 1478 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1459) | |
| 13/03/26 20:24:11 INFO cluster.TaskSetManager: Serialized task 5.0:1478 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1435 in 4827 ms (progress: 1422/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1479 as TID 1479 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1479 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1435) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1444 in 4311 ms (progress: 1423/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1480 as TID 1480 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1444) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1480 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1426 in 5990 ms (progress: 1424/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1481 as TID 1481 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1426) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1481 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1438 in 4639 ms (progress: 1425/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1482 as TID 1482 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1438) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1482 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1454 in 3134 ms (progress: 1426/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1483 as TID 1483 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1454) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1483 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1437 in 4966 ms (progress: 1427/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1484 as TID 1484 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1437) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1484 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1432 in 6089 ms (progress: 1428/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1485 as TID 1485 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1432) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1485 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1464 in 2637 ms (progress: 1429/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1486 as TID 1486 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1464) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1486 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1433 in 6025 ms (progress: 1430/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1487 as TID 1487 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1433) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1487 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1450 in 4115 ms (progress: 1431/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1488 as TID 1488 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1450) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1488 as 2400 bytes in 1 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1430 in 6424 ms (progress: 1432/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1489 as TID 1489 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1430) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1489 as 2400 bytes in 1 ms | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Finished TID 1445 in 4833 ms (progress: 1433/2086) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Starting task 5.0:1490 as TID 1490 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1445) | |
| 13/03/26 20:24:12 INFO cluster.TaskSetManager: Serialized task 5.0:1490 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1441 in 5377 ms (progress: 1434/2086) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1491 as TID 1491 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1441) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1491 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1447 in 4956 ms (progress: 1435/2086) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1492 as TID 1492 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1447) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1492 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1443 in 5732 ms (progress: 1436/2086) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1443) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1493 as TID 1493 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1493 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1446 in 5404 ms (progress: 1437/2086) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1494 as TID 1494 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1494 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1446) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1427 in 7425 ms (progress: 1438/2086) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1495 as TID 1495 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1427) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1495 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1458 in 4244 ms (progress: 1439/2086) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1496 as TID 1496 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1458) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1496 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1340 in 18165 ms (progress: 1440/2086) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1497 as TID 1497 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1340) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1497 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1456 in 4601 ms (progress: 1441/2086) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1498 as TID 1498 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1456) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1498 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Finished TID 1439 in 6257 ms (progress: 1442/2086) | |
| 13/03/26 20:24:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1439) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Starting task 5.0:1499 as TID 1499 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:13 INFO cluster.TaskSetManager: Serialized task 5.0:1499 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Finished TID 1411 in 9661 ms (progress: 1443/2086) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Starting task 5.0:1500 as TID 1500 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1411) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Serialized task 5.0:1500 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Finished TID 1442 in 6553 ms (progress: 1444/2086) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Starting task 5.0:1501 as TID 1501 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1442) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Serialized task 5.0:1501 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Finished TID 1473 in 3497 ms (progress: 1445/2086) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Starting task 5.0:1502 as TID 1502 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1473) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Serialized task 5.0:1502 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Finished TID 1461 in 5048 ms (progress: 1446/2086) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Starting task 5.0:1503 as TID 1503 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1461) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Serialized task 5.0:1503 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Finished TID 1452 in 5969 ms (progress: 1447/2086) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Starting task 5.0:1504 as TID 1504 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1452) | |
| 13/03/26 20:24:14 INFO cluster.TaskSetManager: Serialized task 5.0:1504 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1453 in 6024 ms (progress: 1448/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1505 as TID 1505 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1453) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1505 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1434 in 8060 ms (progress: 1449/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1506 as TID 1506 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1506 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1434) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1477 in 3438 ms (progress: 1450/2086) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1477) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1507 as TID 1507 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1507 as 2386 bytes in 1 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1352 in 18455 ms (progress: 1451/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1508 as TID 1508 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1352) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1508 as 2386 bytes in 1 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1455 in 6089 ms (progress: 1452/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1509 as TID 1509 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1455) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1509 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1475 in 3921 ms (progress: 1453/2086) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1475) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1510 as TID 1510 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1510 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1460 in 5873 ms (progress: 1454/2086) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1460) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1511 as TID 1511 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1511 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1451 in 6754 ms (progress: 1455/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1512 as TID 1512 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1451) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1512 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1429 in 9293 ms (progress: 1456/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1513 as TID 1513 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1429) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1513 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1469 in 4867 ms (progress: 1457/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1514 as TID 1514 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1514 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1469) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1428 in 9343 ms (progress: 1458/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1515 as TID 1515 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1515 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1428) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1479 in 3713 ms (progress: 1459/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1516 as TID 1516 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1479) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1516 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Finished TID 1436 in 8427 ms (progress: 1460/2086) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Starting task 5.0:1517 as TID 1517 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1436) | |
| 13/03/26 20:24:15 INFO cluster.TaskSetManager: Serialized task 5.0:1517 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Finished TID 1465 in 5959 ms (progress: 1461/2086) | |
| 13/03/26 20:24:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1465) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Starting task 5.0:1518 as TID 1518 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Serialized task 5.0:1518 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Finished TID 1448 in 7885 ms (progress: 1462/2086) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Starting task 5.0:1519 as TID 1519 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1448) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Serialized task 5.0:1519 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Finished TID 1485 in 3502 ms (progress: 1463/2086) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Starting task 5.0:1520 as TID 1520 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1485) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Serialized task 5.0:1520 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Finished TID 1462 in 6496 ms (progress: 1464/2086) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Starting task 5.0:1521 as TID 1521 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Serialized task 5.0:1521 as 2386 bytes in 1 ms | |
| 13/03/26 20:24:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1462) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Finished TID 1467 in 5951 ms (progress: 1465/2086) | |
| 13/03/26 20:24:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1467) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Starting task 5.0:1522 as TID 1522 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:16 INFO cluster.TaskSetManager: Serialized task 5.0:1522 as 2386 bytes in 1 ms | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Finished TID 1483 in 4712 ms (progress: 1466/2086) | |
| 13/03/26 20:24:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1483) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Starting task 5.0:1523 as TID 1523 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Serialized task 5.0:1523 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Finished TID 1491 in 4076 ms (progress: 1467/2086) | |
| 13/03/26 20:24:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1491) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Starting task 5.0:1524 as TID 1524 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Serialized task 5.0:1524 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Finished TID 1468 in 6615 ms (progress: 1468/2086) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Starting task 5.0:1525 as TID 1525 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1468) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Serialized task 5.0:1525 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Finished TID 1404 in 13941 ms (progress: 1469/2086) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Starting task 5.0:1526 as TID 1526 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1404) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Serialized task 5.0:1526 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Finished TID 1524 in 704 ms (progress: 1470/2086) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Starting task 5.0:1527 as TID 1527 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1524) | |
| 13/03/26 20:24:17 INFO cluster.TaskSetManager: Serialized task 5.0:1527 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Finished TID 1457 in 8683 ms (progress: 1471/2086) | |
| 13/03/26 20:24:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1457) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Starting task 5.0:1528 as TID 1528 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Serialized task 5.0:1528 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Finished TID 1497 in 4177 ms (progress: 1472/2086) | |
| 13/03/26 20:24:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1497) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Starting task 5.0:1529 as TID 1529 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Serialized task 5.0:1529 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Finished TID 1505 in 3181 ms (progress: 1473/2086) | |
| 13/03/26 20:24:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1505) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Starting task 5.0:1530 as TID 1530 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Serialized task 5.0:1530 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Finished TID 1487 in 5405 ms (progress: 1474/2086) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Starting task 5.0:1531 as TID 1531 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1487) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Serialized task 5.0:1531 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Finished TID 1501 in 4386 ms (progress: 1475/2086) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Starting task 5.0:1532 as TID 1532 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1501) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Serialized task 5.0:1532 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Finished TID 1463 in 9003 ms (progress: 1476/2086) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Starting task 5.0:1533 as TID 1533 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1463) | |
| 13/03/26 20:24:18 INFO cluster.TaskSetManager: Serialized task 5.0:1533 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1421 in 13883 ms (progress: 1477/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1534 as TID 1534 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1421) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1534 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1495 in 5584 ms (progress: 1478/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1535 as TID 1535 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1495) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1535 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1472 in 8417 ms (progress: 1479/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1536 as TID 1536 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1472) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1536 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1503 in 4667 ms (progress: 1480/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1537 as TID 1537 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1537 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1503) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1508 in 4263 ms (progress: 1481/2086) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1508) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1538 as TID 1538 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1538 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1184 in 41790 ms (progress: 1482/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1539 as TID 1539 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1184) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1539 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1535 in 433 ms (progress: 1483/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1540 as TID 1540 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1535) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1540 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1493 in 6200 ms (progress: 1484/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1541 as TID 1541 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1493) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1541 as 2398 bytes in 1 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1470 in 9054 ms (progress: 1485/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1542 as TID 1542 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1470) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1542 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Finished TID 1507 in 4699 ms (progress: 1486/2086) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Starting task 5.0:1543 as TID 1543 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1507) | |
| 13/03/26 20:24:19 INFO cluster.TaskSetManager: Serialized task 5.0:1543 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1474 in 8636 ms (progress: 1487/2086) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1544 as TID 1544 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1474) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1544 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1489 in 7177 ms (progress: 1488/2086) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1489) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1545 as TID 1545 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1545 as 2395 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1348 in 23435 ms (progress: 1489/2086) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1546 as TID 1546 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1546 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1348) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1512 in 4754 ms (progress: 1490/2086) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1547 as TID 1547 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1512) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1547 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1511 in 5117 ms (progress: 1491/2086) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1548 as TID 1548 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1511) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1548 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1499 in 6661 ms (progress: 1492/2086) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1549 as TID 1549 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1499) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1549 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1328 in 26166 ms (progress: 1493/2086) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1550 as TID 1550 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1328) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1550 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1494 in 7093 ms (progress: 1494/2086) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1551 as TID 1551 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1494) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1551 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Finished TID 1514 in 5258 ms (progress: 1495/2086) | |
| 13/03/26 20:24:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1514) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Starting task 5.0:1552 as TID 1552 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:20 INFO cluster.TaskSetManager: Serialized task 5.0:1552 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1518 in 4882 ms (progress: 1496/2086) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1553 as TID 1553 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1518) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1553 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1481 in 8999 ms (progress: 1497/2086) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1481) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1554 as TID 1554 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1554 as 2384 bytes in 1 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1509 in 5942 ms (progress: 1498/2086) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1509) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1555 as TID 1555 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1555 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1516 in 5640 ms (progress: 1499/2086) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1516) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1556 as TID 1556 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1556 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1486 in 8691 ms (progress: 1500/2086) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1486) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1557 as TID 1557 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1557 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1492 in 8227 ms (progress: 1501/2086) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1492) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1558 as TID 1558 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1558 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1496 in 7993 ms (progress: 1502/2086) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1559 as TID 1559 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1496) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1559 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Finished TID 1471 in 11021 ms (progress: 1503/2086) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Starting task 5.0:1560 as TID 1560 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1471) | |
| 13/03/26 20:24:21 INFO cluster.TaskSetManager: Serialized task 5.0:1560 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1476 in 10433 ms (progress: 1504/2086) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1561 as TID 1561 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1476) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1561 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1522 in 5770 ms (progress: 1505/2086) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1562 as TID 1562 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1522) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1562 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1521 in 6078 ms (progress: 1506/2086) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1521) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1563 as TID 1563 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1563 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1520 in 6148 ms (progress: 1507/2086) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1520) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1564 as TID 1564 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1564 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1510 in 7298 ms (progress: 1508/2086) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1510) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1565 as TID 1565 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1565 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1506 in 7520 ms (progress: 1509/2086) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1506) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1566 as TID 1566 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1566 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1527 in 4813 ms (progress: 1510/2086) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1527) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1567 as TID 1567 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1567 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Finished TID 1529 in 4896 ms (progress: 1511/2086) | |
| 13/03/26 20:24:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1529) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Starting task 5.0:1568 as TID 1568 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:22 INFO cluster.TaskSetManager: Serialized task 5.0:1568 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Finished TID 1504 in 8175 ms (progress: 1512/2086) | |
| 13/03/26 20:24:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1504) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Starting task 5.0:1569 as TID 1569 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Serialized task 5.0:1569 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Finished TID 1551 in 2750 ms (progress: 1513/2086) | |
| 13/03/26 20:24:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1551) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Starting task 5.0:1570 as TID 1570 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Serialized task 5.0:1570 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Finished TID 1525 in 6414 ms (progress: 1514/2086) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Starting task 5.0:1571 as TID 1571 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Serialized task 5.0:1571 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1525) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Finished TID 1538 in 4279 ms (progress: 1515/2086) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Starting task 5.0:1572 as TID 1572 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1538) | |
| 13/03/26 20:24:23 INFO cluster.TaskSetManager: Serialized task 5.0:1572 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1536 in 4739 ms (progress: 1516/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1573 as TID 1573 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1536) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1573 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1528 in 6092 ms (progress: 1517/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1574 as TID 1574 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1528) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1574 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1523 in 7196 ms (progress: 1518/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1575 as TID 1575 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1523) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1575 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1543 in 4259 ms (progress: 1519/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1576 as TID 1576 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1543) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1576 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1530 in 6022 ms (progress: 1520/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1577 as TID 1577 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1577 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1530) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1519 in 8164 ms (progress: 1521/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1578 as TID 1578 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1519) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1578 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1517 in 8544 ms (progress: 1522/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1579 as TID 1579 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1579 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1517) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1198 in 45558 ms (progress: 1523/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1580 as TID 1580 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1198) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1580 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1541 in 4885 ms (progress: 1524/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1581 as TID 1581 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1541) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1581 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Finished TID 1531 in 6412 ms (progress: 1525/2086) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Starting task 5.0:1582 as TID 1582 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1531) | |
| 13/03/26 20:24:24 INFO cluster.TaskSetManager: Serialized task 5.0:1582 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1556 in 3711 ms (progress: 1526/2086) | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1556) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1583 as TID 1583 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1583 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1502 in 10631 ms (progress: 1527/2086) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1584 as TID 1584 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1502) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1584 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1532 in 6497 ms (progress: 1528/2086) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1585 as TID 1585 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1532) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1585 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1544 in 5560 ms (progress: 1529/2086) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1586 as TID 1586 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1544) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1586 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1545 in 5475 ms (progress: 1530/2086) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1587 as TID 1587 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1545) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1587 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1539 in 6067 ms (progress: 1531/2086) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1588 as TID 1588 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1539) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1588 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1515 in 10184 ms (progress: 1532/2086) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1589 as TID 1589 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1589 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1515) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Finished TID 1480 in 13769 ms (progress: 1533/2086) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Starting task 5.0:1590 as TID 1590 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1480) | |
| 13/03/26 20:24:25 INFO cluster.TaskSetManager: Serialized task 5.0:1590 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1557 in 4675 ms (progress: 1534/2086) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1591 as TID 1591 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1557) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1591 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1559 in 4330 ms (progress: 1535/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1559) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1592 as TID 1592 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1592 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1537 in 6758 ms (progress: 1536/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1537) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1593 as TID 1593 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1593 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1547 in 5984 ms (progress: 1537/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1547) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1594 as TID 1594 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1594 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1558 in 4871 ms (progress: 1538/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1558) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1595 as TID 1595 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1595 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1513 in 10885 ms (progress: 1539/2086) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1596 as TID 1596 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1513) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1596 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1550 in 5868 ms (progress: 1540/2086) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1597 as TID 1597 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1550) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1597 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1548 in 6006 ms (progress: 1541/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1548) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1598 as TID 1598 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1598 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1560 in 4801 ms (progress: 1542/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1560) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1599 as TID 1599 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1599 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1575 in 2454 ms (progress: 1543/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1575) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1600 as TID 1600 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1600 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1542 in 6852 ms (progress: 1544/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1542) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1601 as TID 1601 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1601 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Finished TID 1526 in 9408 ms (progress: 1545/2086) | |
| 13/03/26 20:24:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1526) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Starting task 5.0:1602 as TID 1602 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:26 INFO cluster.TaskSetManager: Serialized task 5.0:1602 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1488 in 14109 ms (progress: 1546/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1488) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1603 as TID 1603 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1603 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1552 in 6096 ms (progress: 1547/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1552) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1604 as TID 1604 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1604 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1549 in 6399 ms (progress: 1548/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1549) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1605 as TID 1605 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1605 as 2404 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1570 in 3644 ms (progress: 1549/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1570) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1606 as TID 1606 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1606 as 2404 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1554 in 5914 ms (progress: 1550/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1554) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1607 as TID 1607 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1607 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1553 in 6549 ms (progress: 1551/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1553) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1608 as TID 1608 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1608 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1555 in 6318 ms (progress: 1552/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1555) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1609 as TID 1609 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1609 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1584 in 2506 ms (progress: 1553/2086) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1584) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1610 as TID 1610 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1610 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1533 in 9021 ms (progress: 1554/2086) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1611 as TID 1611 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1533) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1611 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Finished TID 1594 in 1692 ms (progress: 1555/2086) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Starting task 5.0:1612 as TID 1612 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1594) | |
| 13/03/26 20:24:27 INFO cluster.TaskSetManager: Serialized task 5.0:1612 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1572 in 4292 ms (progress: 1556/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1613 as TID 1613 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1572) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1613 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1534 in 9037 ms (progress: 1557/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1614 as TID 1614 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1534) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1614 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1564 in 5866 ms (progress: 1558/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1615 as TID 1615 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1564) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1615 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1567 in 5412 ms (progress: 1559/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1616 as TID 1616 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1567) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1616 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1540 in 8682 ms (progress: 1560/2086) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1540) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1617 as TID 1617 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1617 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1563 in 6199 ms (progress: 1561/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1618 as TID 1618 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1563) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1618 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1573 in 4447 ms (progress: 1562/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1619 as TID 1619 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1619 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1573) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1562 in 6369 ms (progress: 1563/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1620 as TID 1620 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1562) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1620 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1561 in 6719 ms (progress: 1564/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1621 as TID 1621 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1621 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1561) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1599 in 2246 ms (progress: 1565/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1622 as TID 1622 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1599) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1622 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Finished TID 1568 in 5999 ms (progress: 1566/2086) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Starting task 5.0:1623 as TID 1623 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1568) | |
| 13/03/26 20:24:28 INFO cluster.TaskSetManager: Serialized task 5.0:1623 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Finished TID 1500 in 14710 ms (progress: 1567/2086) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Starting task 5.0:1624 as TID 1624 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1500) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Serialized task 5.0:1624 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Finished TID 1569 in 6077 ms (progress: 1568/2086) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Starting task 5.0:1625 as TID 1625 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1569) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Serialized task 5.0:1625 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Finished TID 1574 in 5458 ms (progress: 1569/2086) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Starting task 5.0:1626 as TID 1626 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1574) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Serialized task 5.0:1626 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Finished TID 1546 in 9525 ms (progress: 1570/2086) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Starting task 5.0:1627 as TID 1627 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1546) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Serialized task 5.0:1627 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Finished TID 1566 in 7056 ms (progress: 1571/2086) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Starting task 5.0:1628 as TID 1628 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1566) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Serialized task 5.0:1628 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Finished TID 1565 in 7093 ms (progress: 1572/2086) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Starting task 5.0:1629 as TID 1629 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1565) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Serialized task 5.0:1629 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Finished TID 1576 in 5583 ms (progress: 1573/2086) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Starting task 5.0:1630 as TID 1630 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1576) | |
| 13/03/26 20:24:29 INFO cluster.TaskSetManager: Serialized task 5.0:1630 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1571 in 6385 ms (progress: 1574/2086) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1631 as TID 1631 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1571) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1631 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1577 in 5958 ms (progress: 1575/2086) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1632 as TID 1632 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1577) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1632 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1484 in 17846 ms (progress: 1576/2086) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1633 as TID 1633 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1484) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1633 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1592 in 4104 ms (progress: 1577/2086) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1634 as TID 1634 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1592) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1634 as 2398 bytes in 1 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1589 in 4455 ms (progress: 1578/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1589) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1635 as TID 1635 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1635 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1581 in 5735 ms (progress: 1579/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1581) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1636 as TID 1636 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1636 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1490 in 17492 ms (progress: 1580/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1490) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1637 as TID 1637 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1637 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1590 in 4589 ms (progress: 1581/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1590) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1638 as TID 1638 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1638 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1608 in 3016 ms (progress: 1582/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1608) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1639 as TID 1639 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1639 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1580 in 6041 ms (progress: 1583/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1580) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1640 as TID 1640 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1640 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1591 in 4561 ms (progress: 1584/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1591) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1641 as TID 1641 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1641 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1604 in 3661 ms (progress: 1585/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1604) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1642 as TID 1642 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1642 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1578 in 6529 ms (progress: 1586/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1578) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1643 as TID 1643 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1643 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Finished TID 1612 in 2986 ms (progress: 1587/2086) | |
| 13/03/26 20:24:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1612) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Starting task 5.0:1644 as TID 1644 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:30 INFO cluster.TaskSetManager: Serialized task 5.0:1644 as 2386 bytes in 1 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1595 in 4693 ms (progress: 1588/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1595) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1645 as TID 1645 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1645 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1616 in 2836 ms (progress: 1589/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1616) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1646 as TID 1646 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1646 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1582 in 6368 ms (progress: 1590/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1582) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1647 as TID 1647 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1647 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1593 in 4882 ms (progress: 1591/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1593) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1648 as TID 1648 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1648 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1618 in 2904 ms (progress: 1592/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1618) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1649 as TID 1649 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1649 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1603 in 4412 ms (progress: 1593/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1603) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1650 as TID 1650 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1650 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1610 in 3936 ms (progress: 1594/2086) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1651 as TID 1651 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1651 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1610) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1587 in 6081 ms (progress: 1595/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1587) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1652 as TID 1652 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1652 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1586 in 6217 ms (progress: 1596/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1586) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1653 as TID 1653 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1653 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1614 in 3604 ms (progress: 1597/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1614) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1654 as TID 1654 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1654 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1620 in 3162 ms (progress: 1598/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1620) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1655 as TID 1655 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1655 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1600 in 5285 ms (progress: 1599/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1600) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1656 as TID 1656 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1656 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Finished TID 1585 in 6681 ms (progress: 1600/2086) | |
| 13/03/26 20:24:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1585) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Starting task 5.0:1657 as TID 1657 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:31 INFO cluster.TaskSetManager: Serialized task 5.0:1657 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Finished TID 1583 in 6919 ms (progress: 1601/2086) | |
| 13/03/26 20:24:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1583) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Starting task 5.0:1658 as TID 1658 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Serialized task 5.0:1658 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Finished TID 1579 in 7656 ms (progress: 1602/2086) | |
| 13/03/26 20:24:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1579) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Starting task 5.0:1659 as TID 1659 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Serialized task 5.0:1659 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Finished TID 1622 in 3183 ms (progress: 1603/2086) | |
| 13/03/26 20:24:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1622) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Starting task 5.0:1660 as TID 1660 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Serialized task 5.0:1660 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Finished TID 1588 in 6563 ms (progress: 1604/2086) | |
| 13/03/26 20:24:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1588) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Starting task 5.0:1661 as TID 1661 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Serialized task 5.0:1661 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Finished TID 1597 in 5854 ms (progress: 1605/2086) | |
| 13/03/26 20:24:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1597) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Starting task 5.0:1662 as TID 1662 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Serialized task 5.0:1662 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Finished TID 1598 in 5937 ms (progress: 1606/2086) | |
| 13/03/26 20:24:32 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1598) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Starting task 5.0:1663 as TID 1663 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:32 INFO cluster.TaskSetManager: Serialized task 5.0:1663 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Finished TID 1601 in 6353 ms (progress: 1607/2086) | |
| 13/03/26 20:24:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1601) | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Starting task 5.0:1664 as TID 1664 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Serialized task 5.0:1664 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Finished TID 1634 in 3483 ms (progress: 1608/2086) | |
| 13/03/26 20:24:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1634) | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Starting task 5.0:1665 as TID 1665 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Serialized task 5.0:1665 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Finished TID 1638 in 3377 ms (progress: 1609/2086) | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Starting task 5.0:1666 as TID 1666 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:33 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1638) | |
| 13/03/26 20:24:33 INFO cluster.TaskSetManager: Serialized task 5.0:1666 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Finished TID 1632 in 3838 ms (progress: 1610/2086) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Starting task 5.0:1667 as TID 1667 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1632) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Serialized task 5.0:1667 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Finished TID 1636 in 3799 ms (progress: 1611/2086) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Starting task 5.0:1668 as TID 1668 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1636) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Serialized task 5.0:1668 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Finished TID 1640 in 3593 ms (progress: 1612/2086) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Starting task 5.0:1669 as TID 1669 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1640) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Serialized task 5.0:1669 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Finished TID 1645 in 3616 ms (progress: 1613/2086) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Starting task 5.0:1670 as TID 1670 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1645) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Serialized task 5.0:1670 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Finished TID 1624 in 5562 ms (progress: 1614/2086) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Starting task 5.0:1671 as TID 1671 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1624) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Serialized task 5.0:1671 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Finished TID 1626 in 5137 ms (progress: 1615/2086) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Starting task 5.0:1672 as TID 1672 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:34 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1626) | |
| 13/03/26 20:24:34 INFO cluster.TaskSetManager: Serialized task 5.0:1672 as 2384 bytes in 1 ms | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Finished TID 1646 in 4084 ms (progress: 1616/2086) | |
| 13/03/26 20:24:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1646) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Starting task 5.0:1673 as TID 1673 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Serialized task 5.0:1673 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Finished TID 1650 in 3736 ms (progress: 1617/2086) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Starting task 5.0:1674 as TID 1674 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1650) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Serialized task 5.0:1674 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Finished TID 1641 in 4734 ms (progress: 1618/2086) | |
| 13/03/26 20:24:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1641) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Starting task 5.0:1675 as TID 1675 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Serialized task 5.0:1675 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Finished TID 1602 in 8561 ms (progress: 1619/2086) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Starting task 5.0:1676 as TID 1676 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1602) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Serialized task 5.0:1676 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Finished TID 1628 in 6033 ms (progress: 1620/2086) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Starting task 5.0:1677 as TID 1677 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1628) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Serialized task 5.0:1677 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Finished TID 1630 in 6045 ms (progress: 1621/2086) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Starting task 5.0:1678 as TID 1678 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1630) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Serialized task 5.0:1678 as 2395 bytes in 0 ms | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Finished TID 1596 in 9350 ms (progress: 1622/2086) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Starting task 5.0:1679 as TID 1679 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:35 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1596) | |
| 13/03/26 20:24:35 INFO cluster.TaskSetManager: Serialized task 5.0:1679 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Finished TID 1649 in 4891 ms (progress: 1623/2086) | |
| 13/03/26 20:24:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1649) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Starting task 5.0:1680 as TID 1680 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Serialized task 5.0:1680 as 2384 bytes in 1 ms | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Finished TID 1498 in 22613 ms (progress: 1624/2086) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Starting task 5.0:1681 as TID 1681 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1498) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Serialized task 5.0:1681 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Finished TID 1642 in 5830 ms (progress: 1625/2086) | |
| 13/03/26 20:24:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1642) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Starting task 5.0:1682 as TID 1682 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Serialized task 5.0:1682 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Finished TID 1651 in 5180 ms (progress: 1626/2086) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Starting task 5.0:1683 as TID 1683 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1651) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Serialized task 5.0:1683 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Finished TID 1647 in 5733 ms (progress: 1627/2086) | |
| 13/03/26 20:24:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1647) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Starting task 5.0:1684 as TID 1684 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Serialized task 5.0:1684 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Finished TID 1663 in 4359 ms (progress: 1628/2086) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Starting task 5.0:1685 as TID 1685 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:36 INFO cluster.TaskSetManager: Serialized task 5.0:1685 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:36 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1663) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1648 in 5952 ms (progress: 1629/2086) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1648) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1686 as TID 1686 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1686 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1660 in 4952 ms (progress: 1630/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1687 as TID 1687 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1660) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1687 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1652 in 5351 ms (progress: 1631/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1688 as TID 1688 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1652) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1688 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1478 in 25184 ms (progress: 1632/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1689 as TID 1689 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1478) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1689 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1656 in 5543 ms (progress: 1633/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1690 as TID 1690 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1656) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1690 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1653 in 5710 ms (progress: 1634/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1691 as TID 1691 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1653) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1691 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1655 in 5793 ms (progress: 1635/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1692 as TID 1692 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1692 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1655) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1643 in 6904 ms (progress: 1636/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1693 as TID 1693 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1643) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1693 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Finished TID 1658 in 5830 ms (progress: 1637/2086) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Starting task 5.0:1694 as TID 1694 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:37 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1658) | |
| 13/03/26 20:24:37 INFO cluster.TaskSetManager: Serialized task 5.0:1694 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1665 in 4281 ms (progress: 1638/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1695 as TID 1695 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1665) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1695 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1662 in 5815 ms (progress: 1639/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1696 as TID 1696 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1696 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1662) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1657 in 6499 ms (progress: 1640/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1697 as TID 1697 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1657) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1697 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1644 in 7553 ms (progress: 1641/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1698 as TID 1698 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1698 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1644) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1661 in 6260 ms (progress: 1642/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1699 as TID 1699 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1661) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1699 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1684 in 1805 ms (progress: 1643/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1700 as TID 1700 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1684) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1700 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1666 in 4719 ms (progress: 1644/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1701 as TID 1701 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1666) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1701 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1609 in 11171 ms (progress: 1645/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1702 as TID 1702 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1702 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1609) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1633 in 8571 ms (progress: 1646/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1703 as TID 1703 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1633) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1703 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1673 in 3735 ms (progress: 1647/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1704 as TID 1704 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1673) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1704 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Finished TID 1674 in 3716 ms (progress: 1648/2086) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Starting task 5.0:1705 as TID 1705 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:38 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1674) | |
| 13/03/26 20:24:38 INFO cluster.TaskSetManager: Serialized task 5.0:1705 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Finished TID 1621 in 10357 ms (progress: 1649/2086) | |
| 13/03/26 20:24:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1621) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Starting task 5.0:1706 as TID 1706 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Serialized task 5.0:1706 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Finished TID 1668 in 5172 ms (progress: 1650/2086) | |
| 13/03/26 20:24:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1668) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Starting task 5.0:1707 as TID 1707 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Serialized task 5.0:1707 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Finished TID 1670 in 4879 ms (progress: 1651/2086) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Starting task 5.0:1708 as TID 1708 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Serialized task 5.0:1708 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1670) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Finished TID 1675 in 4192 ms (progress: 1652/2086) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Starting task 5.0:1709 as TID 1709 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1675) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Serialized task 5.0:1709 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Finished TID 1654 in 7994 ms (progress: 1653/2086) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Starting task 5.0:1710 as TID 1710 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1654) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Serialized task 5.0:1710 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Finished TID 1667 in 5845 ms (progress: 1654/2086) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Starting task 5.0:1711 as TID 1711 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1667) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Serialized task 5.0:1711 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Finished TID 1689 in 2848 ms (progress: 1655/2086) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Starting task 5.0:1712 as TID 1712 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:39 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1689) | |
| 13/03/26 20:24:39 INFO cluster.TaskSetManager: Serialized task 5.0:1712 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Finished TID 1659 in 7978 ms (progress: 1656/2086) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Starting task 5.0:1713 as TID 1713 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1659) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Serialized task 5.0:1713 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Finished TID 1672 in 5542 ms (progress: 1657/2086) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Starting task 5.0:1714 as TID 1714 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1672) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Serialized task 5.0:1714 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Finished TID 1664 in 7499 ms (progress: 1658/2086) | |
| 13/03/26 20:24:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1664) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Starting task 5.0:1715 as TID 1715 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Serialized task 5.0:1715 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Finished TID 1669 in 6545 ms (progress: 1659/2086) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Starting task 5.0:1716 as TID 1716 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1669) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Serialized task 5.0:1716 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Finished TID 1708 in 1403 ms (progress: 1660/2086) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Starting task 5.0:1717 as TID 1717 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:40 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1708) | |
| 13/03/26 20:24:40 INFO cluster.TaskSetManager: Serialized task 5.0:1717 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Finished TID 1681 in 4804 ms (progress: 1661/2086) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Starting task 5.0:1718 as TID 1718 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1681) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Serialized task 5.0:1718 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Finished TID 1617 in 12968 ms (progress: 1662/2086) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Starting task 5.0:1719 as TID 1719 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1617) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Serialized task 5.0:1719 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Finished TID 1625 in 12368 ms (progress: 1663/2086) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Starting task 5.0:1720 as TID 1720 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1625) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Serialized task 5.0:1720 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Finished TID 1631 in 11507 ms (progress: 1664/2086) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Starting task 5.0:1721 as TID 1721 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1631) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Serialized task 5.0:1721 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Finished TID 1717 in 832 ms (progress: 1665/2086) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Starting task 5.0:1722 as TID 1722 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1717) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Serialized task 5.0:1722 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Finished TID 1687 in 4803 ms (progress: 1666/2086) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Starting task 5.0:1723 as TID 1723 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Serialized task 5.0:1723 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1687) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Finished TID 1703 in 3009 ms (progress: 1667/2086) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Starting task 5.0:1724 as TID 1724 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:41 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1703) | |
| 13/03/26 20:24:41 INFO cluster.TaskSetManager: Serialized task 5.0:1724 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Finished TID 1680 in 5789 ms (progress: 1668/2086) | |
| 13/03/26 20:24:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1680) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Starting task 5.0:1725 as TID 1725 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Serialized task 5.0:1725 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Finished TID 1695 in 4264 ms (progress: 1669/2086) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Starting task 5.0:1726 as TID 1726 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1695) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Serialized task 5.0:1726 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Finished TID 1683 in 5858 ms (progress: 1670/2086) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Starting task 5.0:1727 as TID 1727 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1683) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Serialized task 5.0:1727 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Finished TID 1690 in 5400 ms (progress: 1671/2086) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Starting task 5.0:1728 as TID 1728 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Serialized task 5.0:1728 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1690) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Finished TID 1705 in 4034 ms (progress: 1672/2086) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Starting task 5.0:1729 as TID 1729 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1705) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Serialized task 5.0:1729 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Finished TID 1637 in 12462 ms (progress: 1673/2086) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Starting task 5.0:1730 as TID 1730 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1637) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Serialized task 5.0:1730 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Finished TID 1688 in 5923 ms (progress: 1674/2086) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Starting task 5.0:1731 as TID 1731 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:42 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1688) | |
| 13/03/26 20:24:42 INFO cluster.TaskSetManager: Serialized task 5.0:1731 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1685 in 6075 ms (progress: 1675/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1732 as TID 1732 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1685) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1732 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1701 in 4379 ms (progress: 1676/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1733 as TID 1733 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1701) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1733 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1677 in 7266 ms (progress: 1677/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1734 as TID 1734 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1677) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1734 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1722 in 1393 ms (progress: 1678/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1735 as TID 1735 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1722) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1735 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1676 in 7734 ms (progress: 1679/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1736 as TID 1736 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1736 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1676) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1692 in 5961 ms (progress: 1680/2086) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1692) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1737 as TID 1737 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1737 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1727 in 955 ms (progress: 1681/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1738 as TID 1738 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1727) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1738 as 2404 bytes in 1 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1635 in 13370 ms (progress: 1682/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1739 as TID 1739 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1635) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1739 as 2404 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1691 in 6375 ms (progress: 1683/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1740 as TID 1740 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1691) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1740 as 2372 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Finished TID 1712 in 4020 ms (progress: 1684/2086) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Starting task 5.0:1741 as TID 1741 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:43 INFO cluster.TaskSetManager: Serialized task 5.0:1741 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:43 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1712) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1623 in 15056 ms (progress: 1685/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1742 as TID 1742 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1623) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1742 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1704 in 5213 ms (progress: 1686/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1743 as TID 1743 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1743 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1704) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1699 in 5600 ms (progress: 1687/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1744 as TID 1744 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1699) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1744 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1686 in 7180 ms (progress: 1688/2086) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1686) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1745 as TID 1745 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1745 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1709 in 4673 ms (progress: 1689/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1746 as TID 1746 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1709) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1746 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1606 in 17217 ms (progress: 1690/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1747 as TID 1747 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1747 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1606) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1698 in 5868 ms (progress: 1691/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1748 as TID 1748 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1698) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1748 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1732 in 1523 ms (progress: 1692/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1749 as TID 1749 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1749 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1732) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1619 in 16024 ms (progress: 1693/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1750 as TID 1750 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1750 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1619) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1702 in 5885 ms (progress: 1694/2086) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1702) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1751 as TID 1751 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1751 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1696 in 6413 ms (progress: 1695/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1752 as TID 1752 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1696) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1752 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1671 in 10056 ms (progress: 1696/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1753 as TID 1753 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1671) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1753 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Finished TID 1611 in 16858 ms (progress: 1697/2086) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Starting task 5.0:1754 as TID 1754 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:44 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1611) | |
| 13/03/26 20:24:44 INFO cluster.TaskSetManager: Serialized task 5.0:1754 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Finished TID 1678 in 9167 ms (progress: 1698/2086) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Starting task 5.0:1755 as TID 1755 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1678) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Serialized task 5.0:1755 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Finished TID 1693 in 7485 ms (progress: 1699/2086) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Starting task 5.0:1756 as TID 1756 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1693) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Serialized task 5.0:1756 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Finished TID 1682 in 8719 ms (progress: 1700/2086) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Starting task 5.0:1757 as TID 1757 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1682) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Serialized task 5.0:1757 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Finished TID 1714 in 5257 ms (progress: 1701/2086) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Starting task 5.0:1758 as TID 1758 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1714) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Serialized task 5.0:1758 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Finished TID 1679 in 9745 ms (progress: 1702/2086) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Starting task 5.0:1759 as TID 1759 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Serialized task 5.0:1759 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1679) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Finished TID 1718 in 4591 ms (progress: 1703/2086) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Starting task 5.0:1760 as TID 1760 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:45 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1718) | |
| 13/03/26 20:24:45 INFO cluster.TaskSetManager: Serialized task 5.0:1760 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1711 in 6122 ms (progress: 1704/2086) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1761 as TID 1761 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1711) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1761 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1707 in 6668 ms (progress: 1705/2086) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1762 as TID 1762 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1707) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1762 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1737 in 2718 ms (progress: 1706/2086) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1737) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1763 as TID 1763 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1763 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1615 in 18129 ms (progress: 1707/2086) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1615) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1764 as TID 1764 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1764 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1726 in 4200 ms (progress: 1708/2086) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1726) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1765 as TID 1765 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1765 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1746 in 2476 ms (progress: 1709/2086) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1766 as TID 1766 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1746) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1766 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1710 in 7022 ms (progress: 1710/2086) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1767 as TID 1767 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1710) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1767 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1700 in 8281 ms (progress: 1711/2086) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1768 as TID 1768 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1700) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1768 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1723 in 5114 ms (progress: 1712/2086) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1769 as TID 1769 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1723) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1769 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Finished TID 1742 in 2973 ms (progress: 1713/2086) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Starting task 5.0:1770 as TID 1770 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:46 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1742) | |
| 13/03/26 20:24:46 INFO cluster.TaskSetManager: Serialized task 5.0:1770 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1740 in 3142 ms (progress: 1714/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1771 as TID 1771 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1740) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1771 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1694 in 9209 ms (progress: 1715/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1772 as TID 1772 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1694) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1772 as 2399 bytes in 1 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1729 in 4226 ms (progress: 1716/2086) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1729) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1773 as TID 1773 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1773 as 2400 bytes in 1 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1750 in 2697 ms (progress: 1717/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1774 as TID 1774 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1750) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1774 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1724 in 5570 ms (progress: 1718/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1775 as TID 1775 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1724) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1775 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1720 in 6031 ms (progress: 1719/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1776 as TID 1776 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1720) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1776 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1733 in 4570 ms (progress: 1720/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1777 as TID 1777 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1733) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1777 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1730 in 4825 ms (progress: 1721/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1778 as TID 1778 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1730) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1778 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1748 in 3420 ms (progress: 1722/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1779 as TID 1779 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1748) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1779 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1744 in 3814 ms (progress: 1723/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1780 as TID 1780 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1744) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1780 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Finished TID 1735 in 4835 ms (progress: 1724/2086) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Starting task 5.0:1781 as TID 1781 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:47 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1735) | |
| 13/03/26 20:24:47 INFO cluster.TaskSetManager: Serialized task 5.0:1781 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1715 in 7575 ms (progress: 1725/2086) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1782 as TID 1782 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1715) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1782 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1607 in 21001 ms (progress: 1726/2086) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1783 as TID 1783 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1607) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1783 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1713 in 8222 ms (progress: 1727/2086) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1784 as TID 1784 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1713) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1784 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1728 in 5547 ms (progress: 1728/2086) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1785 as TID 1785 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1728) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1785 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1756 in 3223 ms (progress: 1729/2086) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1786 as TID 1786 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1756) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1786 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1752 in 3962 ms (progress: 1730/2086) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1787 as TID 1787 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1752) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1787 as 2400 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1754 in 4026 ms (progress: 1731/2086) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1788 as TID 1788 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1788 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1754) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Finished TID 1725 in 6824 ms (progress: 1732/2086) | |
| 13/03/26 20:24:48 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1725) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Starting task 5.0:1789 as TID 1789 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:48 INFO cluster.TaskSetManager: Serialized task 5.0:1789 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Finished TID 1716 in 8320 ms (progress: 1733/2086) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Starting task 5.0:1790 as TID 1790 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1716) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Serialized task 5.0:1790 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Finished TID 1731 in 6212 ms (progress: 1734/2086) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Starting task 5.0:1791 as TID 1791 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1731) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Serialized task 5.0:1791 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Finished TID 1697 in 11020 ms (progress: 1735/2086) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Starting task 5.0:1792 as TID 1792 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Serialized task 5.0:1792 as 2386 bytes in 0 ms | |
| 13/03/26 20:24:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1697) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Finished TID 1760 in 3770 ms (progress: 1736/2086) | |
| 13/03/26 20:24:49 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1760) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Starting task 5.0:1793 as TID 1793 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:49 INFO cluster.TaskSetManager: Serialized task 5.0:1793 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1764 in 3699 ms (progress: 1737/2086) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1794 as TID 1794 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1794 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1764) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1766 in 3502 ms (progress: 1738/2086) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1795 as TID 1795 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1766) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1795 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1721 in 8751 ms (progress: 1739/2086) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1796 as TID 1796 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1796 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1721) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1736 in 7389 ms (progress: 1740/2086) | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1736) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1797 as TID 1797 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1797 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1762 in 4672 ms (progress: 1741/2086) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1798 as TID 1798 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1762) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1798 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1770 in 3729 ms (progress: 1742/2086) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1799 as TID 1799 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1770) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1799 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1706 in 11596 ms (progress: 1743/2086) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1800 as TID 1800 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1706) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1800 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Finished TID 1774 in 3638 ms (progress: 1744/2086) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Starting task 5.0:1801 as TID 1801 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:50 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1774) | |
| 13/03/26 20:24:50 INFO cluster.TaskSetManager: Serialized task 5.0:1801 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Finished TID 1734 in 8189 ms (progress: 1745/2086) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Starting task 5.0:1802 as TID 1802 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1734) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Serialized task 5.0:1802 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Finished TID 1738 in 7887 ms (progress: 1746/2086) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Starting task 5.0:1803 as TID 1803 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1738) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Serialized task 5.0:1803 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Finished TID 1768 in 4736 ms (progress: 1747/2086) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Starting task 5.0:1804 as TID 1804 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1768) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Serialized task 5.0:1804 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Finished TID 1781 in 3815 ms (progress: 1748/2086) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Starting task 5.0:1805 as TID 1805 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1781) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Serialized task 5.0:1805 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Finished TID 1743 in 7705 ms (progress: 1749/2086) | |
| 13/03/26 20:24:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1743) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Starting task 5.0:1806 as TID 1806 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Serialized task 5.0:1806 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Finished TID 1639 in 21278 ms (progress: 1750/2086) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Starting task 5.0:1807 as TID 1807 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:51 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1639) | |
| 13/03/26 20:24:51 INFO cluster.TaskSetManager: Serialized task 5.0:1807 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Finished TID 1779 in 4238 ms (progress: 1751/2086) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Starting task 5.0:1808 as TID 1808 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1779) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Serialized task 5.0:1808 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Finished TID 1777 in 4592 ms (progress: 1752/2086) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Starting task 5.0:1809 as TID 1809 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1777) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Serialized task 5.0:1809 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Finished TID 1775 in 4798 ms (progress: 1753/2086) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Starting task 5.0:1810 as TID 1810 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1775) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Serialized task 5.0:1810 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Finished TID 1605 in 25302 ms (progress: 1754/2086) | |
| 13/03/26 20:24:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1605) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Starting task 5.0:1811 as TID 1811 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Serialized task 5.0:1811 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Finished TID 1778 in 4711 ms (progress: 1755/2086) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Starting task 5.0:1812 as TID 1812 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1778) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Serialized task 5.0:1812 as 2395 bytes in 0 ms | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Finished TID 1758 in 7034 ms (progress: 1756/2086) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Starting task 5.0:1813 as TID 1813 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1758) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Serialized task 5.0:1813 as 2398 bytes in 1 ms | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Finished TID 1482 in 40351 ms (progress: 1757/2086) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Starting task 5.0:1814 as TID 1814 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:52 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1482) | |
| 13/03/26 20:24:52 INFO cluster.TaskSetManager: Serialized task 5.0:1814 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Finished TID 1751 in 8516 ms (progress: 1758/2086) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Starting task 5.0:1815 as TID 1815 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1751) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Serialized task 5.0:1815 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Finished TID 1783 in 5050 ms (progress: 1759/2086) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Starting task 5.0:1816 as TID 1816 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Serialized task 5.0:1816 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1783) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Finished TID 1785 in 4790 ms (progress: 1760/2086) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Starting task 5.0:1817 as TID 1817 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Serialized task 5.0:1817 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1785) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Finished TID 1792 in 3913 ms (progress: 1761/2086) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Starting task 5.0:1818 as TID 1818 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1792) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Serialized task 5.0:1818 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Finished TID 1776 in 6034 ms (progress: 1762/2086) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Starting task 5.0:1819 as TID 1819 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1776) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Serialized task 5.0:1819 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Finished TID 1739 in 9976 ms (progress: 1763/2086) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Starting task 5.0:1820 as TID 1820 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:53 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1739) | |
| 13/03/26 20:24:53 INFO cluster.TaskSetManager: Serialized task 5.0:1820 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1786 in 5546 ms (progress: 1764/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1821 as TID 1821 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1821 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1786) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1741 in 10118 ms (progress: 1765/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1822 as TID 1822 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1741) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1822 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1627 in 24478 ms (progress: 1766/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1823 as TID 1823 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1627) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1823 as 2384 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1761 in 8226 ms (progress: 1767/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1824 as TID 1824 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1761) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1824 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1780 in 6340 ms (progress: 1768/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1825 as TID 1825 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1780) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1825 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1818 in 918 ms (progress: 1769/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1826 as TID 1826 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1826 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1818) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1782 in 6199 ms (progress: 1770/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1827 as TID 1827 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1782) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1827 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1793 in 4869 ms (progress: 1771/2086) | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1793) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1828 as TID 1828 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1828 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Finished TID 1797 in 4058 ms (progress: 1772/2086) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Starting task 5.0:1829 as TID 1829 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:54 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1797) | |
| 13/03/26 20:24:54 INFO cluster.TaskSetManager: Serialized task 5.0:1829 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1466 in 44637 ms (progress: 1773/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1830 as TID 1830 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1466) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1830 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1795 in 4883 ms (progress: 1774/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1831 as TID 1831 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1795) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1831 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1629 in 25431 ms (progress: 1775/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1832 as TID 1832 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1629) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1832 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1765 in 8709 ms (progress: 1776/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1833 as TID 1833 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1765) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1833 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1784 in 7106 ms (progress: 1777/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1834 as TID 1834 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1784) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1834 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1791 in 6380 ms (progress: 1778/2086) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1791) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1835 as TID 1835 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1835 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1719 in 14209 ms (progress: 1779/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1836 as TID 1836 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1719) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1836 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1787 in 7050 ms (progress: 1780/2086) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1787) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1837 as TID 1837 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1837 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1794 in 5813 ms (progress: 1781/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1838 as TID 1838 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1794) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1838 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1809 in 3738 ms (progress: 1782/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1839 as TID 1839 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1809) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1839 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1772 in 8923 ms (progress: 1783/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1840 as TID 1840 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1840 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1772) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Finished TID 1767 in 9162 ms (progress: 1784/2086) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Starting task 5.0:1841 as TID 1841 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:24:55 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1767) | |
| 13/03/26 20:24:55 INFO cluster.TaskSetManager: Serialized task 5.0:1841 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1801 in 5322 ms (progress: 1785/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1842 as TID 1842 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1801) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1842 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1789 in 7297 ms (progress: 1786/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1843 as TID 1843 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1843 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1789) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1805 in 4708 ms (progress: 1787/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1844 as TID 1844 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1805) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1844 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1812 in 4120 ms (progress: 1788/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1845 as TID 1845 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1812) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1845 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1810 in 4400 ms (progress: 1789/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1846 as TID 1846 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1846 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1810) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1763 in 10343 ms (progress: 1790/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1847 as TID 1847 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1763) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1847 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1799 in 5929 ms (progress: 1791/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1848 as TID 1848 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1799) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1848 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1800 in 5993 ms (progress: 1792/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1849 as TID 1849 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1800) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1849 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1798 in 6098 ms (progress: 1793/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1850 as TID 1850 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1798) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1850 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1823 in 2705 ms (progress: 1794/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1851 as TID 1851 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1823) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1851 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Finished TID 1613 in 28890 ms (progress: 1795/2086) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Starting task 5.0:1852 as TID 1852 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:56 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1613) | |
| 13/03/26 20:24:56 INFO cluster.TaskSetManager: Serialized task 5.0:1852 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1755 in 11982 ms (progress: 1796/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1853 as TID 1853 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1755) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1853 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1813 in 4555 ms (progress: 1797/2086) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1813) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1854 as TID 1854 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1854 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1806 in 5379 ms (progress: 1798/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1855 as TID 1855 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1806) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1855 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1803 in 5714 ms (progress: 1799/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1856 as TID 1856 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1803) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1856 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1844 in 956 ms (progress: 1800/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1857 as TID 1857 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1844) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1857 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1802 in 6317 ms (progress: 1801/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1858 as TID 1858 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1802) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1858 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1788 in 8890 ms (progress: 1802/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1859 as TID 1859 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1788) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1859 as 2397 bytes in 0 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1828 in 3185 ms (progress: 1803/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1860 as TID 1860 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1828) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1860 as 2397 bytes in 1 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1745 in 13606 ms (progress: 1804/2086) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1745) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1861 as TID 1861 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1861 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Finished TID 1753 in 13300 ms (progress: 1805/2086) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Starting task 5.0:1862 as TID 1862 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:24:57 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1753) | |
| 13/03/26 20:24:57 INFO cluster.TaskSetManager: Serialized task 5.0:1862 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1808 in 6213 ms (progress: 1806/2086) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1863 as TID 1863 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1808) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1863 as 2385 bytes in 0 ms | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1804 in 6639 ms (progress: 1807/2086) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1864 as TID 1864 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1804) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1864 as 2385 bytes in 1 ms | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1807 in 6531 ms (progress: 1808/2086) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1865 as TID 1865 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1807) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1865 as 2404 bytes in 0 ms | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1773 in 11347 ms (progress: 1809/2086) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1866 as TID 1866 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1866 as 2372 bytes in 0 ms | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1773) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1814 in 5913 ms (progress: 1810/2086) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1867 as TID 1867 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1867 as 2400 bytes in 1 ms | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1814) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1749 in 14018 ms (progress: 1811/2086) | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1749) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1868 as TID 1868 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1868 as 2400 bytes in 1 ms | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1833 in 3382 ms (progress: 1812/2086) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1869 as TID 1869 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1833) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1869 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Finished TID 1817 in 5393 ms (progress: 1813/2086) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Starting task 5.0:1870 as TID 1870 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:24:58 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1817) | |
| 13/03/26 20:24:58 INFO cluster.TaskSetManager: Serialized task 5.0:1870 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1852 in 2058 ms (progress: 1814/2086) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1852) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1871 as TID 1871 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1871 as 2398 bytes in 1 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1848 in 2436 ms (progress: 1815/2086) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1848) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1872 as TID 1872 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1872 as 2398 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1815 in 6023 ms (progress: 1816/2086) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1873 as TID 1873 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1815) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1873 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1816 in 5952 ms (progress: 1817/2086) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1816) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1874 as TID 1874 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1874 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1856 in 2257 ms (progress: 1818/2086) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1875 as TID 1875 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1875 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1856) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1819 in 5923 ms (progress: 1819/2086) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1876 as TID 1876 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1819) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1876 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1796 in 9190 ms (progress: 1820/2086) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1877 as TID 1877 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1796) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1877 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1860 in 1963 ms (progress: 1821/2086) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1860) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1878 as TID 1878 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1878 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1821 in 5842 ms (progress: 1822/2086) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1879 as TID 1879 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1821) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1879 as 2399 bytes in 0 ms | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Finished TID 1831 in 4808 ms (progress: 1823/2086) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Starting task 5.0:1880 as TID 1880 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:24:59 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1831) | |
| 13/03/26 20:24:59 INFO cluster.TaskSetManager: Serialized task 5.0:1880 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Finished TID 1771 in 13035 ms (progress: 1824/2086) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Starting task 5.0:1881 as TID 1881 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1771) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Serialized task 5.0:1881 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Finished TID 1811 in 7878 ms (progress: 1825/2086) | |
| 13/03/26 20:25:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1811) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Starting task 5.0:1882 as TID 1882 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Serialized task 5.0:1882 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Finished TID 1830 in 5249 ms (progress: 1826/2086) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Starting task 5.0:1883 as TID 1883 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1830) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Serialized task 5.0:1883 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Finished TID 1824 in 6095 ms (progress: 1827/2086) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Starting task 5.0:1884 as TID 1884 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1824) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Serialized task 5.0:1884 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Finished TID 1839 in 4465 ms (progress: 1828/2086) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Starting task 5.0:1885 as TID 1885 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1839) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Serialized task 5.0:1885 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Finished TID 1840 in 4613 ms (progress: 1829/2086) | |
| 13/03/26 20:25:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1840) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Starting task 5.0:1886 as TID 1886 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Serialized task 5.0:1886 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Finished TID 1842 in 4793 ms (progress: 1830/2086) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Starting task 5.0:1887 as TID 1887 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:00 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1842) | |
| 13/03/26 20:25:00 INFO cluster.TaskSetManager: Serialized task 5.0:1887 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1827 in 6641 ms (progress: 1831/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1888 as TID 1888 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1827) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1888 as 2400 bytes in 1 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1825 in 6785 ms (progress: 1832/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1889 as TID 1889 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1825) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1889 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1790 in 12023 ms (progress: 1833/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1890 as TID 1890 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1790) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1890 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1868 in 2632 ms (progress: 1834/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1891 as TID 1891 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1868) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1891 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1870 in 2622 ms (progress: 1835/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1892 as TID 1892 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1870) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1892 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1832 in 6055 ms (progress: 1836/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1893 as TID 1893 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1832) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1893 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1769 in 14388 ms (progress: 1837/2086) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1769) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1894 as TID 1894 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1894 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1845 in 4834 ms (progress: 1838/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1895 as TID 1895 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1895 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1845) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1872 in 2416 ms (progress: 1839/2086) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1872) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1896 as TID 1896 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1896 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1846 in 4939 ms (progress: 1840/2086) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1846) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1897 as TID 1897 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1897 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1822 in 7549 ms (progress: 1841/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1898 as TID 1898 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1822) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1898 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1874 in 2567 ms (progress: 1842/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1899 as TID 1899 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1874) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1899 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1829 in 7073 ms (progress: 1843/2086) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1829) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1900 as TID 1900 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1900 as 2400 bytes in 1 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1838 in 5915 ms (progress: 1844/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1901 as TID 1901 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1838) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1901 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1876 in 2365 ms (progress: 1845/2086) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1902 as TID 1902 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1902 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1876) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Finished TID 1835 in 6425 ms (progress: 1846/2086) | |
| 13/03/26 20:25:01 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1835) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Starting task 5.0:1903 as TID 1903 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:25:01 INFO cluster.TaskSetManager: Serialized task 5.0:1903 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1857 in 4602 ms (progress: 1847/2086) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1857) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1904 as TID 1904 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1904 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1855 in 5168 ms (progress: 1848/2086) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1855) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1905 as TID 1905 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1905 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1880 in 2495 ms (progress: 1849/2086) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1906 as TID 1906 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1880) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1906 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1820 in 8808 ms (progress: 1850/2086) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1907 as TID 1907 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1820) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1907 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1834 in 7136 ms (progress: 1851/2086) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1908 as TID 1908 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1834) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1908 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1841 in 6531 ms (progress: 1852/2086) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1909 as TID 1909 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1909 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1841) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1878 in 2817 ms (progress: 1853/2086) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1910 as TID 1910 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1878) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1910 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1850 in 5718 ms (progress: 1854/2086) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1911 as TID 1911 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1850) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1911 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1854 in 5480 ms (progress: 1855/2086) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1854) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1912 as TID 1912 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1912 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Finished TID 1847 in 6213 ms (progress: 1856/2086) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Starting task 5.0:1913 as TID 1913 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:02 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1847) | |
| 13/03/26 20:25:02 INFO cluster.TaskSetManager: Serialized task 5.0:1913 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Finished TID 1843 in 6878 ms (progress: 1857/2086) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Starting task 5.0:1914 as TID 1914 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Serialized task 5.0:1914 as 2386 bytes in 1 ms | |
| 13/03/26 20:25:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1843) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Finished TID 1864 in 4935 ms (progress: 1858/2086) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Starting task 5.0:1915 as TID 1915 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1864) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Serialized task 5.0:1915 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Finished TID 1837 in 7746 ms (progress: 1859/2086) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Starting task 5.0:1916 as TID 1916 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1837) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Serialized task 5.0:1916 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Finished TID 1882 in 3225 ms (progress: 1860/2086) | |
| 13/03/26 20:25:03 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1882) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Starting task 5.0:1917 as TID 1917 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:03 INFO cluster.TaskSetManager: Serialized task 5.0:1917 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Finished TID 1910 in 1640 ms (progress: 1861/2086) | |
| 13/03/26 20:25:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1910) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Starting task 5.0:1918 as TID 1918 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Serialized task 5.0:1918 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Finished TID 1884 in 3960 ms (progress: 1862/2086) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Starting task 5.0:1919 as TID 1919 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1884) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Serialized task 5.0:1919 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Finished TID 1826 in 10366 ms (progress: 1863/2086) | |
| 13/03/26 20:25:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1826) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Starting task 5.0:1920 as TID 1920 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Serialized task 5.0:1920 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Finished TID 1892 in 3483 ms (progress: 1864/2086) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Starting task 5.0:1921 as TID 1921 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1892) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Serialized task 5.0:1921 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Finished TID 1863 in 6558 ms (progress: 1865/2086) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Starting task 5.0:1922 as TID 1922 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1863) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Serialized task 5.0:1922 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Finished TID 1894 in 3489 ms (progress: 1866/2086) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Starting task 5.0:1923 as TID 1923 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1894) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Serialized task 5.0:1923 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Finished TID 1900 in 3183 ms (progress: 1867/2086) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Starting task 5.0:1924 as TID 1924 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:04 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1900) | |
| 13/03/26 20:25:04 INFO cluster.TaskSetManager: Serialized task 5.0:1924 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Finished TID 1836 in 9445 ms (progress: 1868/2086) | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Starting task 5.0:1925 as TID 1925 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1836) | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Serialized task 5.0:1925 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Finished TID 1886 in 5102 ms (progress: 1869/2086) | |
| 13/03/26 20:25:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1886) | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Starting task 5.0:1926 as TID 1926 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Serialized task 5.0:1926 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Finished TID 1747 in 21618 ms (progress: 1870/2086) | |
| 13/03/26 20:25:05 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1747) | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Starting task 5.0:1927 as TID 1927 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:05 INFO cluster.TaskSetManager: Serialized task 5.0:1927 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1896 in 4507 ms (progress: 1871/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1928 as TID 1928 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1928 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1896) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1757 in 20828 ms (progress: 1872/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1929 as TID 1929 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1757) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1929 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1906 in 3777 ms (progress: 1873/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1930 as TID 1930 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1906) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1930 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1859 in 8513 ms (progress: 1874/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1931 as TID 1931 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1859) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1931 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1905 in 3863 ms (progress: 1875/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1932 as TID 1932 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1905) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1932 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1849 in 9941 ms (progress: 1876/2086) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1849) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1933 as TID 1933 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1933 as 2395 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1912 in 4249 ms (progress: 1877/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1934 as TID 1934 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1912) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1934 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1890 in 5803 ms (progress: 1878/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1935 as TID 1935 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1890) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1935 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1911 in 4435 ms (progress: 1879/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1936 as TID 1936 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1911) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1936 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Finished TID 1865 in 8586 ms (progress: 1880/2086) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Starting task 5.0:1937 as TID 1937 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:06 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1865) | |
| 13/03/26 20:25:06 INFO cluster.TaskSetManager: Serialized task 5.0:1937 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1851 in 10181 ms (progress: 1881/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1938 as TID 1938 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1851) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1938 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1871 in 8353 ms (progress: 1882/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1939 as TID 1939 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1871) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1939 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1858 in 9859 ms (progress: 1883/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1940 as TID 1940 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1858) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1940 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1866 in 8972 ms (progress: 1884/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1941 as TID 1941 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1941 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1866) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1862 in 9537 ms (progress: 1885/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1942 as TID 1942 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1862) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1942 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1901 in 5894 ms (progress: 1886/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1943 as TID 1943 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1901) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1943 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1909 in 5244 ms (progress: 1887/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1944 as TID 1944 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1909) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1944 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1903 in 5787 ms (progress: 1888/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1945 as TID 1945 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1945 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1903) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Finished TID 1902 in 6035 ms (progress: 1889/2086) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Starting task 5.0:1946 as TID 1946 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:07 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1902) | |
| 13/03/26 20:25:07 INFO cluster.TaskSetManager: Serialized task 5.0:1946 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1908 in 5541 ms (progress: 1890/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1908) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1947 as TID 1947 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1947 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1853 in 11186 ms (progress: 1891/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1853) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1948 as TID 1948 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1948 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1873 in 9151 ms (progress: 1892/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1873) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1949 as TID 1949 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1949 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1875 in 8896 ms (progress: 1893/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1875) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1950 as TID 1950 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1950 as 2385 bytes in 1 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1934 in 1609 ms (progress: 1894/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1934) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1951 as TID 1951 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1951 as 2378 bytes in 1 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1898 in 6879 ms (progress: 1895/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1898) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1952 as TID 1952 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1952 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1918 in 4583 ms (progress: 1896/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1918) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1953 as TID 1953 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1953 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1904 in 6780 ms (progress: 1897/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1904) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1954 as TID 1954 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1954 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1913 in 6061 ms (progress: 1898/2086) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1955 as TID 1955 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1955 as 2378 bytes in 0 ms | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1913) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Finished TID 1879 in 9064 ms (progress: 1899/2086) | |
| 13/03/26 20:25:08 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1879) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Starting task 5.0:1956 as TID 1956 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:08 INFO cluster.TaskSetManager: Serialized task 5.0:1956 as 2378 bytes in 0 ms | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Finished TID 1930 in 3258 ms (progress: 1900/2086) | |
| 13/03/26 20:25:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1930) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Starting task 5.0:1957 as TID 1957 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Serialized task 5.0:1957 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Finished TID 1907 in 7006 ms (progress: 1901/2086) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Starting task 5.0:1958 as TID 1958 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1907) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Serialized task 5.0:1958 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Finished TID 1923 in 4718 ms (progress: 1902/2086) | |
| 13/03/26 20:25:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1923) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Starting task 5.0:1959 as TID 1959 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Serialized task 5.0:1959 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Finished TID 1954 in 748 ms (progress: 1903/2086) | |
| 13/03/26 20:25:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1954) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Starting task 5.0:1960 as TID 1960 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Serialized task 5.0:1960 as 2397 bytes in 1 ms | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Finished TID 1861 in 11788 ms (progress: 1904/2086) | |
| 13/03/26 20:25:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1861) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Starting task 5.0:1961 as TID 1961 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Serialized task 5.0:1961 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Finished TID 1924 in 4936 ms (progress: 1905/2086) | |
| 13/03/26 20:25:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1924) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Starting task 5.0:1962 as TID 1962 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Serialized task 5.0:1962 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Finished TID 1921 in 5161 ms (progress: 1906/2086) | |
| 13/03/26 20:25:09 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1921) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Starting task 5.0:1963 as TID 1963 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:09 INFO cluster.TaskSetManager: Serialized task 5.0:1963 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1932 in 3888 ms (progress: 1907/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1932) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1964 as TID 1964 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1964 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1929 in 4051 ms (progress: 1908/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1929) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1965 as TID 1965 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1965 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1881 in 10227 ms (progress: 1909/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1881) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1966 as TID 1966 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1966 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1919 in 6115 ms (progress: 1910/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1919) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1967 as TID 1967 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1967 as 2397 bytes in 1 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1893 in 9210 ms (progress: 1911/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1893) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1968 as TID 1968 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1968 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1759 in 24922 ms (progress: 1912/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1759) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1969 as TID 1969 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1969 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1869 in 12003 ms (progress: 1913/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1869) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1970 as TID 1970 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1970 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1867 in 12154 ms (progress: 1914/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1867) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1971 as TID 1971 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1971 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1938 in 3650 ms (progress: 1915/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1938) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1972 as TID 1972 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1972 as 2378 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1915 in 7565 ms (progress: 1916/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1915) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1973 as TID 1973 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1973 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1951 in 2387 ms (progress: 1917/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1951) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1974 as TID 1974 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1974 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1917 in 7410 ms (progress: 1918/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1917) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1975 as TID 1975 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1975 as 2397 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1914 in 7839 ms (progress: 1919/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1914) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1976 as TID 1976 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1976 as 2378 bytes in 0 ms | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Finished TID 1928 in 4932 ms (progress: 1920/2086) | |
| 13/03/26 20:25:10 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1928) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Starting task 5.0:1977 as TID 1977 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:10 INFO cluster.TaskSetManager: Serialized task 5.0:1977 as 2378 bytes in 0 ms | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Finished TID 1959 in 1906 ms (progress: 1921/2086) | |
| 13/03/26 20:25:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1959) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Starting task 5.0:1978 as TID 1978 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Serialized task 5.0:1978 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Finished TID 1956 in 2591 ms (progress: 1922/2086) | |
| 13/03/26 20:25:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1956) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Starting task 5.0:1979 as TID 1979 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Serialized task 5.0:1979 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Finished TID 1939 in 4255 ms (progress: 1923/2086) | |
| 13/03/26 20:25:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1939) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Starting task 5.0:1980 as TID 1980 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Serialized task 5.0:1980 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Finished TID 1916 in 8292 ms (progress: 1924/2086) | |
| 13/03/26 20:25:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1916) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Starting task 5.0:1981 as TID 1981 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Serialized task 5.0:1981 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Finished TID 1962 in 1986 ms (progress: 1925/2086) | |
| 13/03/26 20:25:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1962) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Starting task 5.0:1982 as TID 1982 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Serialized task 5.0:1982 as 2404 bytes in 1 ms | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Finished TID 1942 in 4406 ms (progress: 1926/2086) | |
| 13/03/26 20:25:11 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1942) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Starting task 5.0:1983 as TID 1983 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:11 INFO cluster.TaskSetManager: Serialized task 5.0:1983 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1955 in 3122 ms (progress: 1927/2086) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1955) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1984 as TID 1984 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1984 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1927 in 6222 ms (progress: 1928/2086) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1927) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1985 as TID 1985 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1985 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1941 in 4792 ms (progress: 1929/2086) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1941) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1986 as TID 1986 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1986 as 2371 bytes in 1 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1965 in 2228 ms (progress: 1930/2086) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1987 as TID 1987 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1965) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1987 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1946 in 4686 ms (progress: 1931/2086) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1946) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1988 as TID 1988 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1988 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1922 in 7905 ms (progress: 1932/2086) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1922) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1989 as TID 1989 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1989 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1950 in 4474 ms (progress: 1933/2086) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1950) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1990 as TID 1990 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1990 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Finished TID 1936 in 5992 ms (progress: 1934/2086) | |
| 13/03/26 20:25:12 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1936) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Starting task 5.0:1991 as TID 1991 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:12 INFO cluster.TaskSetManager: Serialized task 5.0:1991 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1889 in 11966 ms (progress: 1935/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1889) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1992 as TID 1992 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1992 as 2371 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1933 in 6401 ms (progress: 1936/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1933) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1993 as TID 1993 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1993 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1971 in 2529 ms (progress: 1937/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1971) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1994 as TID 1994 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1994 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1953 in 4556 ms (progress: 1938/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1953) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1995 as TID 1995 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1995 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1968 in 2835 ms (progress: 1939/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1968) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1996 as TID 1996 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1996 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1931 in 7124 ms (progress: 1940/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1931) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1997 as TID 1997 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1997 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1945 in 5779 ms (progress: 1941/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1945) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1998 as TID 1998 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1998 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1920 in 9072 ms (progress: 1942/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1920) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:1999 as TID 1999 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:1999 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1985 in 1602 ms (progress: 1943/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1985) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:2000 as TID 2000 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:2000 as 2372 bytes in 1 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1897 in 12255 ms (progress: 1944/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1897) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:2001 as TID 2001 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:2001 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1980 in 2166 ms (progress: 1945/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1980) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:2002 as TID 2002 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:2002 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1977 in 2909 ms (progress: 1946/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1977) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:2003 as TID 2003 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:2003 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1983 in 1956 ms (progress: 1947/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1983) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:2004 as TID 2004 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:2004 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Finished TID 1926 in 8257 ms (progress: 1948/2086) | |
| 13/03/26 20:25:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1926) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Starting task 5.0:2005 as TID 2005 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:13 INFO cluster.TaskSetManager: Serialized task 5.0:2005 as 2371 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1975 in 3144 ms (progress: 1949/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1975) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2006 as TID 2006 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2006 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1957 in 4624 ms (progress: 1950/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1957) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2007 as TID 2007 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2007 as 2370 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1984 in 2081 ms (progress: 1951/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1984) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2008 as TID 2008 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2008 as 2371 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1981 in 2609 ms (progress: 1952/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1981) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2009 as TID 2009 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2009 as 2372 bytes in 1 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1949 in 6090 ms (progress: 1953/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1949) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2010 as TID 2010 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2010 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1987 in 2131 ms (progress: 1954/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1987) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2011 as TID 2011 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2011 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1960 in 4955 ms (progress: 1955/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1960) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2012 as TID 2012 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2012 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1877 in 15109 ms (progress: 1956/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1877) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2013 as TID 2013 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2013 as 2399 bytes in 1 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1891 in 13486 ms (progress: 1957/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1891) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2014 as TID 2014 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2014 as 2400 bytes in 1 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1988 in 2104 ms (progress: 1958/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1988) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2015 as TID 2015 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2015 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1964 in 4790 ms (progress: 1959/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1964) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2016 as TID 2016 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2016 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Finished TID 1994 in 1704 ms (progress: 1960/2086) | |
| 13/03/26 20:25:14 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1994) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Starting task 5.0:2017 as TID 2017 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:14 INFO cluster.TaskSetManager: Serialized task 5.0:2017 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1976 in 4076 ms (progress: 1961/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1976) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2018 as TID 2018 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2018 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1944 in 7281 ms (progress: 1962/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1944) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2019 as TID 2019 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2019 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1899 in 13310 ms (progress: 1963/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1899) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2020 as TID 2020 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2020 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1990 in 2331 ms (progress: 1964/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1990) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2021 as TID 2021 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2021 as 2400 bytes in 1 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1970 in 4665 ms (progress: 1965/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1970) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2022 as TID 2022 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2022 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1943 in 7621 ms (progress: 1966/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1943) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2023 as TID 2023 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2023 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1937 in 8338 ms (progress: 1967/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1937) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2024 as TID 2024 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2024 as 2371 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1982 in 3538 ms (progress: 1968/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1982) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2025 as TID 2025 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2025 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1992 in 2367 ms (progress: 1969/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1992) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2026 as TID 2026 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2026 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1952 in 6907 ms (progress: 1970/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1952) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2027 as TID 2027 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2027 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1989 in 2793 ms (progress: 1971/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1989) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2028 as TID 2028 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2028 as 2399 bytes in 1 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1883 in 15292 ms (progress: 1972/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1883) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2029 as TID 2029 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2029 as 2372 bytes in 1 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1963 in 5700 ms (progress: 1973/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1963) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2030 as TID 2030 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2030 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1940 in 8169 ms (progress: 1974/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1940) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2031 as TID 2031 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2031 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1888 in 14623 ms (progress: 1975/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1888) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2032 as TID 2032 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2032 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1986 in 3438 ms (progress: 1976/2086) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1986) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2033 as TID 2033 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2033 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Finished TID 1887 in 14905 ms (progress: 1977/2086) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Starting task 5.0:2034 as TID 2034 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:15 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1887) | |
| 13/03/26 20:25:15 INFO cluster.TaskSetManager: Serialized task 5.0:2034 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1948 in 7993 ms (progress: 1978/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2035 as TID 2035 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2035 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1948) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1974 in 5352 ms (progress: 1979/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2036 as TID 2036 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1974) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2036 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1991 in 3321 ms (progress: 1980/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2037 as TID 2037 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1991) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2037 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1947 in 8285 ms (progress: 1981/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2038 as TID 2038 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1947) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2038 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1978 in 4913 ms (progress: 1982/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2039 as TID 2039 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1978) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2039 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1967 in 5963 ms (progress: 1983/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2040 as TID 2040 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1967) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2040 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1979 in 5083 ms (progress: 1984/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2041 as TID 2041 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2041 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1979) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1966 in 6337 ms (progress: 1985/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2042 as TID 2042 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1966) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2042 as 2373 bytes in 0 ms | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Finished TID 1925 in 11789 ms (progress: 1986/2086) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Starting task 5.0:2043 as TID 2043 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:16 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1925) | |
| 13/03/26 20:25:16 INFO cluster.TaskSetManager: Serialized task 5.0:2043 as 2372 bytes in 1 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2027 in 1603 ms (progress: 1987/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2044 as TID 2044 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2027) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2044 as 2400 bytes in 1 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2018 in 2009 ms (progress: 1988/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2045 as TID 2045 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2018) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2045 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2024 in 1814 ms (progress: 1989/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2046 as TID 2046 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2024) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2046 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 1995 in 3910 ms (progress: 1990/2086) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1995) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2047 as TID 2047 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2047 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 1972 in 6601 ms (progress: 1991/2086) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1972) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2048 as TID 2048 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2048 as 2400 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2042 in 710 ms (progress: 1992/2086) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2042) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2049 as TID 2049 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2049 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2043 in 480 ms (progress: 1993/2086) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2043) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2050 as TID 2050 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2050 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2000 in 3644 ms (progress: 1994/2086) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2000) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2051 as TID 2051 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2051 as 2386 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2009 in 3381 ms (progress: 1995/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2052 as TID 2052 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2009) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2052 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 1993 in 4655 ms (progress: 1996/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2053 as TID 2053 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1993) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2053 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2003 in 3877 ms (progress: 1997/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2054 as TID 2054 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2003) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2054 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2033 in 2102 ms (progress: 1998/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2055 as TID 2055 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2033) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2055 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 1973 in 7120 ms (progress: 1999/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2056 as TID 2056 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1973) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2056 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Finished TID 2007 in 3858 ms (progress: 2000/2086) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Starting task 5.0:2057 as TID 2057 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:17 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2007) | |
| 13/03/26 20:25:17 INFO cluster.TaskSetManager: Serialized task 5.0:2057 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Finished TID 2008 in 3958 ms (progress: 2001/2086) | |
| 13/03/26 20:25:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2008) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Starting task 5.0:2058 as TID 2058 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Serialized task 5.0:2058 as 2371 bytes in 1 ms | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Finished TID 2032 in 2760 ms (progress: 2002/2086) | |
| 13/03/26 20:25:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2032) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Starting task 5.0:2059 as TID 2059 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Serialized task 5.0:2059 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Finished TID 2039 in 2116 ms (progress: 2003/2086) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Starting task 5.0:2060 as TID 2060 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2039) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Serialized task 5.0:2060 as 2373 bytes in 1 ms | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Finished TID 2023 in 3425 ms (progress: 2004/2086) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Starting task 5.0:2061 as TID 2061 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:18 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2023) | |
| 13/03/26 20:25:18 INFO cluster.TaskSetManager: Serialized task 5.0:2061 as 2384 bytes in 1 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2045 in 1978 ms (progress: 2005/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2062 as TID 2062 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2045) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2062 as 2384 bytes in 1 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2005 in 5155 ms (progress: 2006/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2063 as TID 2063 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2005) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2063 as 2384 bytes in 1 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2037 in 3058 ms (progress: 2007/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2064 as TID 2064 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2037) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2064 as 2371 bytes in 1 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 1961 in 9786 ms (progress: 2008/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2065 as TID 2065 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2065 as 2372 bytes in 0 ms | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1961) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2029 in 3909 ms (progress: 2009/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2066 as TID 2066 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2029) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2066 as 2371 bytes in 0 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2040 in 3168 ms (progress: 2010/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2067 as TID 2067 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2040) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2067 as 2399 bytes in 0 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2036 in 3378 ms (progress: 2011/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2068 as TID 2068 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2036) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2068 as 2370 bytes in 0 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 1958 in 10195 ms (progress: 2012/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2069 as TID 2069 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2069 as 2398 bytes in 0 ms | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1958) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2065 in 327 ms (progress: 2013/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2070 as TID 2070 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2065) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2070 as 2395 bytes in 4 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2022 in 4464 ms (progress: 2014/2086) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2022) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2071 as TID 2071 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2071 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2066 in 410 ms (progress: 2015/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2072 as TID 2072 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2066) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2072 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Finished TID 2011 in 5437 ms (progress: 2016/2086) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Starting task 5.0:2073 as TID 2073 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:19 INFO cluster.TaskSetManager: Serialized task 5.0:2073 as 2384 bytes in 1 ms | |
| 13/03/26 20:25:19 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2011) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2068 in 449 ms (progress: 2017/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2074 as TID 2074 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2068) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2074 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2031 in 4599 ms (progress: 2018/2086) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2031) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2075 as TID 2075 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2075 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2038 in 4015 ms (progress: 2019/2086) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2038) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2076 as TID 2076 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2076 as 2384 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2025 in 4944 ms (progress: 2020/2086) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2025) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2077 as TID 2077 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2077 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2044 in 3358 ms (progress: 2021/2086) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2044) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2078 as TID 2078 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2078 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2010 in 6087 ms (progress: 2022/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2079 as TID 2079 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2010) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2079 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2060 in 2081 ms (progress: 2023/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2080 as TID 2080 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2060) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2080 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2058 in 2528 ms (progress: 2024/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2081 as TID 2081 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2058) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2081 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 1969 in 10056 ms (progress: 2025/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2082 as TID 2082 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1969) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2082 as 2385 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2057 in 2913 ms (progress: 2026/2086) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2057) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2083 as TID 2083 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2083 as 2371 bytes in 1 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2064 in 1586 ms (progress: 2027/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2084 as TID 2084 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2084 as 2371 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2064) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2026 in 5574 ms (progress: 2028/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 5.0:2085 as TID 2085 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2026) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 5.0:2085 as 2369 bytes in 0 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2051 in 3545 ms (progress: 2029/2086) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Starting task 6.0:0 as TID 2086 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:20 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2051) | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Serialized task 6.0:0 as 3113 bytes in 20 ms | |
| 13/03/26 20:25:20 INFO cluster.TaskSetManager: Finished TID 2070 in 1285 ms (progress: 2030/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2070) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:1 as TID 2087 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:1 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2020 in 5951 ms (progress: 2031/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2020) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:2 as TID 2088 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:2 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2047 in 3799 ms (progress: 2032/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2047) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:3 as TID 2089 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:3 as 3113 bytes in 1 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2001 in 7280 ms (progress: 2033/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2001) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:4 as TID 2090 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:4 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2034 in 5206 ms (progress: 2034/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2034) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:5 as TID 2091 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:5 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 1996 in 7820 ms (progress: 2035/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1996) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:6 as TID 2092 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:6 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 1935 in 14414 ms (progress: 2036/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1935) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:7 as TID 2093 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:7 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2059 in 3094 ms (progress: 2037/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2059) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:8 as TID 2094 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:8 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2041 in 4972 ms (progress: 2038/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2041) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:9 as TID 2095 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:9 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2017 in 6706 ms (progress: 2039/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2017) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:10 as TID 2096 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:10 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2073 in 1925 ms (progress: 2040/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2073) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:11 as TID 2097 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:11 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2054 in 4215 ms (progress: 2041/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2054) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:12 as TID 2098 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:12 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Finished TID 2055 in 4168 ms (progress: 2042/2086) | |
| 13/03/26 20:25:21 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2055) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Starting task 6.0:13 as TID 2099 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:21 INFO cluster.TaskSetManager: Serialized task 6.0:13 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Finished TID 2016 in 7125 ms (progress: 2043/2086) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Starting task 6.0:14 as TID 2100 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2016) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Serialized task 6.0:14 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Finished TID 2015 in 7776 ms (progress: 2044/2086) | |
| 13/03/26 20:25:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2015) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Starting task 6.0:15 as TID 2101 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Serialized task 6.0:15 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Finished TID 2014 in 7816 ms (progress: 2045/2086) | |
| 13/03/26 20:25:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2014) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Starting task 6.0:16 as TID 2102 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Serialized task 6.0:16 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Finished TID 2019 in 7747 ms (progress: 2046/2086) | |
| 13/03/26 20:25:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2019) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Starting task 6.0:17 as TID 2103 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Serialized task 6.0:17 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Finished TID 1885 in 22500 ms (progress: 2047/2086) | |
| 13/03/26 20:25:22 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1885) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Starting task 6.0:18 as TID 2104 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:22 INFO cluster.TaskSetManager: Serialized task 6.0:18 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2083 in 2195 ms (progress: 2048/2086) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2083) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:19 as TID 2105 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:19 as 3113 bytes in 1 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2049 in 6116 ms (progress: 2049/2086) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2049) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:20 as TID 2106 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:20 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 1999 in 9791 ms (progress: 2050/2086) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:21 as TID 2107 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1999) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:21 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2084 in 2713 ms (progress: 2051/2086) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2084) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:22 as TID 2108 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:22 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2012 in 9242 ms (progress: 2052/2086) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2012) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:23 as TID 2109 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:23 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2030 in 8242 ms (progress: 2053/2086) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:24 as TID 2110 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2030) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:24 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2063 in 4806 ms (progress: 2054/2086) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:25 as TID 2111 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2063) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:25 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2006 in 9904 ms (progress: 2055/2086) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:26 as TID 2112 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2006) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:26 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Finished TID 2004 in 10081 ms (progress: 2056/2086) | |
| 13/03/26 20:25:23 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2004) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Starting task 6.0:27 as TID 2113 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:23 INFO cluster.TaskSetManager: Serialized task 6.0:27 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2035 in 7903 ms (progress: 2057/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2035) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:28 as TID 2114 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:28 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2071 in 4445 ms (progress: 2058/2086) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:29 as TID 2115 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2071) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:29 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2085 in 3257 ms (progress: 2059/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2085) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:30 as TID 2116 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:30 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2002 in 10489 ms (progress: 2060/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2002) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:31 as TID 2117 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:31 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2067 in 4906 ms (progress: 2061/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2067) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:32 as TID 2118 on executor 16: ip-10-98-82-214.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:32 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2053 in 6841 ms (progress: 2062/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2053) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:33 as TID 2119 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:33 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2079 in 4181 ms (progress: 2063/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2079) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:34 as TID 2120 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:34 as 3113 bytes in 1 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2061 in 6013 ms (progress: 2064/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2061) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:35 as TID 2121 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:35 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Finished TID 2076 in 4499 ms (progress: 2065/2086) | |
| 13/03/26 20:25:24 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2076) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Starting task 6.0:36 as TID 2122 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:24 INFO cluster.TaskSetManager: Serialized task 6.0:36 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Finished TID 2056 in 7164 ms (progress: 2066/2086) | |
| 13/03/26 20:25:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2056) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Starting task 6.0:37 as TID 2123 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Serialized task 6.0:37 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Finished TID 2072 in 5379 ms (progress: 2067/2086) | |
| 13/03/26 20:25:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2072) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Starting task 6.0:38 as TID 2124 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Serialized task 6.0:38 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Finished TID 2080 in 4768 ms (progress: 2068/2086) | |
| 13/03/26 20:25:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2080) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Starting task 6.0:39 as TID 2125 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Serialized task 6.0:39 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Finished TID 2074 in 5458 ms (progress: 2069/2086) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Starting task 6.0:40 as TID 2126 on executor 3: ip-10-118-97-63.ec2.internal (preferred) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Serialized task 6.0:40 as 3113 bytes in 1 ms | |
| 13/03/26 20:25:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2074) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Finished TID 2087 in 4657 ms (progress: 1/40065) | |
| 13/03/26 20:25:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 1) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Starting task 6.0:41 as TID 2127 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Serialized task 6.0:41 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Finished TID 2052 in 8115 ms (progress: 2070/2086) | |
| 13/03/26 20:25:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2052) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Starting task 6.0:42 as TID 2128 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Serialized task 6.0:42 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Finished TID 2046 in 8818 ms (progress: 2071/2086) | |
| 13/03/26 20:25:25 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2046) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Starting task 6.0:43 as TID 2129 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:25 INFO cluster.TaskSetManager: Serialized task 6.0:43 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2021 in 10873 ms (progress: 2072/2086) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2021) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:44 as TID 2130 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:44 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2095 in 4623 ms (progress: 2/40065) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 9) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:45 as TID 2131 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:45 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2089 in 5232 ms (progress: 3/40065) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 3) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:46 as TID 2132 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:46 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2062 in 7334 ms (progress: 2073/2086) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2062) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:47 as TID 2133 on executor 6: ip-10-83-61-103.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:47 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2091 in 5326 ms (progress: 4/40065) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 5) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:48 as TID 2134 on executor 26: ip-10-12-77-64.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:48 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2078 in 6089 ms (progress: 2074/2086) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2078) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:49 as TID 2135 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:49 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2077 in 6189 ms (progress: 2075/2086) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2077) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:50 as TID 2136 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:50 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2081 in 5960 ms (progress: 2076/2086) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2081) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:51 as TID 2137 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:51 as 3113 bytes in 1 ms | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Finished TID 2088 in 5878 ms (progress: 5/40065) | |
| 13/03/26 20:25:26 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 2) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Starting task 6.0:52 as TID 2138 on executor 28: ip-10-32-69-77.ec2.internal (preferred) | |
| 13/03/26 20:25:26 INFO cluster.TaskSetManager: Serialized task 6.0:52 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2082 in 6536 ms (progress: 2077/2086) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2082) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:53 as TID 2139 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:53 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2096 in 5541 ms (progress: 6/40065) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 10) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:54 as TID 2140 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:54 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2069 in 7608 ms (progress: 2078/2086) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2069) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:55 as TID 2141 on executor 8: ip-10-60-57-114.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:55 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2099 in 5359 ms (progress: 7/40065) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 13) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:56 as TID 2142 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:56 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2105 in 4333 ms (progress: 8/40065) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 19) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:57 as TID 2143 on executor 7: ip-10-212-66-3.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:57 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2092 in 6349 ms (progress: 9/40065) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 6) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:58 as TID 2144 on executor 18: ip-10-77-59-181.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:58 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2086 in 6684 ms (progress: 10/40065) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 0) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:59 as TID 2145 on executor 19: ip-10-101-3-102.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:59 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2093 in 6424 ms (progress: 11/40065) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 7) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:60 as TID 2146 on executor 11: ip-10-82-243-247.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:60 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2075 in 7569 ms (progress: 2079/2086) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2075) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:61 as TID 2147 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:61 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2048 in 10535 ms (progress: 2080/2086) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2048) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:62 as TID 2148 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:62 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Finished TID 2100 in 5855 ms (progress: 12/40065) | |
| 13/03/26 20:25:27 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 14) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Starting task 6.0:63 as TID 2149 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:27 INFO cluster.TaskSetManager: Serialized task 6.0:63 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Finished TID 2090 in 7057 ms (progress: 13/40065) | |
| 13/03/26 20:25:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 4) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Starting task 6.0:64 as TID 2150 on executor 23: ip-10-98-131-10.ec2.internal (preferred) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Serialized task 6.0:64 as 3113 bytes in 1 ms | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Finished TID 1997 in 15201 ms (progress: 2081/2086) | |
| 13/03/26 20:25:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 1997) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Starting task 6.0:65 as TID 2151 on executor 13: ip-10-78-193-188.ec2.internal (preferred) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Serialized task 6.0:65 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Finished TID 2114 in 4690 ms (progress: 14/40065) | |
| 13/03/26 20:25:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 28) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Starting task 6.0:66 as TID 2152 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Serialized task 6.0:66 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Finished TID 2104 in 5936 ms (progress: 15/40065) | |
| 13/03/26 20:25:28 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 18) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Starting task 6.0:67 as TID 2153 on executor 24: ip-10-202-7-40.ec2.internal (preferred) | |
| 13/03/26 20:25:28 INFO cluster.TaskSetManager: Serialized task 6.0:67 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2097 in 7167 ms (progress: 16/40065) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 11) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:68 as TID 2154 on executor 17: ip-10-118-138-26.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:68 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2102 in 6528 ms (progress: 17/40065) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:69 as TID 2155 on executor 4: ip-10-116-191-1.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 16) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:69 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2103 in 6323 ms (progress: 18/40065) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 17) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:70 as TID 2156 on executor 0: ip-10-98-95-218.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:70 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2094 in 7638 ms (progress: 19/40065) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:71 as TID 2157 on executor 5: ip-10-101-58-116.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 8) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:71 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2028 in 13789 ms (progress: 2082/2086) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:72 as TID 2158 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2028) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:72 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2107 in 5976 ms (progress: 20/40065) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 21) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:73 as TID 2159 on executor 21: ip-10-80-14-64.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:73 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2115 in 5422 ms (progress: 21/40065) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 29) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:74 as TID 2160 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:74 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2113 in 5651 ms (progress: 22/40065) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:75 as TID 2161 on executor 2: ip-10-40-187-172.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:75 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 27) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2117 in 5345 ms (progress: 23/40065) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:76 as TID 2162 on executor 14: ip-10-62-87-64.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:76 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 31) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2050 in 12423 ms (progress: 2083/2086) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(5, 2050) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:77 as TID 2163 on executor 25: ip-10-101-38-191.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:77 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Finished TID 2098 in 7911 ms (progress: 24/40065) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Starting task 6.0:78 as TID 2164 on executor 27: ip-10-80-189-211.ec2.internal (preferred) | |
| 13/03/26 20:25:29 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 12) | |
| 13/03/26 20:25:29 INFO cluster.TaskSetManager: Serialized task 6.0:78 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Finished TID 2109 in 6254 ms (progress: 25/40065) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Starting task 6.0:79 as TID 2165 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 23) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Serialized task 6.0:79 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Finished TID 2127 in 4543 ms (progress: 26/40065) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Starting task 6.0:80 as TID 2166 on executor 15: ip-10-10-43-140.ec2.internal (preferred) | |
| 13/03/26 20:25:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 41) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Serialized task 6.0:80 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Finished TID 2101 in 7874 ms (progress: 27/40065) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Starting task 6.0:81 as TID 2167 on executor 9: ip-10-35-90-71.ec2.internal (preferred) | |
| 13/03/26 20:25:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 15) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Serialized task 6.0:81 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Finished TID 2106 in 7230 ms (progress: 28/40065) | |
| 13/03/26 20:25:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 20) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Starting task 6.0:82 as TID 2168 on executor 1: ip-10-83-74-179.ec2.internal (preferred) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Serialized task 6.0:82 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Finished TID 2111 in 7027 ms (progress: 29/40065) | |
| 13/03/26 20:25:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 25) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Starting task 6.0:83 as TID 2169 on executor 12: ip-10-116-222-45.ec2.internal (preferred) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Serialized task 6.0:83 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Finished TID 2122 in 6115 ms (progress: 30/40065) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Starting task 6.0:84 as TID 2170 on executor 22: ip-10-40-29-13.ec2.internal (preferred) | |
| 13/03/26 20:25:30 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 36) | |
| 13/03/26 20:25:30 INFO cluster.TaskSetManager: Serialized task 6.0:84 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:31 INFO cluster.TaskSetManager: Finished TID 2112 in 7119 ms (progress: 31/40065) | |
| 13/03/26 20:25:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 26) | |
| 13/03/26 20:25:31 INFO cluster.TaskSetManager: Starting task 6.0:85 as TID 2171 on executor 10: ip-10-32-83-193.ec2.internal (preferred) | |
| 13/03/26 20:25:31 INFO cluster.TaskSetManager: Serialized task 6.0:85 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:31 INFO cluster.TaskSetManager: Finished TID 2125 in 5766 ms (progress: 32/40065) | |
| 13/03/26 20:25:31 INFO cluster.TaskSetManager: Starting task 6.0:86 as TID 2172 on executor 20: ip-10-204-151-227.ec2.internal (preferred) | |
| 13/03/26 20:25:31 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(6, 39) | |
| 13/03/26 20:25:31 INFO cluster.TaskSetManager: Serialized task 6.0:86 as 3113 bytes in 0 ms | |
| 13/03/26 20:25:31 INFO cluster.TaskSetManager: Finished TID 2118 in 6665 ms (progress: |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment