Last active
August 29, 2015 14:22
-
-
Save AKB428/5ddcde92197584bc3456 to your computer and use it in GitHub Desktop.
9,920,199 行のTwitterテキストデータをSparkCoreで解析し単語をカウントしたログ Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz 24-Core:VPS
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [mnt]# wc -l ./data/20150405_182615.cl.txt | |
| 9920199 ./data/20150405_182615.cl.txt | |
| sbt | |
| run ../../data/20150405_182615.cl.txt ./dictionary/anime_2015_2Q.txt 100 | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/kill,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/static,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/json,null} | |
| 15/06/02 16:21:01 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs,null} | |
| 15/06/02 16:21:01 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041. | |
| 15/06/02 16:21:01 INFO Server: jetty-8.y.z-SNAPSHOT | |
| 15/06/02 16:21:01 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4041 | |
| 15/06/02 16:21:01 INFO Utils: Successfully started service 'SparkUI' on port 4041. | |
| 15/06/02 16:21:01 INFO SparkUI: Started SparkUI at http://vXXXXa002.g.tyo1.static.conoha.io:4041 | |
| 15/06/02 16:21:01 INFO Executor: Starting executor ID <driver> on host localhost | |
| 15/06/02 16:21:01 INFO AkkaUtils: Connecting to HeartbeatReceiver: akka.tcp://sparkDriveXXXXX.a002.g.tyo1.static.conoha.io:58839/user/HeartbeatReceiver | |
| 15/06/02 16:21:01 INFO NettyBlockTransferService: Server created on 49196 | |
| 15/06/02 16:21:01 INFO BlockManagerMaster: Trying to register BlockManager | |
| 15/06/02 16:21:01 INFO BlockManagerMasterActor: Registering block manager localhost:49196 with 530.0 MB RAM, BlockManagerId(<driver>, localhost, 49196) | |
| 15/06/02 16:21:01 INFO BlockManagerMaster: Registered BlockManager | |
| 15/06/02 16:21:02 INFO MemoryStore: ensureFreeSpace(133168) called with curMem=0, maxMem=555755765 | |
| 15/06/02 16:21:02 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 130.0 KB, free 529.9 MB) | |
| 15/06/02 16:21:02 INFO MemoryStore: ensureFreeSpace(18512) called with curMem=133168, maxMem=555755765 | |
| 15/06/02 16:21:02 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 18.1 KB, free 529.9 MB) | |
| 15/06/02 16:21:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:49196 (size: 18.1 KB, free: 530.0 MB) | |
| 15/06/02 16:21:02 INFO BlockManagerMaster: Updated info of block broadcast_0_piece0 | |
| 15/06/02 16:21:02 INFO SparkContext: Created broadcast 0 from textFile at inazumaTwitter.scala:16 | |
| 15/06/02 16:21:02 INFO FileInputFormat: Total input paths to process : 1 | |
| 15/06/02 16:21:02 INFO SparkContext: Starting job: sortBy at inazumaTwitter.scala:73 | |
| 15/06/02 16:21:02 INFO DAGScheduler: Registering RDD 3 (map at inazumaTwitter.scala:73) | |
| 15/06/02 16:21:02 INFO DAGScheduler: Got job 0 (sortBy at inazumaTwitter.scala:73) with 40 output partitions (allowLocal=false) | |
| 15/06/02 16:21:02 INFO DAGScheduler: Final stage: Stage 1(sortBy at inazumaTwitter.scala:73) | |
| 15/06/02 16:21:02 INFO DAGScheduler: Parents of final stage: List(Stage 0) | |
| 15/06/02 16:21:02 INFO DAGScheduler: Missing parents: List(Stage 0) | |
| 15/06/02 16:21:02 INFO DAGScheduler: Submitting Stage 0 (MapPartitionsRDD[3] at map at inazumaTwitter.scala:73), which has no missing parents | |
| 15/06/02 16:21:02 INFO MemoryStore: ensureFreeSpace(3656) called with curMem=151680, maxMem=555755765 | |
| 15/06/02 16:21:02 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.6 KB, free 529.9 MB) | |
| 15/06/02 16:21:02 INFO MemoryStore: ensureFreeSpace(2698) called with curMem=155336, maxMem=555755765 | |
| 15/06/02 16:21:02 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.6 KB, free 529.9 MB) | |
| 15/06/02 16:21:02 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:49196 (size: 2.6 KB, free: 530.0 MB) | |
| 15/06/02 16:21:02 INFO BlockManagerMaster: Updated info of block broadcast_1_piece0 | |
| 15/06/02 16:21:02 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:839 | |
| 15/06/02 16:21:02 INFO DAGScheduler: Submitting 40 missing tasks from Stage 0 (MapPartitionsRDD[3] at map at inazumaTwitter.scala:73) | |
| 15/06/02 16:21:02 INFO TaskSchedulerImpl: Adding task set 0.0 with 40 tasks | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 10.0 in stage 0.0 (TID 10, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 11.0 in stage 0.0 (TID 11, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 13.0 in stage 0.0 (TID 13, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 14.0 in stage 0.0 (TID 14, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 15.0 in stage 0.0 (TID 15, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 16.0 in stage 0.0 (TID 16, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 17.0 in stage 0.0 (TID 17, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 18.0 in stage 0.0 (TID 18, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 19.0 in stage 0.0 (TID 19, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 20.0 in stage 0.0 (TID 20, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 21.0 in stage 0.0 (TID 21, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 22.0 in stage 0.0 (TID 22, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO TaskSetManager: Starting task 23.0 in stage 0.0 (TID 23, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:21:02 INFO Executor: Running task 1.0 in stage 0.0 (TID 1) | |
| 15/06/02 16:21:02 INFO Executor: Running task 2.0 in stage 0.0 (TID 2) | |
| 15/06/02 16:21:02 INFO Executor: Running task 0.0 in stage 0.0 (TID 0) | |
| 15/06/02 16:21:02 INFO Executor: Running task 3.0 in stage 0.0 (TID 3) | |
| 15/06/02 16:21:02 INFO Executor: Running task 4.0 in stage 0.0 (TID 4) | |
| 15/06/02 16:21:02 INFO Executor: Running task 6.0 in stage 0.0 (TID 6) | |
| 15/06/02 16:21:02 INFO Executor: Running task 7.0 in stage 0.0 (TID 7) | |
| 15/06/02 16:21:02 INFO Executor: Running task 8.0 in stage 0.0 (TID 8) | |
| 15/06/02 16:21:02 INFO Executor: Running task 9.0 in stage 0.0 (TID 9) | |
| 15/06/02 16:21:02 INFO Executor: Running task 5.0 in stage 0.0 (TID 5) | |
| 15/06/02 16:21:02 INFO Executor: Running task 10.0 in stage 0.0 (TID 10) | |
| 15/06/02 16:21:02 INFO Executor: Running task 11.0 in stage 0.0 (TID 11) | |
| 15/06/02 16:21:02 INFO Executor: Running task 12.0 in stage 0.0 (TID 12) | |
| 15/06/02 16:21:02 INFO Executor: Running task 13.0 in stage 0.0 (TID 13) | |
| 15/06/02 16:21:02 INFO Executor: Running task 14.0 in stage 0.0 (TID 14) | |
| 15/06/02 16:21:02 INFO Executor: Running task 15.0 in stage 0.0 (TID 15) | |
| 15/06/02 16:21:02 INFO Executor: Running task 16.0 in stage 0.0 (TID 16) | |
| 15/06/02 16:21:02 INFO Executor: Running task 17.0 in stage 0.0 (TID 17) | |
| 15/06/02 16:21:02 INFO Executor: Running task 18.0 in stage 0.0 (TID 18) | |
| 15/06/02 16:21:02 INFO Executor: Running task 19.0 in stage 0.0 (TID 19) | |
| 15/06/02 16:21:02 INFO Executor: Running task 20.0 in stage 0.0 (TID 20) | |
| 15/06/02 16:21:02 INFO Executor: Running task 21.0 in stage 0.0 (TID 21) | |
| 15/06/02 16:21:02 INFO Executor: Running task 22.0 in stage 0.0 (TID 22) | |
| 15/06/02 16:21:02 INFO Executor: Running task 23.0 in stage 0.0 (TID 23) | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:536870912+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:436207616+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:335544320+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:67108864+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:33554432+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:100663296+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:134217728+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:167772160+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:704643072+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:268435456+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:771751936+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:0+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:234881024+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:503316480+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:570425344+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:603979776+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:301989888+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:369098752+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:738197504+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:671088640+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:637534208+33554432 | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:402653184+33554432 | |
| 15/06/02 16:21:02 INFO deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id | |
| 15/06/02 16:21:02 INFO deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap | |
| 15/06/02 16:21:02 INFO deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:469762048+33554432 | |
| 15/06/02 16:21:02 INFO deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition | |
| 15/06/02 16:21:02 INFO deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id | |
| 15/06/02 16:21:02 INFO deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap | |
| 15/06/02 16:21:02 INFO deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id | |
| 15/06/02 16:21:02 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:201326592+33554432 | |
| 15/06/02 16:21:02 INFO deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id | |
| 15/06/02 16:21:02 INFO deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap | |
| 15/06/02 16:24:28 INFO Executor: Finished task 14.0 in stage 0.0 (TID 14). 2042 bytes result sent to driver | |
| 15/06/02 16:24:28 INFO TaskSetManager: Starting task 24.0 in stage 0.0 (TID 24, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:28 INFO Executor: Running task 24.0 in stage 0.0 (TID 24) | |
| 15/06/02 16:24:28 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:805306368+33554432 | |
| 15/06/02 16:24:28 INFO TaskSetManager: Finished task 14.0 in stage 0.0 (TID 14) in 206422 ms on localhost (1/40) | |
| 15/06/02 16:24:39 INFO Executor: Finished task 3.0 in stage 0.0 (TID 3). 2042 bytes result sent to driver | |
| 15/06/02 16:24:39 INFO TaskSetManager: Starting task 25.0 in stage 0.0 (TID 25, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:39 INFO Executor: Running task 25.0 in stage 0.0 (TID 25) | |
| 15/06/02 16:24:39 INFO TaskSetManager: Finished task 3.0 in stage 0.0 (TID 3) in 216841 ms on localhost (2/40) | |
| 15/06/02 16:24:39 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:838860800+33554432 | |
| 15/06/02 16:24:43 INFO Executor: Finished task 13.0 in stage 0.0 (TID 13). 2042 bytes result sent to driver | |
| 15/06/02 16:24:43 INFO TaskSetManager: Starting task 26.0 in stage 0.0 (TID 26, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:43 INFO TaskSetManager: Finished task 13.0 in stage 0.0 (TID 13) in 220651 ms on localhost (3/40) | |
| 15/06/02 16:24:43 INFO Executor: Running task 26.0 in stage 0.0 (TID 26) | |
| 15/06/02 16:24:43 INFO Executor: Finished task 8.0 in stage 0.0 (TID 8). 2042 bytes result sent to driver | |
| 15/06/02 16:24:43 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:872415232+33554432 | |
| 15/06/02 16:24:43 INFO TaskSetManager: Starting task 27.0 in stage 0.0 (TID 27, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:43 INFO TaskSetManager: Finished task 8.0 in stage 0.0 (TID 8) in 220660 ms on localhost (4/40) | |
| 15/06/02 16:24:43 INFO Executor: Running task 27.0 in stage 0.0 (TID 27) | |
| 15/06/02 16:24:43 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:905969664+33554432 | |
| 15/06/02 16:24:46 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 2042 bytes result sent to driver | |
| 15/06/02 16:24:46 INFO TaskSetManager: Starting task 28.0 in stage 0.0 (TID 28, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:46 INFO Executor: Running task 28.0 in stage 0.0 (TID 28) | |
| 15/06/02 16:24:46 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 223761 ms on localhost (5/40) | |
| 15/06/02 16:24:46 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:939524096+33554432 | |
| 15/06/02 16:24:47 INFO Executor: Finished task 20.0 in stage 0.0 (TID 20). 2042 bytes result sent to driver | |
| 15/06/02 16:24:47 INFO TaskSetManager: Starting task 29.0 in stage 0.0 (TID 29, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:47 INFO Executor: Running task 29.0 in stage 0.0 (TID 29) | |
| 15/06/02 16:24:47 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:973078528+33554432 | |
| 15/06/02 16:24:47 INFO TaskSetManager: Finished task 20.0 in stage 0.0 (TID 20) in 224778 ms on localhost (6/40) | |
| 15/06/02 16:24:48 INFO Executor: Finished task 17.0 in stage 0.0 (TID 17). 2042 bytes result sent to driver | |
| 15/06/02 16:24:48 INFO TaskSetManager: Starting task 30.0 in stage 0.0 (TID 30, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:48 INFO Executor: Running task 30.0 in stage 0.0 (TID 30) | |
| 15/06/02 16:24:48 INFO TaskSetManager: Finished task 17.0 in stage 0.0 (TID 17) in 225668 ms on localhost (7/40) | |
| 15/06/02 16:24:48 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1006632960+33554432 | |
| 15/06/02 16:24:51 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 2042 bytes result sent to driver | |
| 15/06/02 16:24:51 INFO TaskSetManager: Starting task 31.0 in stage 0.0 (TID 31, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:51 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 228600 ms on localhost (8/40) | |
| 15/06/02 16:24:51 INFO Executor: Running task 31.0 in stage 0.0 (TID 31) | |
| 15/06/02 16:24:51 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1040187392+33554432 | |
| 15/06/02 16:24:55 INFO Executor: Finished task 2.0 in stage 0.0 (TID 2). 2042 bytes result sent to driver | |
| 15/06/02 16:24:55 INFO TaskSetManager: Starting task 32.0 in stage 0.0 (TID 32, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:55 INFO Executor: Running task 32.0 in stage 0.0 (TID 32) | |
| 15/06/02 16:24:55 INFO TaskSetManager: Finished task 2.0 in stage 0.0 (TID 2) in 233417 ms on localhost (9/40) | |
| 15/06/02 16:24:55 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1073741824+33554432 | |
| 15/06/02 16:24:57 INFO Executor: Finished task 9.0 in stage 0.0 (TID 9). 2042 bytes result sent to driver | |
| 15/06/02 16:24:57 INFO TaskSetManager: Starting task 33.0 in stage 0.0 (TID 33, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:57 INFO Executor: Running task 33.0 in stage 0.0 (TID 33) | |
| 15/06/02 16:24:57 INFO TaskSetManager: Finished task 9.0 in stage 0.0 (TID 9) in 234541 ms on localhost (10/40) | |
| 15/06/02 16:24:57 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1107296256+33554432 | |
| 15/06/02 16:24:58 INFO Executor: Finished task 18.0 in stage 0.0 (TID 18). 2042 bytes result sent to driver | |
| 15/06/02 16:24:58 INFO TaskSetManager: Starting task 34.0 in stage 0.0 (TID 34, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:58 INFO Executor: Running task 34.0 in stage 0.0 (TID 34) | |
| 15/06/02 16:24:58 INFO TaskSetManager: Finished task 18.0 in stage 0.0 (TID 18) in 236003 ms on localhost (11/40) | |
| 15/06/02 16:24:58 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1140850688+33554432 | |
| 15/06/02 16:24:59 INFO Executor: Finished task 10.0 in stage 0.0 (TID 10). 2042 bytes result sent to driver | |
| 15/06/02 16:24:59 INFO TaskSetManager: Starting task 35.0 in stage 0.0 (TID 35, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:59 INFO Executor: Running task 35.0 in stage 0.0 (TID 35) | |
| 15/06/02 16:24:59 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1174405120+33554432 | |
| 15/06/02 16:24:59 INFO TaskSetManager: Finished task 10.0 in stage 0.0 (TID 10) in 236664 ms on localhost (12/40) | |
| 15/06/02 16:24:59 INFO Executor: Finished task 21.0 in stage 0.0 (TID 21). 2042 bytes result sent to driver | |
| 15/06/02 16:24:59 INFO TaskSetManager: Starting task 36.0 in stage 0.0 (TID 36, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:59 INFO Executor: Running task 36.0 in stage 0.0 (TID 36) | |
| 15/06/02 16:24:59 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1207959552+33554432 | |
| 15/06/02 16:24:59 INFO TaskSetManager: Finished task 21.0 in stage 0.0 (TID 21) in 236704 ms on localhost (13/40) | |
| 15/06/02 16:24:59 INFO Executor: Finished task 12.0 in stage 0.0 (TID 12). 2042 bytes result sent to driver | |
| 15/06/02 16:24:59 INFO TaskSetManager: Starting task 37.0 in stage 0.0 (TID 37, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:24:59 INFO Executor: Running task 37.0 in stage 0.0 (TID 37) | |
| 15/06/02 16:24:59 INFO TaskSetManager: Finished task 12.0 in stage 0.0 (TID 12) in 237173 ms on localhost (14/40) | |
| 15/06/02 16:24:59 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1241513984+33554432 | |
| 15/06/02 16:25:03 INFO Executor: Finished task 23.0 in stage 0.0 (TID 23). 2042 bytes result sent to driver | |
| 15/06/02 16:25:03 INFO TaskSetManager: Starting task 38.0 in stage 0.0 (TID 38, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:25:03 INFO TaskSetManager: Finished task 23.0 in stage 0.0 (TID 23) in 240668 ms on localhost (15/40) | |
| 15/06/02 16:25:03 INFO Executor: Running task 38.0 in stage 0.0 (TID 38) | |
| 15/06/02 16:25:03 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1275068416+33554432 | |
| 15/06/02 16:25:04 INFO Executor: Finished task 5.0 in stage 0.0 (TID 5). 2042 bytes result sent to driver | |
| 15/06/02 16:25:04 INFO TaskSetManager: Starting task 39.0 in stage 0.0 (TID 39, localhost, PROCESS_LOCAL, 1290 bytes) | |
| 15/06/02 16:25:04 INFO Executor: Running task 39.0 in stage 0.0 (TID 39) | |
| 15/06/02 16:25:04 INFO TaskSetManager: Finished task 5.0 in stage 0.0 (TID 5) in 242175 ms on localhost (16/40) | |
| 15/06/02 16:25:04 INFO HadoopRDD: Input split: file:/mnt/data/20150405_182615.cl.txt:1308622848+33662296 | |
| 15/06/02 16:25:05 INFO Executor: Finished task 19.0 in stage 0.0 (TID 19). 2042 bytes result sent to driver | |
| 15/06/02 16:25:05 INFO TaskSetManager: Finished task 19.0 in stage 0.0 (TID 19) in 243272 ms on localhost (17/40) | |
| 15/06/02 16:25:09 INFO Executor: Finished task 22.0 in stage 0.0 (TID 22). 2042 bytes result sent to driver | |
| 15/06/02 16:25:09 INFO TaskSetManager: Finished task 22.0 in stage 0.0 (TID 22) in 246757 ms on localhost (18/40) | |
| 15/06/02 16:25:09 INFO Executor: Finished task 7.0 in stage 0.0 (TID 7). 2042 bytes result sent to driver | |
| 15/06/02 16:25:09 INFO TaskSetManager: Finished task 7.0 in stage 0.0 (TID 7) in 247315 ms on localhost (19/40) | |
| 15/06/02 16:25:14 INFO Executor: Finished task 15.0 in stage 0.0 (TID 15). 2042 bytes result sent to driver | |
| 15/06/02 16:25:14 INFO TaskSetManager: Finished task 15.0 in stage 0.0 (TID 15) in 252334 ms on localhost (20/40) | |
| 15/06/02 16:25:15 INFO Executor: Finished task 6.0 in stage 0.0 (TID 6). 2042 bytes result sent to driver | |
| 15/06/02 16:25:15 INFO TaskSetManager: Finished task 6.0 in stage 0.0 (TID 6) in 253127 ms on localhost (21/40) | |
| 15/06/02 16:25:17 INFO Executor: Finished task 11.0 in stage 0.0 (TID 11). 2042 bytes result sent to driver | |
| 15/06/02 16:25:17 INFO TaskSetManager: Finished task 11.0 in stage 0.0 (TID 11) in 254542 ms on localhost (22/40) | |
| 15/06/02 16:25:18 INFO Executor: Finished task 4.0 in stage 0.0 (TID 4). 2042 bytes result sent to driver | |
| 15/06/02 16:25:18 INFO TaskSetManager: Finished task 4.0 in stage 0.0 (TID 4) in 255847 ms on localhost (23/40) | |
| 15/06/02 16:25:20 INFO Executor: Finished task 16.0 in stage 0.0 (TID 16). 2042 bytes result sent to driver | |
| 15/06/02 16:25:20 INFO TaskSetManager: Finished task 16.0 in stage 0.0 (TID 16) in 257464 ms on localhost (24/40) | |
| 15/06/02 16:27:43 INFO Executor: Finished task 24.0 in stage 0.0 (TID 24). 2042 bytes result sent to driver | |
| 15/06/02 16:27:43 INFO TaskSetManager: Finished task 24.0 in stage 0.0 (TID 24) in 194120 ms on localhost (25/40) | |
| 15/06/02 16:27:51 INFO Executor: Finished task 28.0 in stage 0.0 (TID 28). 2042 bytes result sent to driver | |
| 15/06/02 16:27:51 INFO TaskSetManager: Finished task 28.0 in stage 0.0 (TID 28) in 185072 ms on localhost (26/40) | |
| 15/06/02 16:27:58 INFO Executor: Finished task 25.0 in stage 0.0 (TID 25). 2042 bytes result sent to driver | |
| 15/06/02 16:27:58 INFO TaskSetManager: Finished task 25.0 in stage 0.0 (TID 25) in 199321 ms on localhost (27/40) | |
| 15/06/02 16:27:59 INFO Executor: Finished task 37.0 in stage 0.0 (TID 37). 2042 bytes result sent to driver | |
| 15/06/02 16:27:59 INFO TaskSetManager: Finished task 37.0 in stage 0.0 (TID 37) in 180068 ms on localhost (28/40) | |
| 15/06/02 16:28:02 INFO Executor: Finished task 33.0 in stage 0.0 (TID 33). 2042 bytes result sent to driver | |
| 15/06/02 16:28:02 INFO TaskSetManager: Finished task 33.0 in stage 0.0 (TID 33) in 185144 ms on localhost (29/40) | |
| 15/06/02 16:28:02 INFO Executor: Finished task 32.0 in stage 0.0 (TID 32). 2042 bytes result sent to driver | |
| 15/06/02 16:28:02 INFO TaskSetManager: Finished task 32.0 in stage 0.0 (TID 32) in 186404 ms on localhost (30/40) | |
| 15/06/02 16:28:03 INFO Executor: Finished task 29.0 in stage 0.0 (TID 29). 2042 bytes result sent to driver | |
| 15/06/02 16:28:03 INFO TaskSetManager: Finished task 29.0 in stage 0.0 (TID 29) in 195711 ms on localhost (31/40) | |
| 15/06/02 16:28:06 INFO Executor: Finished task 27.0 in stage 0.0 (TID 27). 2042 bytes result sent to driver | |
| 15/06/02 16:28:06 INFO TaskSetManager: Finished task 27.0 in stage 0.0 (TID 27) in 203662 ms on localhost (32/40) | |
| 15/06/02 16:28:10 INFO Executor: Finished task 35.0 in stage 0.0 (TID 35). 2042 bytes result sent to driver | |
| 15/06/02 16:28:10 INFO TaskSetManager: Finished task 35.0 in stage 0.0 (TID 35) in 191191 ms on localhost (33/40) | |
| 15/06/02 16:28:14 INFO Executor: Finished task 31.0 in stage 0.0 (TID 31). 2042 bytes result sent to driver | |
| 15/06/02 16:28:14 INFO TaskSetManager: Finished task 31.0 in stage 0.0 (TID 31) in 203304 ms on localhost (34/40) | |
| 15/06/02 16:28:15 INFO Executor: Finished task 36.0 in stage 0.0 (TID 36). 2042 bytes result sent to driver | |
| 15/06/02 16:28:15 INFO TaskSetManager: Finished task 36.0 in stage 0.0 (TID 36) in 195999 ms on localhost (35/40) | |
| 15/06/02 16:28:27 INFO Executor: Finished task 39.0 in stage 0.0 (TID 39). 2042 bytes result sent to driver | |
| 15/06/02 16:28:27 INFO TaskSetManager: Finished task 39.0 in stage 0.0 (TID 39) in 202790 ms on localhost (36/40) | |
| 15/06/02 16:28:28 INFO Executor: Finished task 26.0 in stage 0.0 (TID 26). 2042 bytes result sent to driver | |
| 15/06/02 16:28:28 INFO TaskSetManager: Finished task 26.0 in stage 0.0 (TID 26) in 225514 ms on localhost (37/40) | |
| 15/06/02 16:28:31 INFO Executor: Finished task 38.0 in stage 0.0 (TID 38). 2042 bytes result sent to driver | |
| 15/06/02 16:28:31 INFO TaskSetManager: Finished task 38.0 in stage 0.0 (TID 38) in 208732 ms on localhost (38/40) | |
| 15/06/02 16:28:33 INFO Executor: Finished task 30.0 in stage 0.0 (TID 30). 2042 bytes result sent to driver | |
| 15/06/02 16:28:33 INFO TaskSetManager: Finished task 30.0 in stage 0.0 (TID 30) in 225107 ms on localhost (39/40) | |
| 15/06/02 16:28:35 INFO Executor: Finished task 34.0 in stage 0.0 (TID 34). 2042 bytes result sent to driver | |
| 15/06/02 16:28:35 INFO TaskSetManager: Finished task 34.0 in stage 0.0 (TID 34) in 217134 ms on localhost (40/40) | |
| 15/06/02 16:28:35 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool | |
| 15/06/02 16:28:35 INFO DAGScheduler: Stage 0 (map at inazumaTwitter.scala:73) finished in 453.152 s | |
| 15/06/02 16:28:35 INFO DAGScheduler: looking for newly runnable stages | |
| 15/06/02 16:28:35 INFO DAGScheduler: running: Set() | |
| 15/06/02 16:28:35 INFO DAGScheduler: waiting: Set(Stage 1) | |
| 15/06/02 16:28:35 INFO DAGScheduler: failed: Set() | |
| 15/06/02 16:28:35 INFO DAGScheduler: Missing parents for Stage 1: List() | |
| 15/06/02 16:28:35 INFO DAGScheduler: Submitting Stage 1 (MapPartitionsRDD[7] at sortBy at inazumaTwitter.scala:73), which is now runnable | |
| 15/06/02 16:28:35 INFO MemoryStore: ensureFreeSpace(3032) called with curMem=158034, maxMem=555755765 | |
| 15/06/02 16:28:35 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 3.0 KB, free 529.9 MB) | |
| 15/06/02 16:28:35 INFO MemoryStore: ensureFreeSpace(2182) called with curMem=161066, maxMem=555755765 | |
| 15/06/02 16:28:35 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.1 KB, free 529.9 MB) | |
| 15/06/02 16:28:35 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:49196 (size: 2.1 KB, free: 530.0 MB) | |
| 15/06/02 16:28:35 INFO BlockManagerMaster: Updated info of block broadcast_2_piece0 | |
| 15/06/02 16:28:35 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:839 | |
| 15/06/02 16:28:35 INFO DAGScheduler: Submitting 40 missing tasks from Stage 1 (MapPartitionsRDD[7] at sortBy at inazumaTwitter.scala:73) | |
| 15/06/02 16:28:35 INFO TaskSchedulerImpl: Adding task set 1.0 with 40 tasks | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 40, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 41, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 42, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 43, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 44, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 5.0 in stage 1.0 (TID 45, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 6.0 in stage 1.0 (TID 46, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 7.0 in stage 1.0 (TID 47, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 8.0 in stage 1.0 (TID 48, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 9.0 in stage 1.0 (TID 49, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 10.0 in stage 1.0 (TID 50, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 11.0 in stage 1.0 (TID 51, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 12.0 in stage 1.0 (TID 52, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 13.0 in stage 1.0 (TID 53, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 14.0 in stage 1.0 (TID 54, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 15.0 in stage 1.0 (TID 55, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 16.0 in stage 1.0 (TID 56, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 17.0 in stage 1.0 (TID 57, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 18.0 in stage 1.0 (TID 58, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 19.0 in stage 1.0 (TID 59, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 20.0 in stage 1.0 (TID 60, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 21.0 in stage 1.0 (TID 61, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 22.0 in stage 1.0 (TID 62, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO TaskSetManager: Starting task 23.0 in stage 1.0 (TID 63, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:35 INFO Executor: Running task 2.0 in stage 1.0 (TID 42) | |
| 15/06/02 16:28:35 INFO Executor: Running task 0.0 in stage 1.0 (TID 40) | |
| 15/06/02 16:28:35 INFO Executor: Running task 3.0 in stage 1.0 (TID 43) | |
| 15/06/02 16:28:35 INFO Executor: Running task 1.0 in stage 1.0 (TID 41) | |
| 15/06/02 16:28:35 INFO Executor: Running task 11.0 in stage 1.0 (TID 51) | |
| 15/06/02 16:28:35 INFO Executor: Running task 4.0 in stage 1.0 (TID 44) | |
| 15/06/02 16:28:35 INFO Executor: Running task 9.0 in stage 1.0 (TID 49) | |
| 15/06/02 16:28:35 INFO Executor: Running task 10.0 in stage 1.0 (TID 50) | |
| 15/06/02 16:28:35 INFO Executor: Running task 14.0 in stage 1.0 (TID 54) | |
| 15/06/02 16:28:35 INFO Executor: Running task 7.0 in stage 1.0 (TID 47) | |
| 15/06/02 16:28:35 INFO Executor: Running task 5.0 in stage 1.0 (TID 45) | |
| 15/06/02 16:28:35 INFO Executor: Running task 6.0 in stage 1.0 (TID 46) | |
| 15/06/02 16:28:35 INFO Executor: Running task 17.0 in stage 1.0 (TID 57) | |
| 15/06/02 16:28:35 INFO Executor: Running task 16.0 in stage 1.0 (TID 56) | |
| 15/06/02 16:28:35 INFO Executor: Running task 8.0 in stage 1.0 (TID 48) | |
| 15/06/02 16:28:35 INFO Executor: Running task 15.0 in stage 1.0 (TID 55) | |
| 15/06/02 16:28:35 INFO Executor: Running task 12.0 in stage 1.0 (TID 52) | |
| 15/06/02 16:28:35 INFO Executor: Running task 19.0 in stage 1.0 (TID 59) | |
| 15/06/02 16:28:35 INFO Executor: Running task 13.0 in stage 1.0 (TID 53) | |
| 15/06/02 16:28:35 INFO Executor: Running task 18.0 in stage 1.0 (TID 58) | |
| 15/06/02 16:28:35 INFO Executor: Running task 20.0 in stage 1.0 (TID 60) | |
| 15/06/02 16:28:35 INFO Executor: Running task 21.0 in stage 1.0 (TID 61) | |
| 15/06/02 16:28:35 INFO Executor: Running task 22.0 in stage 1.0 (TID 62) | |
| 15/06/02 16:28:35 INFO Executor: Running task 23.0 in stage 1.0 (TID 63) | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 6 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 4 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 4 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 4 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 4 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 10 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 14 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 14 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 14 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 14 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 14 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 17 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 14 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 14 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 17 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 17 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 17 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 17 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 16 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 18 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 18 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 18 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 18 ms | |
| 15/06/02 16:28:35 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 18 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 6.0 in stage 1.0 (TID 46). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 24.0 in stage 1.0 (TID 64, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 24.0 in stage 1.0 (TID 64) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 6.0 in stage 1.0 (TID 46) in 365 ms on localhost (1/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 12.0 in stage 1.0 (TID 52). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 10.0 in stage 1.0 (TID 50). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 25.0 in stage 1.0 (TID 65, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 25.0 in stage 1.0 (TID 65) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 26.0 in stage 1.0 (TID 66, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 26.0 in stage 1.0 (TID 66) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 10.0 in stage 1.0 (TID 50) in 366 ms on localhost (2/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 12.0 in stage 1.0 (TID 52) in 366 ms on localhost (3/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 4.0 in stage 1.0 (TID 44). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 7.0 in stage 1.0 (TID 47). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 27.0 in stage 1.0 (TID 67, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 27.0 in stage 1.0 (TID 67) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 44) in 380 ms on localhost (4/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 7.0 in stage 1.0 (TID 47) in 379 ms on localhost (5/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 28.0 in stage 1.0 (TID 68, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 28.0 in stage 1.0 (TID 68) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 2.0 in stage 1.0 (TID 42). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 13.0 in stage 1.0 (TID 53). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 19.0 in stage 1.0 (TID 59). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 18.0 in stage 1.0 (TID 58). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 29.0 in stage 1.0 (TID 69, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 29.0 in stage 1.0 (TID 69) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 14.0 in stage 1.0 (TID 54). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 42) in 384 ms on localhost (6/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 9.0 in stage 1.0 (TID 49). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 8.0 in stage 1.0 (TID 48). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 23.0 in stage 1.0 (TID 63). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 5.0 in stage 1.0 (TID 45). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 30.0 in stage 1.0 (TID 70, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 30.0 in stage 1.0 (TID 70) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 1.0 in stage 1.0 (TID 41). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 31.0 in stage 1.0 (TID 71, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 17.0 in stage 1.0 (TID 57). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 32.0 in stage 1.0 (TID 72, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 3.0 in stage 1.0 (TID 43). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 13.0 in stage 1.0 (TID 53) in 382 ms on localhost (7/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 14.0 in stage 1.0 (TID 54) in 382 ms on localhost (8/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO Executor: Running task 32.0 in stage 1.0 (TID 72) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 22.0 in stage 1.0 (TID 62). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 11.0 in stage 1.0 (TID 51). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 16.0 in stage 1.0 (TID 56). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO Executor: Finished task 21.0 in stage 1.0 (TID 61). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 31.0 in stage 1.0 (TID 71) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 19.0 in stage 1.0 (TID 59) in 380 ms on localhost (9/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 0.0 in stage 1.0 (TID 40). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO Executor: Finished task 15.0 in stage 1.0 (TID 55). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 20.0 in stage 1.0 (TID 60). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 33.0 in stage 1.0 (TID 73, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 33.0 in stage 1.0 (TID 73) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 34.0 in stage 1.0 (TID 74, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 34.0 in stage 1.0 (TID 74) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 35.0 in stage 1.0 (TID 75, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 3 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 35.0 in stage 1.0 (TID 75) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 9.0 in stage 1.0 (TID 49) in 386 ms on localhost (10/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 8.0 in stage 1.0 (TID 48) in 388 ms on localhost (11/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 23.0 in stage 1.0 (TID 63) in 381 ms on localhost (12/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 5.0 in stage 1.0 (TID 45) in 390 ms on localhost (13/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 36.0 in stage 1.0 (TID 76, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 36.0 in stage 1.0 (TID 76) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 37.0 in stage 1.0 (TID 77, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 38.0 in stage 1.0 (TID 78, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 38.0 in stage 1.0 (TID 78) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 39.0 in stage 1.0 (TID 79, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 39.0 in stage 1.0 (TID 79) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 37.0 in stage 1.0 (TID 77) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 41) in 396 ms on localhost (14/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 17.0 in stage 1.0 (TID 57) in 388 ms on localhost (15/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 43) in 395 ms on localhost (16/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 22.0 in stage 1.0 (TID 62) in 387 ms on localhost (17/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 11.0 in stage 1.0 (TID 51) in 393 ms on localhost (18/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 16.0 in stage 1.0 (TID 56) in 390 ms on localhost (19/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 21.0 in stage 1.0 (TID 61) in 389 ms on localhost (20/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 15.0 in stage 1.0 (TID 55) in 391 ms on localhost (21/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 40) in 403 ms on localhost (22/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 18.0 in stage 1.0 (TID 58) in 390 ms on localhost (23/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 20.0 in stage 1.0 (TID 60) in 390 ms on localhost (24/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 24.0 in stage 1.0 (TID 64). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 24.0 in stage 1.0 (TID 64) in 79 ms on localhost (25/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 25.0 in stage 1.0 (TID 65). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 27.0 in stage 1.0 (TID 67). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 25.0 in stage 1.0 (TID 65) in 77 ms on localhost (26/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 32.0 in stage 1.0 (TID 72). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 27.0 in stage 1.0 (TID 67) in 67 ms on localhost (27/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 32.0 in stage 1.0 (TID 72) in 61 ms on localhost (28/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 28.0 in stage 1.0 (TID 68). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 28.0 in stage 1.0 (TID 68) in 72 ms on localhost (29/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 31.0 in stage 1.0 (TID 71). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 31.0 in stage 1.0 (TID 71) in 73 ms on localhost (30/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 29.0 in stage 1.0 (TID 69). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 29.0 in stage 1.0 (TID 69) in 76 ms on localhost (31/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 30.0 in stage 1.0 (TID 70). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 37.0 in stage 1.0 (TID 77). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 30.0 in stage 1.0 (TID 70) in 78 ms on localhost (32/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 37.0 in stage 1.0 (TID 77) in 71 ms on localhost (33/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 26.0 in stage 1.0 (TID 66). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 34.0 in stage 1.0 (TID 74). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 26.0 in stage 1.0 (TID 66) in 113 ms on localhost (34/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 34.0 in stage 1.0 (TID 74) in 94 ms on localhost (35/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 36.0 in stage 1.0 (TID 76). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 36.0 in stage 1.0 (TID 76) in 92 ms on localhost (36/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 38.0 in stage 1.0 (TID 78). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 38.0 in stage 1.0 (TID 78) in 92 ms on localhost (37/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 33.0 in stage 1.0 (TID 73). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 33.0 in stage 1.0 (TID 73) in 98 ms on localhost (38/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 39.0 in stage 1.0 (TID 79). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 35.0 in stage 1.0 (TID 75). 1310 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 39.0 in stage 1.0 (TID 79) in 95 ms on localhost (39/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 35.0 in stage 1.0 (TID 75) in 99 ms on localhost (40/40) | |
| 15/06/02 16:28:36 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool | |
| 15/06/02 16:28:36 INFO DAGScheduler: Stage 1 (sortBy at inazumaTwitter.scala:73) finished in 0.494 s | |
| 15/06/02 16:28:36 INFO DAGScheduler: Job 0 finished: sortBy at inazumaTwitter.scala:73, took 453.765677 s | |
| 15/06/02 16:28:36 INFO SparkContext: Starting job: take at inazumaTwitter.scala:76 | |
| 15/06/02 16:28:36 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 739 bytes | |
| 15/06/02 16:28:36 INFO DAGScheduler: Registering RDD 5 (sortBy at inazumaTwitter.scala:73) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Got job 1 (take at inazumaTwitter.scala:76) with 1 output partitions (allowLocal=true) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Final stage: Stage 4(take at inazumaTwitter.scala:76) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Parents of final stage: List(Stage 3) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Missing parents: List(Stage 3) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Submitting Stage 3 (MapPartitionsRDD[5] at sortBy at inazumaTwitter.scala:73), which has no missing parents | |
| 15/06/02 16:28:36 INFO MemoryStore: ensureFreeSpace(3048) called with curMem=163248, maxMem=555755765 | |
| 15/06/02 16:28:36 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 3.0 KB, free 529.9 MB) | |
| 15/06/02 16:28:36 INFO MemoryStore: ensureFreeSpace(2184) called with curMem=166296, maxMem=555755765 | |
| 15/06/02 16:28:36 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.1 KB, free 529.8 MB) | |
| 15/06/02 16:28:36 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:49196 (size: 2.1 KB, free: 530.0 MB) | |
| 15/06/02 16:28:36 INFO BlockManagerMaster: Updated info of block broadcast_3_piece0 | |
| 15/06/02 16:28:36 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:839 | |
| 15/06/02 16:28:36 INFO DAGScheduler: Submitting 40 missing tasks from Stage 3 (MapPartitionsRDD[5] at sortBy at inazumaTwitter.scala:73) | |
| 15/06/02 16:28:36 INFO TaskSchedulerImpl: Adding task set 3.0 with 40 tasks | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 80, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 81, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 82, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 83, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 4.0 in stage 3.0 (TID 84, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 5.0 in stage 3.0 (TID 85, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 6.0 in stage 3.0 (TID 86, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 7.0 in stage 3.0 (TID 87, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 8.0 in stage 3.0 (TID 88, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 9.0 in stage 3.0 (TID 89, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 10.0 in stage 3.0 (TID 90, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 11.0 in stage 3.0 (TID 91, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 12.0 in stage 3.0 (TID 92, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 13.0 in stage 3.0 (TID 93, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 14.0 in stage 3.0 (TID 94, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 15.0 in stage 3.0 (TID 95, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 16.0 in stage 3.0 (TID 96, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 17.0 in stage 3.0 (TID 97, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 18.0 in stage 3.0 (TID 98, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 19.0 in stage 3.0 (TID 99, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 20.0 in stage 3.0 (TID 100, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 21.0 in stage 3.0 (TID 101, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 22.0 in stage 3.0 (TID 102, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 23.0 in stage 3.0 (TID 103, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 0.0 in stage 3.0 (TID 80) | |
| 15/06/02 16:28:36 INFO Executor: Running task 1.0 in stage 3.0 (TID 81) | |
| 15/06/02 16:28:36 INFO Executor: Running task 9.0 in stage 3.0 (TID 89) | |
| 15/06/02 16:28:36 INFO Executor: Running task 2.0 in stage 3.0 (TID 82) | |
| 15/06/02 16:28:36 INFO Executor: Running task 14.0 in stage 3.0 (TID 94) | |
| 15/06/02 16:28:36 INFO Executor: Running task 23.0 in stage 3.0 (TID 103) | |
| 15/06/02 16:28:36 INFO Executor: Running task 4.0 in stage 3.0 (TID 84) | |
| 15/06/02 16:28:36 INFO Executor: Running task 5.0 in stage 3.0 (TID 85) | |
| 15/06/02 16:28:36 INFO Executor: Running task 3.0 in stage 3.0 (TID 83) | |
| 15/06/02 16:28:36 INFO Executor: Running task 15.0 in stage 3.0 (TID 95) | |
| 15/06/02 16:28:36 INFO Executor: Running task 17.0 in stage 3.0 (TID 97) | |
| 15/06/02 16:28:36 INFO Executor: Running task 21.0 in stage 3.0 (TID 101) | |
| 15/06/02 16:28:36 INFO Executor: Running task 20.0 in stage 3.0 (TID 100) | |
| 15/06/02 16:28:36 INFO Executor: Running task 22.0 in stage 3.0 (TID 102) | |
| 15/06/02 16:28:36 INFO Executor: Running task 19.0 in stage 3.0 (TID 99) | |
| 15/06/02 16:28:36 INFO Executor: Running task 7.0 in stage 3.0 (TID 87) | |
| 15/06/02 16:28:36 INFO Executor: Running task 13.0 in stage 3.0 (TID 93) | |
| 15/06/02 16:28:36 INFO Executor: Running task 11.0 in stage 3.0 (TID 91) | |
| 15/06/02 16:28:36 INFO Executor: Running task 16.0 in stage 3.0 (TID 96) | |
| 15/06/02 16:28:36 INFO Executor: Running task 12.0 in stage 3.0 (TID 92) | |
| 15/06/02 16:28:36 INFO Executor: Running task 6.0 in stage 3.0 (TID 86) | |
| 15/06/02 16:28:36 INFO Executor: Running task 8.0 in stage 3.0 (TID 88) | |
| 15/06/02 16:28:36 INFO Executor: Running task 10.0 in stage 3.0 (TID 90) | |
| 15/06/02 16:28:36 INFO Executor: Running task 18.0 in stage 3.0 (TID 98) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 14.0 in stage 3.0 (TID 94). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 11.0 in stage 3.0 (TID 91). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 24.0 in stage 3.0 (TID 104, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 24.0 in stage 3.0 (TID 104) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 25.0 in stage 3.0 (TID 105, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 25.0 in stage 3.0 (TID 105) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 11.0 in stage 3.0 (TID 91) in 238 ms on localhost (1/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 14.0 in stage 3.0 (TID 94) in 238 ms on localhost (2/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 5.0 in stage 3.0 (TID 85). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 26.0 in stage 3.0 (TID 106, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 26.0 in stage 3.0 (TID 106) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 5.0 in stage 3.0 (TID 85) in 241 ms on localhost (3/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 10.0 in stage 3.0 (TID 90). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 16.0 in stage 3.0 (TID 96). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 27.0 in stage 3.0 (TID 107, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 27.0 in stage 3.0 (TID 107) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 10.0 in stage 3.0 (TID 90) in 241 ms on localhost (4/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 28.0 in stage 3.0 (TID 108, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 28.0 in stage 3.0 (TID 108) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 18.0 in stage 3.0 (TID 98). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 16.0 in stage 3.0 (TID 96) in 241 ms on localhost (5/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 29.0 in stage 3.0 (TID 109, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 29.0 in stage 3.0 (TID 109) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 18.0 in stage 3.0 (TID 98) in 241 ms on localhost (6/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 23.0 in stage 3.0 (TID 103). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 30.0 in stage 3.0 (TID 110, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 30.0 in stage 3.0 (TID 110) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 23.0 in stage 3.0 (TID 103) in 247 ms on localhost (7/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 21.0 in stage 3.0 (TID 101). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 1.0 in stage 3.0 (TID 81). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 22.0 in stage 3.0 (TID 102). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 31.0 in stage 3.0 (TID 111, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 31.0 in stage 3.0 (TID 111) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 15.0 in stage 3.0 (TID 95). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO Executor: Finished task 9.0 in stage 3.0 (TID 89). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 21.0 in stage 3.0 (TID 101) in 249 ms on localhost (8/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 13.0 in stage 3.0 (TID 93). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 3.0 in stage 3.0 (TID 83). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 32.0 in stage 3.0 (TID 112, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 81) in 253 ms on localhost (9/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 6.0 in stage 3.0 (TID 86). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Running task 32.0 in stage 3.0 (TID 112) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 4.0 in stage 3.0 (TID 84). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 33.0 in stage 3.0 (TID 113, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 34.0 in stage 3.0 (TID 114, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 34.0 in stage 3.0 (TID 114) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 22.0 in stage 3.0 (TID 102) in 251 ms on localhost (10/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 15.0 in stage 3.0 (TID 95) in 251 ms on localhost (11/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 19.0 in stage 3.0 (TID 99). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 35.0 in stage 3.0 (TID 115, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 35.0 in stage 3.0 (TID 115) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 20.0 in stage 3.0 (TID 100). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 36.0 in stage 3.0 (TID 116, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 37.0 in stage 3.0 (TID 117, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 37.0 in stage 3.0 (TID 117) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 38.0 in stage 3.0 (TID 118, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 39.0 in stage 3.0 (TID 119, localhost, PROCESS_LOCAL, 1045 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 39.0 in stage 3.0 (TID 119) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 9.0 in stage 3.0 (TID 89) in 254 ms on localhost (12/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 38.0 in stage 3.0 (TID 118) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 6.0 in stage 3.0 (TID 86) in 255 ms on localhost (13/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 19.0 in stage 3.0 (TID 99) in 254 ms on localhost (14/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 83) in 256 ms on localhost (15/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 13.0 in stage 3.0 (TID 93) in 255 ms on localhost (16/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 4.0 in stage 3.0 (TID 84) in 256 ms on localhost (17/40) | |
| 15/06/02 16:28:36 INFO Executor: Running task 33.0 in stage 3.0 (TID 113) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 20.0 in stage 3.0 (TID 100) in 254 ms on localhost (18/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 2.0 in stage 3.0 (TID 82). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 82) in 261 ms on localhost (19/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 12.0 in stage 3.0 (TID 92). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 7.0 in stage 3.0 (TID 87). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 12.0 in stage 3.0 (TID 92) in 261 ms on localhost (20/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Running task 36.0 in stage 3.0 (TID 116) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 8.0 in stage 3.0 (TID 88). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 7.0 in stage 3.0 (TID 87) in 262 ms on localhost (21/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 17.0 in stage 3.0 (TID 97). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 0.0 in stage 3.0 (TID 80). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 8.0 in stage 3.0 (TID 88) in 262 ms on localhost (22/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 17.0 in stage 3.0 (TID 97) in 261 ms on localhost (23/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 80) in 265 ms on localhost (24/40) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 25.0 in stage 3.0 (TID 105). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 25.0 in stage 3.0 (TID 105) in 92 ms on localhost (25/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 24.0 in stage 3.0 (TID 104). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 30.0 in stage 3.0 (TID 110). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 29.0 in stage 3.0 (TID 109). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 30.0 in stage 3.0 (TID 110) in 88 ms on localhost (26/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 29.0 in stage 3.0 (TID 109) in 94 ms on localhost (27/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 24.0 in stage 3.0 (TID 104) in 100 ms on localhost (28/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 38.0 in stage 3.0 (TID 118). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 28.0 in stage 3.0 (TID 108). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 38.0 in stage 3.0 (TID 118) in 87 ms on localhost (29/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 28.0 in stage 3.0 (TID 108) in 99 ms on localhost (30/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 34.0 in stage 3.0 (TID 114). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO Executor: Finished task 26.0 in stage 3.0 (TID 106). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 34.0 in stage 3.0 (TID 114) in 100 ms on localhost (31/40) | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 26.0 in stage 3.0 (TID 106) in 112 ms on localhost (32/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 33.0 in stage 3.0 (TID 113). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 33.0 in stage 3.0 (TID 113) in 107 ms on localhost (33/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 36.0 in stage 3.0 (TID 116). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 36.0 in stage 3.0 (TID 116) in 111 ms on localhost (34/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 32.0 in stage 3.0 (TID 112). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 32.0 in stage 3.0 (TID 112) in 115 ms on localhost (35/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 37.0 in stage 3.0 (TID 117). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 37.0 in stage 3.0 (TID 117) in 130 ms on localhost (36/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 35.0 in stage 3.0 (TID 115). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 35.0 in stage 3.0 (TID 115) in 134 ms on localhost (37/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 31.0 in stage 3.0 (TID 111). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 31.0 in stage 3.0 (TID 111) in 139 ms on localhost (38/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 39.0 in stage 3.0 (TID 119). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 39.0 in stage 3.0 (TID 119) in 136 ms on localhost (39/40) | |
| 15/06/02 16:28:36 INFO Executor: Finished task 27.0 in stage 3.0 (TID 107). 1111 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 27.0 in stage 3.0 (TID 107) in 154 ms on localhost (40/40) | |
| 15/06/02 16:28:36 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool | |
| 15/06/02 16:28:36 INFO DAGScheduler: Stage 3 (sortBy at inazumaTwitter.scala:73) finished in 0.398 s | |
| 15/06/02 16:28:36 INFO DAGScheduler: looking for newly runnable stages | |
| 15/06/02 16:28:36 INFO DAGScheduler: running: Set() | |
| 15/06/02 16:28:36 INFO DAGScheduler: waiting: Set(Stage 4) | |
| 15/06/02 16:28:36 INFO DAGScheduler: failed: Set() | |
| 15/06/02 16:28:36 INFO DAGScheduler: Missing parents for Stage 4: List() | |
| 15/06/02 16:28:36 INFO DAGScheduler: Submitting Stage 4 (MapPartitionsRDD[9] at sortBy at inazumaTwitter.scala:73), which is now runnable | |
| 15/06/02 16:28:36 INFO MemoryStore: ensureFreeSpace(2808) called with curMem=168480, maxMem=555755765 | |
| 15/06/02 16:28:36 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 2.7 KB, free 529.8 MB) | |
| 15/06/02 16:28:36 INFO MemoryStore: ensureFreeSpace(2089) called with curMem=171288, maxMem=555755765 | |
| 15/06/02 16:28:36 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.0 KB, free 529.8 MB) | |
| 15/06/02 16:28:36 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:49196 (size: 2.0 KB, free: 530.0 MB) | |
| 15/06/02 16:28:36 INFO BlockManagerMaster: Updated info of block broadcast_4_piece0 | |
| 15/06/02 16:28:36 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:839 | |
| 15/06/02 16:28:36 INFO DAGScheduler: Submitting 1 missing tasks from Stage 4 (MapPartitionsRDD[9] at sortBy at inazumaTwitter.scala:73) | |
| 15/06/02 16:28:36 INFO TaskSchedulerImpl: Adding task set 4.0 with 1 tasks | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 120, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 0.0 in stage 4.0 (TID 120) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 0.0 in stage 4.0 (TID 120). 4163 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 120) in 69 ms on localhost (1/1) | |
| 15/06/02 16:28:36 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool | |
| 15/06/02 16:28:36 INFO DAGScheduler: Stage 4 (take at inazumaTwitter.scala:76) finished in 0.070 s | |
| 15/06/02 16:28:36 INFO DAGScheduler: Job 1 finished: take at inazumaTwitter.scala:76, took 0.487144 s | |
| 銀魂 893233 | |
| ニセコイ 460165 | |
| うたプリ 341368 | |
| 終わりのセラフ 258941 | |
| 俺ガイル 231784 | |
| 血界戦線 205487 | |
| えとたま 169583 | |
| ニコ 161225 | |
| きんいろモザイク 153137 | |
| 巨人 152936 | |
| アルスラーン戦記 152885 | |
| 楽しみ 151640 | |
| うた 150494 | |
| アイドル 146488 | |
| ラブライブ 141197 | |
| 黒子 137217 | |
| ソング 131185 | |
| イラスト 128716 | |
| プリンス 127150 | |
| 戸塚 121853 | |
| うたの☆プリンスさまっ♪ 117977 | |
| マジLOVEレボリューション 117977 | |
| 青春 117822 | |
| コメ 116141 | |
| ダンまち 116020 | |
| 食戟のソーマ 115729 | |
| 情報 114529 | |
| 画像 113589 | |
| 東京 113246 | |
| 先生 108579 | |
| イベント 99798 | |
| ヘスティア 99787 | |
| ラブ 98273 | |
| シリーズ 97757 | |
| あと 96472 | |
| 特典 96375 | |
| マギ 96359 | |
| 境界 93603 | |
| キャラ 91923 | |
| ダンジョンに出会いを求めるのは間違っているだろうか 91890 | |
| ニンジャスレイヤー 88809 | |
| プリパラ 88119 | |
| ハイ 87743 | |
| B 87163 | |
| Y ROCK 87163 | |
| 執事 87133 | |
| バス 87035 | |
| レーカン 86763 | |
| イシヨン 82975 | |
| 皆様 82447 | |
| パンチライン 81748 | |
| いろは 80894 | |
| バスケ 79809 | |
| 響け！ユーフォニアム 76726 | |
| キュー 75846 | |
| 世界 71193 | |
| おん 71046 | |
| けい 70228 | |
| 電波教師 70209 | |
| 日常 70056 | |
| 感想 69168 | |
| プレアデス 68958 | |
| プラスティック・メモリーズ 67751 | |
| サイト 67445 | |
| キャラクター 66873 | |
| ニュース 66868 | |
| 実況 66859 | |
| 有希 66071 | |
| グッズ 65833 | |
| クラスタ 64154 | |
| 長門有希ちゃんの消失 63706 | |
| 少女 62751 | |
| 商品 62303 | |
| 最速 61650 | |
| トキヤ 60620 | |
| シーン 60555 | |
| ハイスクール 60393 | |
| 境界のRINNE 60026 | |
| ハロー 59751 | |
| ベル 58812 | |
| 鬼灯 58539 | |
| ミカグラ学園組曲 58430 | |
| フォロワー 58266 | |
| 土方 58010 | |
| ニセ 57993 | |
| フロムアニメイシヨ 57709 | |
| 送料 57703 | |
| コイ 57367 | |
| 物語 56336 | |
| 魔法少女リリカルなのはViVid 55743 | |
| デュラララ 55024 | |
| バッジ 54328 | |
| 山田くんと7人の魔女 53859 | |
| きんモザ 53071 | |
| グリザイア 53054 | |
| 冷徹 52835 | |
| ｗｗｗ 52789 | |
| 原作 52415 | |
| レーカン！ 51775 | |
| 見逃し 51774 | |
| 15/06/02 16:28:36 INFO SparkContext: Starting job: take at inazumaTwitter.scala:82 | |
| 15/06/02 16:28:36 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 739 bytes | |
| 15/06/02 16:28:36 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 1 is 508 bytes | |
| 15/06/02 16:28:36 INFO DAGScheduler: Got job 2 (take at inazumaTwitter.scala:82) with 1 output partitions (allowLocal=true) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Final stage: Stage 7(take at inazumaTwitter.scala:82) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Parents of final stage: List(Stage 6) | |
| 15/06/02 16:28:36 INFO DAGScheduler: Missing parents: List() | |
| 15/06/02 16:28:36 INFO DAGScheduler: Submitting Stage 7 (MapPartitionsRDD[9] at sortBy at inazumaTwitter.scala:73), which has no missing parents | |
| 15/06/02 16:28:36 INFO MemoryStore: ensureFreeSpace(2808) called with curMem=173377, maxMem=555755765 | |
| 15/06/02 16:28:36 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 2.7 KB, free 529.8 MB) | |
| 15/06/02 16:28:36 INFO MemoryStore: ensureFreeSpace(2089) called with curMem=176185, maxMem=555755765 | |
| 15/06/02 16:28:36 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.0 KB, free 529.8 MB) | |
| 15/06/02 16:28:36 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:49196 (size: 2.0 KB, free: 530.0 MB) | |
| 15/06/02 16:28:36 INFO BlockManagerMaster: Updated info of block broadcast_5_piece0 | |
| 15/06/02 16:28:36 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:839 | |
| 15/06/02 16:28:36 INFO DAGScheduler: Submitting 1 missing tasks from Stage 7 (MapPartitionsRDD[9] at sortBy at inazumaTwitter.scala:73) | |
| 15/06/02 16:28:36 INFO TaskSchedulerImpl: Adding task set 7.0 with 1 tasks | |
| 15/06/02 16:28:36 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 121, localhost, PROCESS_LOCAL, 1056 bytes) | |
| 15/06/02 16:28:36 INFO Executor: Running task 0.0 in stage 7.0 (TID 121) | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Getting 40 non-empty blocks out of 40 blocks | |
| 15/06/02 16:28:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms | |
| 15/06/02 16:28:36 INFO Executor: Finished task 0.0 in stage 7.0 (TID 121). 4163 bytes result sent to driver | |
| 15/06/02 16:28:36 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 121) in 37 ms on localhost (1/1) | |
| 15/06/02 16:28:36 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool | |
| 15/06/02 16:28:36 INFO DAGScheduler: Stage 7 (take at inazumaTwitter.scala:82) finished in 0.037 s | |
| 15/06/02 16:28:36 INFO DAGScheduler: Job 2 finished: take at inazumaTwitter.scala:82, took 0.050726 s | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/metrics/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/kill,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/static,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/json,null} | |
| 15/06/02 16:28:36 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs,null} | |
| 15/06/02 16:28:36 INFO SparkUI: Stopped Spark web UI at http://vXXXX.a002.g.tyo1.static.conoha.io:4041 | |
| 15/06/02 16:28:36 INFO DAGScheduler: Stopping DAGScheduler | |
| 15/06/02 16:28:36 INFO MapOutputTrackerMasterActor: MapOutputTrackerActor stopped! | |
| 15/06/02 16:28:37 INFO MemoryStore: MemoryStore cleared | |
| 15/06/02 16:28:37 INFO BlockManager: BlockManager stopped |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment