Created
March 6, 2010 15:42
-
-
Save anonymous/323746 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2010-03-06 07:54:36,785 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: fs.default.name; Ignoring. | |
2010-03-06 07:54:36,836 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId= | |
2010-03-06 07:54:36,945 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: fs.default.name; Ignoring. | |
2010-03-06 07:54:36,947 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring. | |
2010-03-06 07:54:36,948 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. | |
2010-03-06 07:54:36,948 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring. | |
2010-03-06 07:54:36,994 INFO com.hadoop.compression.lzo.GPLNativeCodeLoader: Loaded native gpl library | |
2010-03-06 07:54:36,997 INFO com.hadoop.compression.lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 916aeae88ceb6734a679ebf9b48a93bea4cd9a06] | |
2010-03-06 07:54:37,030 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=417601952, MaxSingleShuffleLimit=104400488 | |
2010-03-06 07:54:37,410 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor | |
2010-03-06 07:54:37,410 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor | |
2010-03-06 07:54:37,411 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor | |
2010-03-06 07:54:37,411 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor | |
2010-03-06 07:54:37,411 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor | |
2010-03-06 07:54:37,413 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread started: Thread for merging on-disk files | |
2010-03-06 07:54:37,413 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread waiting: Thread for merging on-disk files | |
2010-03-06 07:54:37,414 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread started: Thread for merging in memory files | |
2010-03-06 07:54:37,415 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread started: Thread for polling Map Completion Events | |
2010-03-06 07:54:37,415 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Need another 209754 map output(s) where 0 is already in progress | |
2010-03-06 07:54:37,432 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) | |
2010-03-06 07:54:38,176 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 10000 new map-outputs | |
2010-03-06 07:54:39,190 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 568 new map-outputs | |
2010-03-06 07:54:40,195 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 136 new map-outputs | |
2010-03-06 07:54:42,434 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 18 outputs (0 slow hosts and0 dup hosts) | |
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000091_0, compressed len: 383937, decompressed len: 3360744 | |
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000102_0, compressed len: 498917, decompressed len: 3055348 | |
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3360744 bytes (383937 raw bytes) into RAM from attempt_201003060739_0002_m_000091_0 | |
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3055348 bytes (498917 raw bytes) into RAM from attempt_201003060739_0002_m_000102_0 | |
2010-03-06 07:54:42,520 INFO org.apache.hadoop.mapred.ReduceTask: Read 3055348 bytes from map-output for attempt_201003060739_0002_m_000102_0 | |
2010-03-06 07:54:42,522 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000102_0 -> (27, 26) from hd34.dfs.returnpath.net | |
2010-03-06 07:54:42,531 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10095 dup hosts) | |
2010-03-06 07:54:42,532 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000154_0, compressed len: 332726, decompressed len: 2431455 | |
2010-03-06 07:54:42,532 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2431455 bytes (332726 raw bytes) into RAM from attempt_201003060739_0002_m_000154_0 | |
2010-03-06 07:54:42,543 INFO org.apache.hadoop.mapred.ReduceTask: Read 3360744 bytes from map-output for attempt_201003060739_0002_m_000091_0 | |
2010-03-06 07:54:42,543 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000091_0 -> (29, 22) from hd37.dfs.returnpath.net | |
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10053 dup hosts) | |
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: Read 2431455 bytes from map-output for attempt_201003060739_0002_m_000154_0 | |
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000154_0 -> (28, 22) from hd14.dfs.returnpath.net | |
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10109 dup hosts) | |
2010-03-06 07:54:42,551 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000120_0, compressed len: 468743, decompressed len: 2773070 | |
2010-03-06 07:54:42,551 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2773070 bytes (468743 raw bytes) into RAM from attempt_201003060739_0002_m_000120_0 | |
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000142_0, compressed len: 392971, decompressed len: 2324947 | |
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000071_0, compressed len: 567828, decompressed len: 3777993 | |
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2324947 bytes (392971 raw bytes) into RAM from attempt_201003060739_0002_m_000142_0 | |
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3777993 bytes (567828 raw bytes) into RAM from attempt_201003060739_0002_m_000071_0 | |
2010-03-06 07:54:42,590 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000097_0, compressed len: 389385, decompressed len: 3195710 | |
2010-03-06 07:54:42,591 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3195710 bytes (389385 raw bytes) into RAM from attempt_201003060739_0002_m_000097_0 | |
2010-03-06 07:54:42,604 INFO org.apache.hadoop.mapred.ReduceTask: Read 2773070 bytes from map-output for attempt_201003060739_0002_m_000120_0 | |
2010-03-06 07:54:42,604 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000120_0 -> (30, 22) from hd10.dfs.returnpath.net | |
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10053 dup hosts) | |
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: Read 2324947 bytes from map-output for attempt_201003060739_0002_m_000142_0 | |
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000142_0 -> (26, 22) from hd27.dfs.returnpath.net | |
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10086 dup hosts) | |
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: Read 3195710 bytes from map-output for attempt_201003060739_0002_m_000097_0 | |
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000097_0 -> (31, 22) from hd11.dfs.returnpath.net | |
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000123_0, compressed len: 396591, decompressed len: 2758180 | |
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2758180 bytes (396591 raw bytes) into RAM from attempt_201003060739_0002_m_000123_0 | |
2010-03-06 07:54:42,610 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10088 dup hosts) | |
2010-03-06 07:54:42,614 INFO org.apache.hadoop.mapred.ReduceTask: Read 3777993 bytes from map-output for attempt_201003060739_0002_m_000071_0 | |
2010-03-06 07:54:42,614 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000071_0 -> (30, 22) from hd30.dfs.returnpath.net | |
2010-03-06 07:54:42,614 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10087 dup hosts) | |
2010-03-06 07:54:42,617 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000080_0, compressed len: 523298, decompressed len: 4097989 | |
2010-03-06 07:54:42,617 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4097989 bytes (523298 raw bytes) into RAM from attempt_201003060739_0002_m_000080_0 | |
2010-03-06 07:54:42,626 INFO org.apache.hadoop.mapred.ReduceTask: Read 2758180 bytes from map-output for attempt_201003060739_0002_m_000123_0 | |
2010-03-06 07:54:42,626 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000123_0 -> (31, 22) from hd19.dfs.returnpath.net | |
2010-03-06 07:54:42,626 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10046 dup hosts) | |
2010-03-06 07:54:42,631 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000143_0, compressed len: 388643, decompressed len: 2446027 | |
2010-03-06 07:54:42,631 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2446027 bytes (388643 raw bytes) into RAM from attempt_201003060739_0002_m_000143_0 | |
2010-03-06 07:54:42,644 INFO org.apache.hadoop.mapred.ReduceTask: Read 4097989 bytes from map-output for attempt_201003060739_0002_m_000080_0 | |
2010-03-06 07:54:42,644 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000080_0 -> (28, 22) from hd31.dfs.returnpath.net | |
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10128 dup hosts) | |
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: Read 2446027 bytes from map-output for attempt_201003060739_0002_m_000143_0 | |
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000143_0 -> (31, 23) from hd21.dfs.returnpath.net | |
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10069 dup hosts) | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000039_0, compressed len: 669462, decompressed len: 4758093 | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4758093 bytes (669462 raw bytes) into RAM from attempt_201003060739_0002_m_000039_0 | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000113_0, compressed len: 389815, decompressed len: 2892647 | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000036_0, compressed len: 668943, decompressed len: 4668635 | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4668635 bytes (668943 raw bytes) into RAM from attempt_201003060739_0002_m_000036_0 | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000063_0, compressed len: 562154, decompressed len: 4544148 | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2892647 bytes (389815 raw bytes) into RAM from attempt_201003060739_0002_m_000113_0 | |
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000078_0, compressed len: 414436, decompressed len: 3628087 | |
2010-03-06 07:54:42,955 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3628087 bytes (414436 raw bytes) into RAM from attempt_201003060739_0002_m_000078_0 | |
2010-03-06 07:54:42,955 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4544148 bytes (562154 raw bytes) into RAM from attempt_201003060739_0002_m_000063_0 | |
2010-03-06 07:54:42,994 INFO org.apache.hadoop.mapred.ReduceTask: Read 3628087 bytes from map-output for attempt_201003060739_0002_m_000078_0 | |
2010-03-06 07:54:42,995 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000078_0 -> (31, 22) from hd38.dfs.returnpath.net | |
2010-03-06 07:54:42,995 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10090 dup hosts) | |
2010-03-06 07:54:42,997 INFO org.apache.hadoop.mapred.ReduceTask: Read 4544148 bytes from map-output for attempt_201003060739_0002_m_000063_0 | |
2010-03-06 07:54:42,997 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000063_0 -> (29, 22) from hd13.dfs.returnpath.net | |
2010-03-06 07:54:42,997 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10124 dup hosts) | |
2010-03-06 07:54:43,000 INFO org.apache.hadoop.mapred.ReduceTask: Read 4668635 bytes from map-output for attempt_201003060739_0002_m_000036_0 | |
2010-03-06 07:54:43,000 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000036_0 -> (28, 22) from hd17.dfs.returnpath.net | |
2010-03-06 07:54:43,000 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10116 dup hosts) | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Read 4758093 bytes from map-output for attempt_201003060739_0002_m_000039_0 | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000145_0, compressed len: 382166, decompressed len: 2521200 | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2521200 bytes (382166 raw bytes) into RAM from attempt_201003060739_0002_m_000145_0 | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000039_0 -> (28, 22) from hd33.dfs.returnpath.net | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000046_0, compressed len: 587827, decompressed len: 4415671 | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10114 dup hosts) | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Read 2892647 bytes from map-output for attempt_201003060739_0002_m_000113_0 | |
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4415671 bytes (587827 raw bytes) into RAM from attempt_201003060739_0002_m_000046_0 | |
2010-03-06 07:54:43,002 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000113_0 -> (31, 22) from hd20.dfs.returnpath.net | |
2010-03-06 07:54:43,020 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10065 dup hosts) | |
2010-03-06 07:54:43,023 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000047_0, compressed len: 600645, decompressed len: 4279480 | |
2010-03-06 07:54:43,023 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4279480 bytes (600645 raw bytes) into RAM from attempt_201003060739_0002_m_000047_0 | |
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000121_0, compressed len: 406002, decompressed len: 2801631 | |
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2801631 bytes (406002 raw bytes) into RAM from attempt_201003060739_0002_m_000121_0 | |
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000093_0, compressed len: 500298, decompressed len: 3648406 | |
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3648406 bytes (500298 raw bytes) into RAM from attempt_201003060739_0002_m_000093_0 | |
2010-03-06 07:54:43,061 INFO org.apache.hadoop.mapred.ReduceTask: Read 2521200 bytes from map-output for attempt_201003060739_0002_m_000145_0 | |
2010-03-06 07:54:43,061 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000145_0 -> (31, 22) from hd16.dfs.returnpath.net | |
2010-03-06 07:54:43,061 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10052 dup hosts) | |
2010-03-06 07:54:43,066 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000134_0, compressed len: 385962, decompressed len: 2577331 | |
2010-03-06 07:54:43,066 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2577331 bytes (385962 raw bytes) into RAM from attempt_201003060739_0002_m_000134_0 | |
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Read 4415671 bytes from map-output for attempt_201003060739_0002_m_000046_0 | |
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Read 4279480 bytes from map-output for attempt_201003060739_0002_m_000047_0 | |
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000046_0 -> (30, 22) from hd28.dfs.returnpath.net | |
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000047_0 -> (28, 24) from hd36.dfs.returnpath.net | |
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 2 outputs (0 slow hosts and9465 dup hosts) | |
2010-03-06 07:54:43,068 INFO org.apache.hadoop.mapred.ReduceTask: Read 3648406 bytes from map-output for attempt_201003060739_0002_m_000093_0 | |
2010-03-06 07:54:43,068 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000093_0 -> (30, 22) from hd37.dfs.returnpath.net | |
2010-03-06 07:54:43,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10037 dup hosts) | |
2010-03-06 07:54:43,074 INFO org.apache.hadoop.mapred.ReduceTask: Read 2801631 bytes from map-output for attempt_201003060739_0002_m_000121_0 | |
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000121_0 -> (29, 26) from hd34.dfs.returnpath.net | |
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000129_0, compressed len: 373233, decompressed len: 2757140 | |
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10077 dup hosts) | |
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2757140 bytes (373233 raw bytes) into RAM from attempt_201003060739_0002_m_000129_0 | |
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000135_0, compressed len: 342917, decompressed len: 2567595 | |
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000094_0, compressed len: 378557, decompressed len: 3088969 | |
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2567595 bytes (342917 raw bytes) into RAM from attempt_201003060739_0002_m_000135_0 | |
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000077_0, compressed len: 477837, decompressed len: 4013422 | |
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4013422 bytes (477837 raw bytes) into RAM from attempt_201003060739_0002_m_000077_0 | |
2010-03-06 07:54:43,099 INFO org.apache.hadoop.mapred.ReduceTask: Read 2577331 bytes from map-output for attempt_201003060739_0002_m_000134_0 | |
2010-03-06 07:54:43,100 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000134_0 -> (31, 22) from hd14.dfs.returnpath.net | |
2010-03-06 07:54:43,100 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10092 dup hosts) | |
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3088969 bytes (378557 raw bytes) into RAM from attempt_201003060739_0002_m_000094_0 | |
2010-03-06 07:54:43,137 INFO org.apache.hadoop.mapred.ReduceTask: Read 2567595 bytes from map-output for attempt_201003060739_0002_m_000135_0 | |
2010-03-06 07:54:43,137 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000135_0 -> (28, 22) from hd27.dfs.returnpath.net | |
2010-03-06 07:54:43,138 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10070 dup hosts) | |
2010-03-06 07:54:43,140 INFO org.apache.hadoop.mapred.ReduceTask: Read 2757140 bytes from map-output for attempt_201003060739_0002_m_000129_0 | |
2010-03-06 07:54:43,140 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000129_0 -> (29, 22) from hd10.dfs.returnpath.net | |
2010-03-06 07:54:43,140 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10035 dup hosts) | |
2010-03-06 07:54:43,145 INFO org.apache.hadoop.mapred.ReduceTask: Read 4013422 bytes from map-output for attempt_201003060739_0002_m_000077_0 | |
2010-03-06 07:54:43,146 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000077_0 -> (31, 22) from hd30.dfs.returnpath.net | |
2010-03-06 07:54:43,146 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10071 dup hosts) | |
2010-03-06 07:54:43,151 INFO org.apache.hadoop.mapred.ReduceTask: Read 3088969 bytes from map-output for attempt_201003060739_0002_m_000094_0 | |
2010-03-06 07:54:43,151 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000094_0 -> (31, 22) from hd11.dfs.returnpath.net | |
2010-03-06 07:54:43,151 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10070 dup hosts) | |
2010-03-06 07:54:43,154 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000072_0, compressed len: 622722, decompressed len: 3828178 | |
2010-03-06 07:54:43,154 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3828178 bytes (622722 raw bytes) into RAM from attempt_201003060739_0002_m_000072_0 | |
2010-03-06 07:54:43,167 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000060_0, compressed len: 588836, decompressed len: 5015957 | |
2010-03-06 07:54:43,167 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5015957 bytes (588836 raw bytes) into RAM from attempt_201003060739_0002_m_000060_0 | |
2010-03-06 07:54:43,170 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000115_0, compressed len: 410596, decompressed len: 3018449 | |
2010-03-06 07:54:43,170 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3018449 bytes (410596 raw bytes) into RAM from attempt_201003060739_0002_m_000115_0 | |
2010-03-06 07:54:43,170 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000048_0, compressed len: 647062, decompressed len: 4615345 | |
2010-03-06 07:54:43,427 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4615345 bytes (647062 raw bytes) into RAM from attempt_201003060739_0002_m_000048_0 | |
2010-03-06 07:54:43,427 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000110_0, compressed len: 433498, decompressed len: 2939207 | |
2010-03-06 07:54:43,459 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2939207 bytes (433498 raw bytes) into RAM from attempt_201003060739_0002_m_000110_0 | |
2010-03-06 07:54:43,460 INFO org.apache.hadoop.mapred.ReduceTask: Read 3828178 bytes from map-output for attempt_201003060739_0002_m_000072_0 | |
2010-03-06 07:54:43,491 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000072_0 -> (30, 22) from hd38.dfs.returnpath.net | |
2010-03-06 07:54:43,491 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10076 dup hosts) | |
2010-03-06 07:54:43,495 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 152 new map-outputs | |
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: Read 3018449 bytes from map-output for attempt_201003060739_0002_m_000115_0 | |
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000045_0, compressed len: 679831, decompressed len: 5702627 | |
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5702627 bytes (679831 raw bytes) into RAM from attempt_201003060739_0002_m_000045_0 | |
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000115_0 -> (31, 22) from hd19.dfs.returnpath.net | |
2010-03-06 07:54:43,500 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10172 dup hosts) | |
2010-03-06 07:54:43,504 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000335_0, compressed len: 245324, decompressed len: 1097576 | |
2010-03-06 07:54:43,504 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1097576 bytes (245324 raw bytes) into RAM from attempt_201003060739_0002_m_000335_0 | |
2010-03-06 07:54:43,531 INFO org.apache.hadoop.mapred.ReduceTask: Read 2939207 bytes from map-output for attempt_201003060739_0002_m_000110_0 | |
2010-03-06 07:54:43,531 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000110_0 -> (26, 24) from hd21.dfs.returnpath.net | |
2010-03-06 07:54:43,532 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts) | |
2010-03-06 07:54:43,535 INFO org.apache.hadoop.mapred.ReduceTask: Read 4615345 bytes from map-output for attempt_201003060739_0002_m_000048_0 | |
2010-03-06 07:54:43,535 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000048_0 -> (27, 24) from hd13.dfs.returnpath.net | |
2010-03-06 07:54:43,535 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10252 dup hosts) | |
2010-03-06 07:54:43,537 INFO org.apache.hadoop.mapred.ReduceTask: Read 1097576 bytes from map-output for attempt_201003060739_0002_m_000335_0 | |
2010-03-06 07:54:43,537 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000335_0 -> (31, 22) from hd33.dfs.returnpath.net | |
2010-03-06 07:54:43,537 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10243 dup hosts) | |
2010-03-06 07:54:43,539 INFO org.apache.hadoop.mapred.ReduceTask: Read 5015957 bytes from map-output for attempt_201003060739_0002_m_000060_0 | |
2010-03-06 07:54:43,539 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000060_0 -> (26, 22) from hd31.dfs.returnpath.net | |
2010-03-06 07:54:43,540 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10251 dup hosts) | |
2010-03-06 07:54:43,540 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000065_0, compressed len: 435003, decompressed len: 4127846 | |
2010-03-06 07:54:43,540 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4127846 bytes (435003 raw bytes) into RAM from attempt_201003060739_0002_m_000065_0 | |
2010-03-06 07:54:43,544 INFO org.apache.hadoop.mapred.ReduceTask: Read 5702627 bytes from map-output for attempt_201003060739_0002_m_000045_0 | |
2010-03-06 07:54:43,544 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000045_0 -> (31, 22) from hd17.dfs.returnpath.net | |
2010-03-06 07:54:43,545 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10242 dup hosts) | |
2010-03-06 07:54:43,548 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000109_0, compressed len: 334086, decompressed len: 2979814 | |
2010-03-06 07:54:43,548 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2979814 bytes (334086 raw bytes) into RAM from attempt_201003060739_0002_m_000109_0 | |
2010-03-06 07:54:43,759 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000103_0, compressed len: 472438, decompressed len: 3395785 | |
2010-03-06 07:54:43,760 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000054_0, compressed len: 582801, decompressed len: 4047887 | |
2010-03-06 07:54:43,760 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3395785 bytes (472438 raw bytes) into RAM from attempt_201003060739_0002_m_000103_0 | |
2010-03-06 07:54:43,759 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000038_0, compressed len: 679731, decompressed len: 5003500 | |
2010-03-06 07:54:43,760 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4047887 bytes (582801 raw bytes) into RAM from attempt_201003060739_0002_m_000054_0 | |
2010-03-06 07:54:43,777 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5003500 bytes (679731 raw bytes) into RAM from attempt_201003060739_0002_m_000038_0 | |
2010-03-06 07:54:43,797 INFO org.apache.hadoop.mapred.ReduceTask: Read 2979814 bytes from map-output for attempt_201003060739_0002_m_000109_0 | |
2010-03-06 07:54:43,797 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000109_0 -> (28, 22) from hd16.dfs.returnpath.net | |
2010-03-06 07:54:43,797 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10180 dup hosts) | |
2010-03-06 07:54:43,798 INFO org.apache.hadoop.mapred.ReduceTask: Read 4127846 bytes from map-output for attempt_201003060739_0002_m_000065_0 | |
2010-03-06 07:54:43,798 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000065_0 -> (27, 22) from hd28.dfs.returnpath.net | |
2010-03-06 07:54:43,798 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10178 dup hosts) | |
2010-03-06 07:54:43,801 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000149_0, compressed len: 402034, decompressed len: 2424085 | |
2010-03-06 07:54:43,802 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2424085 bytes (402034 raw bytes) into RAM from attempt_201003060739_0002_m_000149_0 | |
2010-03-06 07:54:43,806 INFO org.apache.hadoop.mapred.ReduceTask: Read 4047887 bytes from map-output for attempt_201003060739_0002_m_000054_0 | |
2010-03-06 07:54:43,806 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000054_0 -> (30, 22) from hd37.dfs.returnpath.net | |
2010-03-06 07:54:43,806 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10166 dup hosts) | |
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000095_0, compressed len: 393676, decompressed len: 3250049 | |
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3250049 bytes (393676 raw bytes) into RAM from attempt_201003060739_0002_m_000095_0 | |
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: Read 2424085 bytes from map-output for attempt_201003060739_0002_m_000149_0 | |
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000149_0 -> (31, 22) from hd14.dfs.returnpath.net | |
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10222 dup hosts) | |
2010-03-06 07:54:43,811 INFO org.apache.hadoop.mapred.ReduceTask: Read 3395785 bytes from map-output for attempt_201003060739_0002_m_000103_0 | |
2010-03-06 07:54:43,811 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000103_0 -> (29, 22) from hd20.dfs.returnpath.net | |
2010-03-06 07:54:43,811 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts) | |
2010-03-06 07:54:43,813 INFO org.apache.hadoop.mapred.ReduceTask: Read 5003500 bytes from map-output for attempt_201003060739_0002_m_000038_0 | |
2010-03-06 07:54:43,813 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000038_0 -> (27, 22) from hd36.dfs.returnpath.net | |
2010-03-06 07:54:43,813 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10209 dup hosts) | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000043_0, compressed len: 682335, decompressed len: 4907967 | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000070_0, compressed len: 431637, decompressed len: 4016204 | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4016204 bytes (431637 raw bytes) into RAM from attempt_201003060739_0002_m_000070_0 | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000139_0, compressed len: 412081, decompressed len: 2432814 | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2432814 bytes (412081 raw bytes) into RAM from attempt_201003060739_0002_m_000139_0 | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4907967 bytes (682335 raw bytes) into RAM from attempt_201003060739_0002_m_000043_0 | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000126_0, compressed len: 420656, decompressed len: 2728620 | |
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2728620 bytes (420656 raw bytes) into RAM from attempt_201003060739_0002_m_000126_0 | |
2010-03-06 07:54:43,993 INFO org.apache.hadoop.mapred.ReduceTask: Read 3250049 bytes from map-output for attempt_201003060739_0002_m_000095_0 | |
2010-03-06 07:54:43,993 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000095_0 -> (31, 22) from hd34.dfs.returnpath.net | |
2010-03-06 07:54:43,993 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10203 dup hosts) | |
2010-03-06 07:54:44,000 INFO org.apache.hadoop.mapred.ReduceTask: Read 2728620 bytes from map-output for attempt_201003060739_0002_m_000126_0 | |
2010-03-06 07:54:44,000 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000126_0 -> (31, 22) from hd10.dfs.returnpath.net | |
2010-03-06 07:54:44,000 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10163 dup hosts) | |
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000106_0, compressed len: 481712, decompressed len: 3530032 | |
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3530032 bytes (481712 raw bytes) into RAM from attempt_201003060739_0002_m_000106_0 | |
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: Read 2432814 bytes from map-output for attempt_201003060739_0002_m_000139_0 | |
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000139_0 -> (29, 23) from hd27.dfs.returnpath.net | |
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10196 dup hosts) | |
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Read 4016204 bytes from map-output for attempt_201003060739_0002_m_000070_0 | |
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000070_0 -> (28, 22) from hd11.dfs.returnpath.net | |
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Read 4907967 bytes from map-output for attempt_201003060739_0002_m_000043_0 | |
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10198 dup hosts) | |
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000043_0 -> (30, 22) from hd30.dfs.returnpath.net | |
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10197 dup hosts) | |
2010-03-06 07:54:44,011 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000506_0, compressed len: 181306, decompressed len: 718179 | |
2010-03-06 07:54:44,011 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 718179 bytes (181306 raw bytes) into RAM from attempt_201003060739_0002_m_000506_0 | |
2010-03-06 07:54:44,015 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000033_0, compressed len: 699786, decompressed len: 5360652 | |
2010-03-06 07:54:44,015 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5360652 bytes (699786 raw bytes) into RAM from attempt_201003060739_0002_m_000033_0 | |
2010-03-06 07:54:44,028 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000165_0, compressed len: 335219, decompressed len: 2305914 | |
2010-03-06 07:54:44,028 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2305914 bytes (335219 raw bytes) into RAM from attempt_201003060739_0002_m_000165_0 | |
2010-03-06 07:54:44,028 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000037_0, compressed len: 692329, decompressed len: 4965738 | |
2010-03-06 07:54:44,029 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4965738 bytes (692329 raw bytes) into RAM from attempt_201003060739_0002_m_000037_0 | |
2010-03-06 07:54:44,033 INFO org.apache.hadoop.mapred.ReduceTask: Read 3530032 bytes from map-output for attempt_201003060739_0002_m_000106_0 | |
2010-03-06 07:54:44,033 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000106_0 -> (29, 22) from hd19.dfs.returnpath.net | |
2010-03-06 07:54:44,033 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10156 dup hosts) | |
2010-03-06 07:54:44,035 INFO org.apache.hadoop.mapred.ReduceTask: Read 2305914 bytes from map-output for attempt_201003060739_0002_m_000165_0 | |
2010-03-06 07:54:44,035 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000165_0 -> (31, 22) from hd21.dfs.returnpath.net | |
2010-03-06 07:54:44,035 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10172 dup hosts) | |
2010-03-06 07:54:44,047 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000034_0, compressed len: 731122, decompressed len: 5279297 | |
2010-03-06 07:54:44,047 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5279297 bytes (731122 raw bytes) into RAM from attempt_201003060739_0002_m_000034_0 | |
2010-03-06 07:54:44,058 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000055_0, compressed len: 576568, decompressed len: 4811086 | |
2010-03-06 07:54:44,058 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4811086 bytes (576568 raw bytes) into RAM from attempt_201003060739_0002_m_000055_0 | |
2010-03-06 07:54:44,059 INFO org.apache.hadoop.mapred.ReduceTask: Read 718179 bytes from map-output for attempt_201003060739_0002_m_000506_0 | |
2010-03-06 07:54:44,059 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000506_0 -> (31, 24) from hd33.dfs.returnpath.net | |
2010-03-06 07:54:44,060 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10228 dup hosts) | |
2010-03-06 07:54:44,062 INFO org.apache.hadoop.mapred.ReduceTask: Read 4965738 bytes from map-output for attempt_201003060739_0002_m_000037_0 | |
2010-03-06 07:54:44,062 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000037_0 -> (28, 24) from hd13.dfs.returnpath.net | |
2010-03-06 07:54:44,063 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10235 dup hosts) | |
2010-03-06 07:54:44,067 INFO org.apache.hadoop.mapred.ReduceTask: Read 5360652 bytes from map-output for attempt_201003060739_0002_m_000033_0 | |
2010-03-06 07:54:44,067 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000033_0 -> (29, 22) from hd38.dfs.returnpath.net | |
2010-03-06 07:54:44,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10199 dup hosts) | |
2010-03-06 07:54:44,068 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000062_0, compressed len: 446401, decompressed len: 4264318 | |
2010-03-06 07:54:44,069 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4264318 bytes (446401 raw bytes) into RAM from attempt_201003060739_0002_m_000062_0 | |
2010-03-06 07:54:44,071 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000087_0, compressed len: 493666, decompressed len: 3877817 | |
2010-03-06 07:54:44,071 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3877817 bytes (493666 raw bytes) into RAM from attempt_201003060739_0002_m_000087_0 | |
2010-03-06 07:54:44,323 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000124_0, compressed len: 325072, decompressed len: 2794092 | |
2010-03-06 07:54:44,323 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2794092 bytes (325072 raw bytes) into RAM from attempt_201003060739_0002_m_000124_0 | |
2010-03-06 07:54:44,325 INFO org.apache.hadoop.mapred.ReduceTask: Read 4811086 bytes from map-output for attempt_201003060739_0002_m_000055_0 | |
2010-03-06 07:54:44,325 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000055_0 -> (28, 22) from hd31.dfs.returnpath.net | |
2010-03-06 07:54:44,325 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10234 dup hosts) | |
2010-03-06 07:54:44,328 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000152_0, compressed len: 386585, decompressed len: 2362784 | |
2010-03-06 07:54:44,328 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2362784 bytes (386585 raw bytes) into RAM from attempt_201003060739_0002_m_000152_0 | |
2010-03-06 07:54:44,331 INFO org.apache.hadoop.mapred.ReduceTask: Read 2794092 bytes from map-output for attempt_201003060739_0002_m_000124_0 | |
2010-03-06 07:54:44,331 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000124_0 -> (30, 22) from hd16.dfs.returnpath.net | |
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: Read 5279297 bytes from map-output for attempt_201003060739_0002_m_000034_0 | |
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10164 dup hosts) | |
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000034_0 -> (30, 22) from hd17.dfs.returnpath.net | |
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10224 dup hosts) | |
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Read 4264318 bytes from map-output for attempt_201003060739_0002_m_000062_0 | |
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Read 3877817 bytes from map-output for attempt_201003060739_0002_m_000087_0 | |
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000062_0 -> (28, 22) from hd28.dfs.returnpath.net | |
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000087_0 -> (30, 22) from hd37.dfs.returnpath.net | |
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 2 outputs (0 slow hosts and9524 dup hosts) | |
2010-03-06 07:54:44,338 INFO org.apache.hadoop.mapred.ReduceTask: Read 2362784 bytes from map-output for attempt_201003060739_0002_m_000152_0 | |
2010-03-06 07:54:44,338 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000152_0 -> (31, 24) from hd14.dfs.returnpath.net | |
2010-03-06 07:54:44,338 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10205 dup hosts) | |
2010-03-06 07:54:44,346 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000099_0, compressed len: 376129, decompressed len: 3001061 | |
2010-03-06 07:54:44,346 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3001061 bytes (376129 raw bytes) into RAM from attempt_201003060739_0002_m_000099_0 | |
2010-03-06 07:54:44,347 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000051_0, compressed len: 663744, decompressed len: 5480925 | |
2010-03-06 07:54:44,347 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5480925 bytes (663744 raw bytes) into RAM from attempt_201003060739_0002_m_000051_0 | |
2010-03-06 07:54:44,352 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000098_0, compressed len: 393809, decompressed len: 3243667 | |
2010-03-06 07:54:44,352 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3243667 bytes (393809 raw bytes) into RAM from attempt_201003060739_0002_m_000098_0 | |
2010-03-06 07:54:44,353 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000108_0, compressed len: 403609, decompressed len: 3017253 | |
2010-03-06 07:54:44,353 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3017253 bytes (403609 raw bytes) into RAM from attempt_201003060739_0002_m_000108_0 | |
2010-03-06 07:54:44,357 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000131_0, compressed len: 372289, decompressed len: 2736166 | |
2010-03-06 07:54:44,357 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2736166 bytes (372289 raw bytes) into RAM from attempt_201003060739_0002_m_000131_0 | |
2010-03-06 07:54:44,361 INFO org.apache.hadoop.mapred.ReduceTask: Read 3001061 bytes from map-output for attempt_201003060739_0002_m_000099_0 | |
2010-03-06 07:54:44,361 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000099_0 -> (31, 22) from hd34.dfs.returnpath.net | |
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts) | |
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: Read 3243667 bytes from map-output for attempt_201003060739_0002_m_000098_0 | |
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000098_0 -> (27, 22) from hd10.dfs.returnpath.net | |
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10148 dup hosts) | |
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000083_0, compressed len: 493433, decompressed len: 3888726 | |
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000075_0, compressed len: 411041, decompressed len: 3947538 | |
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3888726 bytes (493433 raw bytes) into RAM from attempt_201003060739_0002_m_000083_0 | |
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3947538 bytes (411041 raw bytes) into RAM from attempt_201003060739_0002_m_000075_0 | |
2010-03-06 07:54:44,375 INFO org.apache.hadoop.mapred.ReduceTask: Read 3017253 bytes from map-output for attempt_201003060739_0002_m_000108_0 | |
2010-03-06 07:54:44,375 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000108_0 -> (30, 22) from hd20.dfs.returnpath.net | |
2010-03-06 07:54:44,376 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10169 dup hosts) | |
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Read 3947538 bytes from map-output for attempt_201003060739_0002_m_000075_0 | |
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000075_0 -> (31, 22) from hd11.dfs.returnpath.net | |
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Read 3888726 bytes from map-output for attempt_201003060739_0002_m_000083_0 | |
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10183 dup hosts) | |
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000083_0 -> (30, 22) from hd30.dfs.returnpath.net | |
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10182 dup hosts) | |
2010-03-06 07:54:44,385 INFO org.apache.hadoop.mapred.ReduceTask: Read 5480925 bytes from map-output for attempt_201003060739_0002_m_000051_0 | |
2010-03-06 07:54:44,385 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000051_0 -> (31, 22) from hd36.dfs.returnpath.net | |
2010-03-06 07:54:44,386 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts) | |
2010-03-06 07:54:44,390 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000027_0, compressed len: 249012, decompressed len: 8740634 | |
2010-03-06 07:54:44,390 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 8740634 bytes (249012 raw bytes) into RAM from attempt_201003060739_0002_m_000027_0 | |
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000052_0, compressed len: 597319, decompressed len: 5304225 | |
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000114_0, compressed len: 430690, decompressed len: 3226138 | |
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5304225 bytes (597319 raw bytes) into RAM from attempt_201003060739_0002_m_000052_0 | |
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3226138 bytes (430690 raw bytes) into RAM from attempt_201003060739_0002_m_000114_0 | |
2010-03-06 07:54:44,421 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000074_0, compressed len: 417314, decompressed len: 3687377 | |
2010-03-06 07:54:44,421 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3687377 bytes (417314 raw bytes) into RAM from attempt_201003060739_0002_m_000074_0 | |
2010-03-06 07:54:44,425 INFO org.apache.hadoop.mapred.ReduceTask: Read 3226138 bytes from map-output for attempt_201003060739_0002_m_000114_0 | |
2010-03-06 07:54:44,425 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000114_0 -> (31, 22) from hd21.dfs.returnpath.net | |
2010-03-06 07:54:44,425 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10157 dup hosts) | |
2010-03-06 07:54:44,426 INFO org.apache.hadoop.mapred.ReduceTask: Read 8740634 bytes from map-output for attempt_201003060739_0002_m_000027_0 | |
2010-03-06 07:54:44,427 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000027_0 -> (30, 22) from hd33.dfs.returnpath.net | |
2010-03-06 07:54:44,427 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10213 dup hosts) | |
2010-03-06 07:54:44,428 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000057_0, compressed len: 574958, decompressed len: 4809270 | |
2010-03-06 07:54:44,428 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4809270 bytes (574958 raw bytes) into RAM from attempt_201003060739_0002_m_000057_0 | |
2010-03-06 07:54:44,431 INFO org.apache.hadoop.mapred.ReduceTask: Read 5304225 bytes from map-output for attempt_201003060739_0002_m_000052_0 | |
2010-03-06 07:54:44,432 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000052_0 -> (26, 22) from hd13.dfs.returnpath.net | |
2010-03-06 07:54:44,432 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10220 dup hosts) | |
2010-03-06 07:54:44,436 INFO org.apache.hadoop.mapred.ReduceTask: Read 3687377 bytes from map-output for attempt_201003060739_0002_m_000074_0 | |
2010-03-06 07:54:44,436 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000074_0 -> (30, 22) from hd19.dfs.returnpath.net | |
2010-03-06 07:54:44,436 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10137 dup hosts) | |
2010-03-06 07:54:44,439 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000229_0, compressed len: 331874, decompressed len: 1541274 | |
2010-03-06 07:54:44,439 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1541274 bytes (331874 raw bytes) into RAM from attempt_201003060739_0002_m_000229_0 | |
2010-03-06 07:54:44,441 INFO org.apache.hadoop.mapred.ReduceTask: Read 4809270 bytes from map-output for attempt_201003060739_0002_m_000057_0 | |
2010-03-06 07:54:44,441 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000057_0 -> (28, 22) from hd38.dfs.returnpath.net | |
2010-03-06 07:54:44,441 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10183 dup hosts) | |
2010-03-06 07:54:44,457 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000044_0, compressed len: 631644, decompressed len: 4526587 | |
2010-03-06 07:54:44,457 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000042_0, compressed len: 453682, decompressed len: 4582537 | |
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4526587 bytes (631644 raw bytes) into RAM from attempt_201003060739_0002_m_000044_0 | |
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000148_0, compressed len: 339516, decompressed len: 2404661 | |
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4582537 bytes (453682 raw bytes) into RAM from attempt_201003060739_0002_m_000042_0 | |
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2404661 bytes (339516 raw bytes) into RAM from attempt_201003060739_0002_m_000148_0 | |
2010-03-06 07:54:44,461 INFO org.apache.hadoop.mapred.ReduceTask: Read 1541274 bytes from map-output for attempt_201003060739_0002_m_000229_0 | |
2010-03-06 07:54:44,461 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000229_0 -> (29, 24) from hd17.dfs.returnpath.net | |
2010-03-06 07:54:44,461 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10210 dup hosts) | |
2010-03-06 07:54:44,468 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000049_0, compressed len: 434703, decompressed len: 4549278 | |
2010-03-06 07:54:44,468 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4549278 bytes (434703 raw bytes) into RAM from attempt_201003060739_0002_m_000049_0 | |
2010-03-06 07:54:44,472 INFO org.apache.hadoop.mapred.ReduceTask: Read 4582537 bytes from map-output for attempt_201003060739_0002_m_000042_0 | |
2010-03-06 07:54:44,472 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000042_0 -> (28, 22) from hd37.dfs.returnpath.net | |
2010-03-06 07:54:44,472 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10136 dup hosts) | |
2010-03-06 07:54:44,474 INFO org.apache.hadoop.mapred.ReduceTask: Read 4526587 bytes from map-output for attempt_201003060739_0002_m_000044_0 | |
2010-03-06 07:54:44,474 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000044_0 -> (28, 22) from hd31.dfs.returnpath.net | |
2010-03-06 07:54:44,474 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10216 dup hosts) | |
2010-03-06 07:54:44,475 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000100_0, compressed len: 378728, decompressed len: 2993498 | |
2010-03-06 07:54:44,475 INFO org.apache.hadoop.mapred.ReduceTask: Read 2404661 bytes from map-output for attempt_201003060739_0002_m_000148_0 | |
2010-03-06 07:54:44,475 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2993498 bytes (378728 raw bytes) into RAM from attempt_201003060739_0002_m_000100_0 | |
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000148_0 -> (30, 22) from hd16.dfs.returnpath.net | |
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000107_0, compressed len: 536132, decompressed len: 3925927 | |
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3925927 bytes (536132 raw bytes) into RAM from attempt_201003060739_0002_m_000107_0 | |
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10146 dup hosts) | |
2010-03-06 07:54:44,499 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000101_0, compressed len: 457619, decompressed len: 3526411 | |
2010-03-06 07:54:44,499 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3526411 bytes (457619 raw bytes) into RAM from attempt_201003060739_0002_m_000101_0 | |
2010-03-06 07:54:44,503 INFO org.apache.hadoop.mapred.ReduceTask: Read 4549278 bytes from map-output for attempt_201003060739_0002_m_000049_0 | |
2010-03-06 07:54:44,503 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000049_0 -> (29, 22) from hd28.dfs.returnpath.net | |
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10144 dup hosts) | |
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: Read 2993498 bytes from map-output for attempt_201003060739_0002_m_000100_0 | |
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000100_0 -> (31, 22) from hd14.dfs.returnpath.net | |
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10189 dup hosts) | |
2010-03-06 07:54:44,507 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000090_0, compressed len: 468872, decompressed len: 3517018 | |
2010-03-06 07:54:44,507 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3517018 bytes (468872 raw bytes) into RAM from attempt_201003060739_0002_m_000090_0 | |
2010-03-06 07:54:44,510 INFO org.apache.hadoop.mapred.ReduceTask: Read 3526411 bytes from map-output for attempt_201003060739_0002_m_000101_0 | |
2010-03-06 07:54:44,510 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000101_0 -> (28, 22) from hd10.dfs.returnpath.net | |
2010-03-06 07:54:44,510 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10133 dup hosts) | |
2010-03-06 07:54:44,512 INFO org.apache.hadoop.mapred.ReduceTask: Read 3925927 bytes from map-output for attempt_201003060739_0002_m_000107_0 | |
2010-03-06 07:54:44,512 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000107_0 -> (31, 22) from hd34.dfs.returnpath.net | |
2010-03-06 07:54:44,512 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10171 dup hosts) | |
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000029_0, compressed len: 796853, decompressed len: 7416176 | |
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000105_0, compressed len: 437827, decompressed len: 3179052 | |
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 7416176 bytes (796853 raw bytes) into RAM from attempt_201003060739_0002_m_000029_0 | |
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000089_0, compressed len: 527790, decompressed len: 3989322 | |
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3179052 bytes (437827 raw bytes) into RAM from attempt_201003060739_0002_m_000105_0 | |
2010-03-06 07:54:44,724 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3989322 bytes (527790 raw bytes) into RAM from attempt_201003060739_0002_m_000089_0 | |
2010-03-06 07:54:44,728 INFO org.apache.hadoop.mapred.ReduceTask: Read 3517018 bytes from map-output for attempt_201003060739_0002_m_000090_0 | |
2010-03-06 07:54:44,728 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000090_0 -> (30, 22) from hd11.dfs.returnpath.net | |
2010-03-06 07:54:44,728 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10168 dup hosts) | |
2010-03-06 07:54:44,735 INFO org.apache.hadoop.mapred.ReduceTask: Read 3179052 bytes from map-output for attempt_201003060739_0002_m_000105_0 | |
2010-03-06 07:54:44,735 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000105_0 -> (31, 22) from hd20.dfs.returnpath.net | |
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10152 dup hosts) | |
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: Read 2736166 bytes from map-output for attempt_201003060739_0002_m_000131_0 | |
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000131_0 -> (28, 22) from hd27.dfs.returnpath.net | |
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10162 dup hosts) | |
2010-03-06 07:54:44,738 INFO org.apache.hadoop.mapred.ReduceTask: Read 3989322 bytes from map-output for attempt_201003060739_0002_m_000089_0 | |
2010-03-06 07:54:44,738 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000089_0 -> (30, 22) from hd30.dfs.returnpath.net | |
2010-03-06 07:54:44,738 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10165 dup hosts) | |
2010-03-06 07:54:44,740 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000199_0, compressed len: 303132, decompressed len: 1685092 | |
2010-03-06 07:54:44,740 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1685092 bytes (303132 raw bytes) into RAM from attempt_201003060739_0002_m_000199_0 | |
2010-03-06 07:54:44,741 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000599_0, compressed len: 175609, decompressed len: 739834 | |
2010-03-06 07:54:44,741 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 739834 bytes (175609 raw bytes) into RAM from attempt_201003060739_0002_m_000599_0 | |
2010-03-06 07:54:44,744 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000141_0, compressed len: 395517, decompressed len: 2480855 | |
2010-03-06 07:54:44,744 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2480855 bytes (395517 raw bytes) into RAM from attempt_201003060739_0002_m_000141_0 | |
2010-03-06 07:54:44,745 WARN org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: Failed to create /hadoop.admin/tmp/mapred/local | |
2010-03-06 07:54:44,762 INFO org.apache.hadoop.mapred.ReduceTask: Read 739834 bytes from map-output for attempt_201003060739_0002_m_000599_0 | |
2010-03-06 07:54:44,763 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000599_0 -> (30, 24) from hd33.dfs.returnpath.net | |
2010-03-06 07:54:44,763 INFO org.apache.hadoop.mapred.ReduceTask: Read 1685092 bytes from map-output for attempt_201003060739_0002_m_000199_0 | |
2010-03-06 07:54:44,764 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000199_0 -> (26, 22) from hd13.dfs.returnpath.net | |
2010-03-06 07:54:44,764 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10198 dup hosts) | |
2010-03-06 07:54:44,764 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10205 dup hosts) | |
2010-03-06 07:54:44,808 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000085_0, compressed len: 396123, decompressed len: 3461041 | |
2010-03-06 07:54:44,809 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3461041 bytes (396123 raw bytes) into RAM from attempt_201003060739_0002_m_000085_0 | |
2010-03-06 07:54:44,814 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000267_0, compressed len: 133127, decompressed len: 1229110 | |
2010-03-06 07:54:44,814 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1229110 bytes (133127 raw bytes) into RAM from attempt_201003060739_0002_m_000267_0 | |
2010-03-06 07:54:44,819 INFO org.apache.hadoop.mapred.ReduceTask: Read 1229110 bytes from map-output for attempt_201003060739_0002_m_000267_0 | |
2010-03-06 07:54:44,820 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000267_0 -> (28, 22) from hd17.dfs.returnpath.net | |
2010-03-06 07:54:44,820 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10197 dup hosts) | |
2010-03-06 07:54:44,821 INFO org.apache.hadoop.mapred.ReduceTask: Read 2480855 bytes from map-output for attempt_201003060739_0002_m_000141_0 | |
2010-03-06 07:54:44,821 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000141_0 -> (26, 22) from hd21.dfs.returnpath.net | |
2010-03-06 07:54:44,821 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10138 dup hosts) | |
2010-03-06 07:54:44,822 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor | |
2010-03-06 07:54:44,824 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000050_0, compressed len: 453201, decompressed len: 4570821 | |
2010-03-06 07:54:44,824 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4570821 bytes (453201 raw bytes) into RAM from attempt_201003060739_0002_m_000050_0 | |
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: Read 7416176 bytes from map-output for attempt_201003060739_0002_m_000029_0 | |
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000029_0 -> (27, 24) from hd36.dfs.returnpath.net | |
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000040_0, compressed len: 670246, decompressed len: 4732797 | |
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4732797 bytes (670246 raw bytes) into RAM from attempt_201003060739_0002_m_000040_0 | |
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10167 dup hosts) | |
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: Read 3461041 bytes from map-output for attempt_201003060739_0002_m_000085_0 | |
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000085_0 -> (31, 22) from hd19.dfs.returnpath.net | |
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10119 dup hosts) | |
2010-03-06 07:54:44,827 INFO org.apache.hadoop.mapred.ReduceTask: Initiating in-memory merge with 77 segments... | |
2010-03-06 07:54:44,828 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000150_0, compressed len: 383803, decompressed len: 2452585 | |
2010-03-06 07:54:44,828 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2452585 bytes (383803 raw bytes) into RAM from attempt_201003060739_0002_m_000150_0 | |
2010-03-06 07:54:44,829 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000066_0, compressed len: 673867, decompressed len: 5205165 | |
2010-03-06 07:54:44,830 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5205165 bytes (673867 raw bytes) into RAM from attempt_201003060739_0002_m_000066_0 | |
2010-03-06 07:54:44,830 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000067_0, compressed len: 667750, decompressed len: 5138904 | |
2010-03-06 07:54:44,830 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5138904 bytes (667750 raw bytes) into RAM from attempt_201003060739_0002_m_000067_0 | |
2010-03-06 07:54:45,123 INFO org.apache.hadoop.mapred.Merger: Merging 77 sorted segments | |
2010-03-06 07:54:45,124 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 77 segments left of total size: 279004282 bytes | |
2010-03-06 07:54:45,129 INFO org.apache.hadoop.mapred.ReduceTask: Read 2452585 bytes from map-output for attempt_201003060739_0002_m_000150_0 | |
2010-03-06 07:54:45,130 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000150_0 -> (31, 22) from hd16.dfs.returnpath.net | |
2010-03-06 07:54:45,130 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10132 dup hosts) | |
2010-03-06 07:54:45,132 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000144_0, compressed len: 381957, decompressed len: 2514288 | |
2010-03-06 07:54:45,132 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2514288 bytes (381957 raw bytes) into RAM from attempt_201003060739_0002_m_000144_0 | |
2010-03-06 07:54:45,136 INFO org.apache.hadoop.mapred.ReduceTask: Read 4570821 bytes from map-output for attempt_201003060739_0002_m_000050_0 | |
2010-03-06 07:54:45,137 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000050_0 -> (28, 22) from hd31.dfs.returnpath.net | |
2010-03-06 07:54:45,137 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10200 dup hosts) | |
2010-03-06 07:54:45,140 INFO org.apache.hadoop.mapred.ReduceTask: Read 5138904 bytes from map-output for attempt_201003060739_0002_m_000067_0 | |
2010-03-06 07:54:45,140 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000067_0 -> (31, 22) from hd37.dfs.returnpath.net | |
2010-03-06 07:54:45,140 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10118 dup hosts) | |
2010-03-06 07:54:45,141 INFO org.apache.hadoop.mapred.ReduceTask: Read 4732797 bytes from map-output for attempt_201003060739_0002_m_000040_0 | |
2010-03-06 07:54:45,141 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000040_0 -> (29, 22) from hd38.dfs.returnpath.net | |
2010-03-06 07:54:45,141 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10162 dup hosts) | |
2010-03-06 07:54:45,143 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000064_0, compressed len: 427151, decompressed len: 4243953 | |
2010-03-06 07:54:45,143 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4243953 bytes (427151 raw bytes) into RAM from attempt_201003060739_0002_m_000064_0 | |
2010-03-06 07:54:45,166 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000035_0, compressed len: 711096, decompressed len: 5224180 | |
2010-03-06 07:54:45,166 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5224180 bytes (711096 raw bytes) into RAM from attempt_201003060739_0002_m_000035_0 | |
2010-03-06 07:54:45,168 INFO org.apache.hadoop.mapred.ReduceTask: Read 5205165 bytes from map-output for attempt_201003060739_0002_m_000066_0 | |
2010-03-06 07:54:45,168 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000066_0 -> (31, 22) from hd28.dfs.returnpath.net | |
2010-03-06 07:54:45,168 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10127 dup hosts) | |
2010-03-06 07:54:45,171 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000086_0, compressed len: 497182, decompressed len: 3146262 | |
2010-03-06 07:54:45,171 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3146262 bytes (497182 raw bytes) into RAM from attempt_201003060739_0002_m_000086_0 | |
2010-03-06 07:54:45,178 INFO org.apache.hadoop.mapred.ReduceTask: Read 4243953 bytes from map-output for attempt_201003060739_0002_m_000064_0 | |
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000064_0 -> (31, 22) from hd34.dfs.returnpath.net | |
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: Read 2514288 bytes from map-output for attempt_201003060739_0002_m_000144_0 | |
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10156 dup hosts) | |
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000144_0 -> (31, 22) from hd14.dfs.returnpath.net | |
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10171 dup hosts) | |
2010-03-06 07:54:45,183 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000136_0, compressed len: 377105, decompressed len: 2751049 | |
2010-03-06 07:54:45,183 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2751049 bytes (377105 raw bytes) into RAM from attempt_201003060739_0002_m_000136_0 | |
2010-03-06 07:54:45,184 INFO org.apache.hadoop.mapred.ReduceTask: Read 3146262 bytes from map-output for attempt_201003060739_0002_m_000086_0 | |
2010-03-06 07:54:45,184 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000086_0 -> (29, 22) from hd20.dfs.returnpath.net | |
2010-03-06 07:54:45,184 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10137 dup hosts) | |
2010-03-06 07:54:45,189 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000642_0, compressed len: 316992, decompressed len: 1075927 | |
2010-03-06 07:54:45,189 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1075927 bytes (316992 raw bytes) into RAM from attempt_201003060739_0002_m_000642_0 | |
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000122_0, compressed len: 440683, decompressed len: 3064435 | |
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000056_0, compressed len: 693118, decompressed len: 4400126 | |
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4400126 bytes (693118 raw bytes) into RAM from attempt_201003060739_0002_m_000056_0 | |
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3064435 bytes (440683 raw bytes) into RAM from attempt_201003060739_0002_m_000122_0 | |
2010-03-06 07:54:45,488 INFO org.apache.hadoop.mapred.ReduceTask: Read 1075927 bytes from map-output for attempt_201003060739_0002_m_000642_0 | |
2010-03-06 07:54:45,488 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000642_0 -> (31, 26) from hd33.dfs.returnpath.net | |
2010-03-06 07:54:45,488 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10185 dup hosts) | |
2010-03-06 07:54:45,490 INFO org.apache.hadoop.mapred.ReduceTask: Read 5224180 bytes from map-output for attempt_201003060739_0002_m_000035_0 | |
2010-03-06 07:54:45,490 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000035_0 -> (28, 26) from hd11.dfs.returnpath.net | |
2010-03-06 07:54:45,490 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10150 dup hosts) | |
2010-03-06 07:54:45,491 INFO org.apache.hadoop.mapred.ReduceTask: Read 2751049 bytes from map-output for attempt_201003060739_0002_m_000136_0 | |
2010-03-06 07:54:45,492 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000136_0 -> (31, 22) from hd27.dfs.returnpath.net | |
2010-03-06 07:54:45,492 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10145 dup hosts) | |
2010-03-06 07:54:45,497 INFO org.apache.hadoop.mapred.ReduceTask: Read 3064435 bytes from map-output for attempt_201003060739_0002_m_000122_0 | |
2010-03-06 07:54:45,498 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000122_0 -> (29, 22) from hd10.dfs.returnpath.net | |
2010-03-06 07:54:45,498 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10111 dup hosts) | |
2010-03-06 07:54:45,500 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000111_0, compressed len: 411355, decompressed len: 3044597 | |
2010-03-06 07:54:45,500 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3044597 bytes (411355 raw bytes) into RAM from attempt_201003060739_0002_m_000111_0 | |
2010-03-06 07:54:45,502 INFO org.apache.hadoop.mapred.ReduceTask: Read 4400126 bytes from map-output for attempt_201003060739_0002_m_000056_0 | |
2010-03-06 07:54:45,502 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000056_0 -> (29, 24) from hd30.dfs.returnpath.net | |
2010-03-06 07:54:45,502 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10147 dup hosts) | |
2010-03-06 07:54:45,503 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000298_0, compressed len: 255296, decompressed len: 1104934 | |
2010-03-06 07:54:45,503 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1104934 bytes (255296 raw bytes) into RAM from attempt_201003060739_0002_m_000298_0 | |
2010-03-06 07:54:45,508 INFO org.apache.hadoop.mapred.ReduceTask: Read 1104934 bytes from map-output for attempt_201003060739_0002_m_000298_0 | |
2010-03-06 07:54:45,508 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000298_0 -> (30, 26) from hd13.dfs.returnpath.net | |
2010-03-06 07:54:45,509 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts) | |
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000076_0, compressed len: 369696, decompressed len: 3760271 | |
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000096_0, compressed len: 496540, decompressed len: 3604111 | |
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3760271 bytes (369696 raw bytes) into RAM from attempt_201003060739_0002_m_000076_0 | |
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000201_0, compressed len: 324724, decompressed len: 2060091 | |
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000163_0, compressed len: 365476, decompressed len: 2130748 | |
2010-03-06 07:54:46,090 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2060091 bytes (324724 raw bytes) into RAM from attempt_201003060739_0002_m_000201_0 | |
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3604111 bytes (496540 raw bytes) into RAM from attempt_201003060739_0002_m_000096_0 | |
2010-03-06 07:54:46,090 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2130748 bytes (365476 raw bytes) into RAM from attempt_201003060739_0002_m_000163_0 | |
2010-03-06 07:54:46,103 INFO org.apache.hadoop.mapred.ReduceTask: Read 3044597 bytes from map-output for attempt_201003060739_0002_m_000111_0 | |
2010-03-06 07:54:46,103 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000111_0 -> (29, 22) from hd36.dfs.returnpath.net | |
2010-03-06 07:54:46,103 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10152 dup hosts) | |
2010-03-06 07:54:46,109 INFO org.apache.hadoop.mapred.ReduceTask: Read 3760271 bytes from map-output for attempt_201003060739_0002_m_000076_0 | |
2010-03-06 07:54:46,109 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000076_0 -> (28, 22) from hd16.dfs.returnpath.net | |
2010-03-06 07:54:46,109 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10118 dup hosts) | |
2010-03-06 07:54:46,113 INFO org.apache.hadoop.mapred.ReduceTask: Read 2130748 bytes from map-output for attempt_201003060739_0002_m_000163_0 | |
2010-03-06 07:54:46,113 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000163_0 -> (29, 22) from hd21.dfs.returnpath.net | |
2010-03-06 07:54:46,114 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10120 dup hosts) | |
2010-03-06 07:54:46,117 INFO org.apache.hadoop.mapred.ReduceTask: Read 2060091 bytes from map-output for attempt_201003060739_0002_m_000201_0 | |
2010-03-06 07:54:46,117 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000201_0 -> (29, 22) from hd17.dfs.returnpath.net | |
2010-03-06 07:54:46,118 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10177 dup hosts) | |
2010-03-06 07:54:46,119 INFO org.apache.hadoop.mapred.ReduceTask: Read 3604111 bytes from map-output for attempt_201003060739_0002_m_000096_0 | |
2010-03-06 07:54:46,119 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000096_0 -> (30, 22) from hd19.dfs.returnpath.net | |
2010-03-06 07:54:46,120 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10101 dup hosts) | |
2010-03-06 07:54:46,125 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000117_0, compressed len: 442108, decompressed len: 3024337 | |
2010-03-06 07:54:46,126 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3024337 bytes (442108 raw bytes) into RAM from attempt_201003060739_0002_m_000117_0 | |
2010-03-06 07:54:46,131 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000179_0, compressed len: 331831, decompressed len: 1967778 | |
2010-03-06 07:54:46,131 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1967778 bytes (331831 raw bytes) into RAM from attempt_201003060739_0002_m_000179_0 | |
2010-03-06 07:54:46,138 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000079_0, compressed len: 525950, decompressed len: 4481022 | |
2010-03-06 07:54:46,138 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4481022 bytes (525950 raw bytes) into RAM from attempt_201003060739_0002_m_000079_0 | |
2010-03-06 07:54:46,391 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000082_0, compressed len: 388614, decompressed len: 3472789 | |
2010-03-06 07:54:46,391 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000041_0, compressed len: 462721, decompressed len: 4692670 | |
2010-03-06 07:54:46,392 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3472789 bytes (388614 raw bytes) into RAM from attempt_201003060739_0002_m_000082_0 | |
2010-03-06 07:54:46,392 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4692670 bytes (462721 raw bytes) into RAM from attempt_201003060739_0002_m_000041_0 | |
2010-03-06 07:54:46,399 INFO org.apache.hadoop.mapred.ReduceTask: Read 1967778 bytes from map-output for attempt_201003060739_0002_m_000179_0 | |
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: Read 3024337 bytes from map-output for attempt_201003060739_0002_m_000117_0 | |
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000179_0 -> (29, 22) from hd37.dfs.returnpath.net | |
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000117_0 -> (27, 22) from hd38.dfs.returnpath.net | |
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10102 dup hosts) | |
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10146 dup hosts) | |
2010-03-06 07:54:46,412 INFO org.apache.hadoop.mapred.ReduceTask: Read 4692670 bytes from map-output for attempt_201003060739_0002_m_000041_0 | |
2010-03-06 07:54:46,412 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000041_0 -> (29, 22) from hd31.dfs.returnpath.net | |
2010-03-06 07:54:46,412 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10181 dup hosts) | |
2010-03-06 07:54:46,416 INFO org.apache.hadoop.mapred.ReduceTask: Read 4481022 bytes from map-output for attempt_201003060739_0002_m_000079_0 | |
2010-03-06 07:54:46,416 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000079_0 -> (30, 22) from hd28.dfs.returnpath.net | |
2010-03-06 07:54:46,416 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10110 dup hosts) | |
2010-03-06 07:54:46,425 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000116_0, compressed len: 437608, decompressed len: 3164252 | |
2010-03-06 07:54:46,425 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3164252 bytes (437608 raw bytes) into RAM from attempt_201003060739_0002_m_000116_0 | |
2010-03-06 07:54:46,431 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000171_0, compressed len: 354564, decompressed len: 2276135 | |
2010-03-06 07:54:46,431 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2276135 bytes (354564 raw bytes) into RAM from attempt_201003060739_0002_m_000171_0 | |
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000022_0, compressed len: 287169, decompressed len: 10333848 | |
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000068_0, compressed len: 552362, decompressed len: 4466728 | |
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 10333848 bytes (287169 raw bytes) into RAM from attempt_201003060739_0002_m_000022_0 | |
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4466728 bytes (552362 raw bytes) into RAM from attempt_201003060739_0002_m_000068_0 | |
2010-03-06 07:54:46,909 INFO org.apache.hadoop.mapred.ReduceTask: Read 3472789 bytes from map-output for attempt_201003060739_0002_m_000082_0 | |
2010-03-06 07:54:46,909 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000082_0 -> (29, 22) from hd34.dfs.returnpath.net | |
2010-03-06 07:54:46,910 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10139 dup hosts) | |
2010-03-06 07:54:46,915 INFO org.apache.hadoop.mapred.ReduceTask: Read 3164252 bytes from map-output for attempt_201003060739_0002_m_000116_0 | |
2010-03-06 07:54:46,915 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000116_0 -> (29, 22) from hd20.dfs.returnpath.net | |
2010-03-06 07:54:46,915 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10121 dup hosts) | |
2010-03-06 07:54:46,917 INFO org.apache.hadoop.mapred.ReduceTask: Read 2276135 bytes from map-output for attempt_201003060739_0002_m_000171_0 | |
2010-03-06 07:54:46,917 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000171_0 -> (31, 22) from hd14.dfs.returnpath.net | |
2010-03-06 07:54:46,918 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10153 dup hosts) | |
2010-03-06 07:54:46,930 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000112_0, compressed len: 439879, decompressed len: 3217070 | |
2010-03-06 07:54:46,930 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3217070 bytes (439879 raw bytes) into RAM from attempt_201003060739_0002_m_000112_0 | |
2010-03-06 07:54:46,932 INFO org.apache.hadoop.mapred.ReduceTask: Read 4466728 bytes from map-output for attempt_201003060739_0002_m_000068_0 | |
2010-03-06 07:54:46,933 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000068_0 -> (29, 22) from hd11.dfs.returnpath.net | |
2010-03-06 07:54:46,934 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10134 dup hosts) | |
2010-03-06 07:54:46,935 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000118_0, compressed len: 430628, decompressed len: 3213259 | |
2010-03-06 07:54:46,936 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3213259 bytes (430628 raw bytes) into RAM from attempt_201003060739_0002_m_000118_0 | |
2010-03-06 07:54:46,937 INFO org.apache.hadoop.mapred.ReduceTask: Read 10333848 bytes from map-output for attempt_201003060739_0002_m_000022_0 | |
2010-03-06 07:54:46,938 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000022_0 -> (30, 22) from hd33.dfs.returnpath.net | |
2010-03-06 07:54:46,938 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10167 dup hosts) | |
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000069_0, compressed len: 663932, decompressed len: 5097350 | |
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000258_0, compressed len: 262692, decompressed len: 1320897 | |
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5097350 bytes (663932 raw bytes) into RAM from attempt_201003060739_0002_m_000069_0 | |
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000031_0, compressed len: 202287, decompressed len: 6736732 | |
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1320897 bytes (262692 raw bytes) into RAM from attempt_201003060739_0002_m_000258_0 | |
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 6736732 bytes (202287 raw bytes) into RAM from attempt_201003060739_0002_m_000031_0 | |
2010-03-06 07:54:47,266 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 144 new map-outputs | |
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Read 3217070 bytes from map-output for attempt_201003060739_0002_m_000112_0 | |
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000112_0 -> (29, 22) from hd27.dfs.returnpath.net | |
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Read 1320897 bytes from map-output for attempt_201003060739_0002_m_000258_0 | |
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10264 dup hosts) | |
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000258_0 -> (26, 22) from hd36.dfs.returnpath.net | |
2010-03-06 07:54:47,736 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10274 dup hosts) | |
2010-03-06 07:54:47,738 INFO org.apache.hadoop.mapred.ReduceTask: Read 3213259 bytes from map-output for attempt_201003060739_0002_m_000118_0 | |
2010-03-06 07:54:47,738 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000118_0 -> (30, 22) from hd10.dfs.returnpath.net | |
2010-03-06 07:54:47,738 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10229 dup hosts) | |
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000081_0, compressed len: 469890, decompressed len: 3875947 | |
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000133_0, compressed len: 384904, decompressed len: 2812800 | |
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3875947 bytes (469890 raw bytes) into RAM from attempt_201003060739_0002_m_000081_0 | |
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2812800 bytes (384904 raw bytes) into RAM from attempt_201003060739_0002_m_000133_0 | |
2010-03-06 07:54:48,188 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000028_0, compressed len: 246012, decompressed len: 8497700 | |
2010-03-06 07:54:48,188 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 8497700 bytes (246012 raw bytes) into RAM from attempt_201003060739_0002_m_000028_0 | |
2010-03-06 07:54:49,150 INFO org.apache.hadoop.mapred.ReduceTask: Read 5097350 bytes from map-output for attempt_201003060739_0002_m_000069_0 | |
2010-03-06 07:54:49,151 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000069_0 -> (31, 22) from hd30.dfs.returnpath.net | |
2010-03-06 07:54:49,151 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10265 dup hosts) | |
2010-03-06 07:54:49,391 INFO org.apache.hadoop.mapred.ReduceTask: Read 3875947 bytes from map-output for attempt_201003060739_0002_m_000081_0 | |
2010-03-06 07:54:49,392 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000081_0 -> (31, 22) from hd16.dfs.returnpath.net | |
2010-03-06 07:54:49,392 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10238 dup hosts) | |
2010-03-06 07:54:49,621 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000061_0, compressed len: 435311, decompressed len: 4191933 | |
2010-03-06 07:54:49,621 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000202_0, compressed len: 295631, decompressed len: 1734546 | |
2010-03-06 07:54:49,622 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1734546 bytes (295631 raw bytes) into RAM from attempt_201003060739_0002_m_000202_0 | |
2010-03-06 07:54:49,621 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4191933 bytes (435311 raw bytes) into RAM from attempt_201003060739_0002_m_000061_0 | |
2010-03-06 07:54:50,222 INFO org.apache.hadoop.mapred.ReduceTask: Task attempt_201003060739_0002_r_000000_0: Failed fetch #1 from attempt_201003060739_0002_m_000202_0 | |
2010-03-06 07:54:50,223 WARN org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 adding host hd37.dfs.returnpath.net to penalty box, next contact in 4 seconds | |
2010-03-06 07:54:50,223 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 1 map-outputs from previous failures | |
2010-03-06 07:54:50,223 FATAL org.apache.hadoop.mapred.TaskRunner: attempt_201003060739_0002_r_000000_0 : Map output copy failure : java.lang.OutOfMemoryError: Java heap space | |
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.shuffleInMemory(ReduceTask.java:1508) | |
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1408) | |
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1261) | |
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1195) | |
2010-03-06 07:54:51,674 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: fs.default.name; Ignoring. | |
2010-03-06 07:54:51,728 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=CLEANUP, sessionId= | |
2010-03-06 07:54:51,814 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: fs.default.name; Ignoring. | |
2010-03-06 07:54:51,816 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring. | |
2010-03-06 07:54:51,817 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. | |
2010-03-06 07:54:51,818 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring. | |
2010-03-06 07:54:51,863 INFO org.apache.hadoop.mapred.TaskRunner: Runnning cleanup for the task | |
2010-03-06 07:54:51,866 INFO org.apache.hadoop.mapred.TaskRunner: Task:attempt_201003060739_0002_r_000000_0 is done. And is in the process of commiting | |
2010-03-06 07:54:51,872 INFO org.apache.hadoop.mapred.TaskRunner: Task 'attempt_201003060739_0002_r_000000_0' done. | |
2010-03-06 07:54:53,561 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000032_0, compressed len: 803639, decompressed len: 6022276 | |
2010-03-06 07:54:53,564 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 6022276 bytes (803639 raw bytes) into RAM from attempt_201003060739_0002_m_000032_0 | |
2010-03-06 07:54:53,564 WARN org.apache.hadoop.mapred.TaskRunner: Parent died. Exiting attempt_201003060739_0002_r_000000_0 | |
2010-03-06 07:54:53,565 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 152 new map-outputs |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment