Skip to content

Instantly share code, notes, and snippets.

Created March 6, 2010 15:42
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save anonymous/323746 to your computer and use it in GitHub Desktop.
2010-03-06 07:54:36,785 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: fs.default.name; Ignoring.
2010-03-06 07:54:36,836 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId=
2010-03-06 07:54:36,945 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: fs.default.name; Ignoring.
2010-03-06 07:54:36,947 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2010-03-06 07:54:36,948 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2010-03-06 07:54:36,948 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.1/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2010-03-06 07:54:36,994 INFO com.hadoop.compression.lzo.GPLNativeCodeLoader: Loaded native gpl library
2010-03-06 07:54:36,997 INFO com.hadoop.compression.lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 916aeae88ceb6734a679ebf9b48a93bea4cd9a06]
2010-03-06 07:54:37,030 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=417601952, MaxSingleShuffleLimit=104400488
2010-03-06 07:54:37,410 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2010-03-06 07:54:37,410 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2010-03-06 07:54:37,411 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2010-03-06 07:54:37,411 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2010-03-06 07:54:37,411 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2010-03-06 07:54:37,413 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread started: Thread for merging on-disk files
2010-03-06 07:54:37,413 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread waiting: Thread for merging on-disk files
2010-03-06 07:54:37,414 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread started: Thread for merging in memory files
2010-03-06 07:54:37,415 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Thread started: Thread for polling Map Completion Events
2010-03-06 07:54:37,415 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Need another 209754 map output(s) where 0 is already in progress
2010-03-06 07:54:37,432 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2010-03-06 07:54:38,176 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 10000 new map-outputs
2010-03-06 07:54:39,190 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 568 new map-outputs
2010-03-06 07:54:40,195 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 136 new map-outputs
2010-03-06 07:54:42,434 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 18 outputs (0 slow hosts and0 dup hosts)
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000091_0, compressed len: 383937, decompressed len: 3360744
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000102_0, compressed len: 498917, decompressed len: 3055348
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3360744 bytes (383937 raw bytes) into RAM from attempt_201003060739_0002_m_000091_0
2010-03-06 07:54:42,491 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3055348 bytes (498917 raw bytes) into RAM from attempt_201003060739_0002_m_000102_0
2010-03-06 07:54:42,520 INFO org.apache.hadoop.mapred.ReduceTask: Read 3055348 bytes from map-output for attempt_201003060739_0002_m_000102_0
2010-03-06 07:54:42,522 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000102_0 -> (27, 26) from hd34.dfs.returnpath.net
2010-03-06 07:54:42,531 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10095 dup hosts)
2010-03-06 07:54:42,532 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000154_0, compressed len: 332726, decompressed len: 2431455
2010-03-06 07:54:42,532 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2431455 bytes (332726 raw bytes) into RAM from attempt_201003060739_0002_m_000154_0
2010-03-06 07:54:42,543 INFO org.apache.hadoop.mapred.ReduceTask: Read 3360744 bytes from map-output for attempt_201003060739_0002_m_000091_0
2010-03-06 07:54:42,543 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000091_0 -> (29, 22) from hd37.dfs.returnpath.net
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10053 dup hosts)
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: Read 2431455 bytes from map-output for attempt_201003060739_0002_m_000154_0
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000154_0 -> (28, 22) from hd14.dfs.returnpath.net
2010-03-06 07:54:42,544 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10109 dup hosts)
2010-03-06 07:54:42,551 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000120_0, compressed len: 468743, decompressed len: 2773070
2010-03-06 07:54:42,551 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2773070 bytes (468743 raw bytes) into RAM from attempt_201003060739_0002_m_000120_0
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000142_0, compressed len: 392971, decompressed len: 2324947
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000071_0, compressed len: 567828, decompressed len: 3777993
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2324947 bytes (392971 raw bytes) into RAM from attempt_201003060739_0002_m_000142_0
2010-03-06 07:54:42,557 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3777993 bytes (567828 raw bytes) into RAM from attempt_201003060739_0002_m_000071_0
2010-03-06 07:54:42,590 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000097_0, compressed len: 389385, decompressed len: 3195710
2010-03-06 07:54:42,591 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3195710 bytes (389385 raw bytes) into RAM from attempt_201003060739_0002_m_000097_0
2010-03-06 07:54:42,604 INFO org.apache.hadoop.mapred.ReduceTask: Read 2773070 bytes from map-output for attempt_201003060739_0002_m_000120_0
2010-03-06 07:54:42,604 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000120_0 -> (30, 22) from hd10.dfs.returnpath.net
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10053 dup hosts)
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: Read 2324947 bytes from map-output for attempt_201003060739_0002_m_000142_0
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000142_0 -> (26, 22) from hd27.dfs.returnpath.net
2010-03-06 07:54:42,605 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10086 dup hosts)
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: Read 3195710 bytes from map-output for attempt_201003060739_0002_m_000097_0
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000097_0 -> (31, 22) from hd11.dfs.returnpath.net
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000123_0, compressed len: 396591, decompressed len: 2758180
2010-03-06 07:54:42,609 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2758180 bytes (396591 raw bytes) into RAM from attempt_201003060739_0002_m_000123_0
2010-03-06 07:54:42,610 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10088 dup hosts)
2010-03-06 07:54:42,614 INFO org.apache.hadoop.mapred.ReduceTask: Read 3777993 bytes from map-output for attempt_201003060739_0002_m_000071_0
2010-03-06 07:54:42,614 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000071_0 -> (30, 22) from hd30.dfs.returnpath.net
2010-03-06 07:54:42,614 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10087 dup hosts)
2010-03-06 07:54:42,617 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000080_0, compressed len: 523298, decompressed len: 4097989
2010-03-06 07:54:42,617 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4097989 bytes (523298 raw bytes) into RAM from attempt_201003060739_0002_m_000080_0
2010-03-06 07:54:42,626 INFO org.apache.hadoop.mapred.ReduceTask: Read 2758180 bytes from map-output for attempt_201003060739_0002_m_000123_0
2010-03-06 07:54:42,626 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000123_0 -> (31, 22) from hd19.dfs.returnpath.net
2010-03-06 07:54:42,626 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10046 dup hosts)
2010-03-06 07:54:42,631 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000143_0, compressed len: 388643, decompressed len: 2446027
2010-03-06 07:54:42,631 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2446027 bytes (388643 raw bytes) into RAM from attempt_201003060739_0002_m_000143_0
2010-03-06 07:54:42,644 INFO org.apache.hadoop.mapred.ReduceTask: Read 4097989 bytes from map-output for attempt_201003060739_0002_m_000080_0
2010-03-06 07:54:42,644 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000080_0 -> (28, 22) from hd31.dfs.returnpath.net
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10128 dup hosts)
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: Read 2446027 bytes from map-output for attempt_201003060739_0002_m_000143_0
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000143_0 -> (31, 23) from hd21.dfs.returnpath.net
2010-03-06 07:54:42,645 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10069 dup hosts)
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000039_0, compressed len: 669462, decompressed len: 4758093
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4758093 bytes (669462 raw bytes) into RAM from attempt_201003060739_0002_m_000039_0
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000113_0, compressed len: 389815, decompressed len: 2892647
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000036_0, compressed len: 668943, decompressed len: 4668635
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4668635 bytes (668943 raw bytes) into RAM from attempt_201003060739_0002_m_000036_0
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000063_0, compressed len: 562154, decompressed len: 4544148
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2892647 bytes (389815 raw bytes) into RAM from attempt_201003060739_0002_m_000113_0
2010-03-06 07:54:42,937 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000078_0, compressed len: 414436, decompressed len: 3628087
2010-03-06 07:54:42,955 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3628087 bytes (414436 raw bytes) into RAM from attempt_201003060739_0002_m_000078_0
2010-03-06 07:54:42,955 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4544148 bytes (562154 raw bytes) into RAM from attempt_201003060739_0002_m_000063_0
2010-03-06 07:54:42,994 INFO org.apache.hadoop.mapred.ReduceTask: Read 3628087 bytes from map-output for attempt_201003060739_0002_m_000078_0
2010-03-06 07:54:42,995 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000078_0 -> (31, 22) from hd38.dfs.returnpath.net
2010-03-06 07:54:42,995 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10090 dup hosts)
2010-03-06 07:54:42,997 INFO org.apache.hadoop.mapred.ReduceTask: Read 4544148 bytes from map-output for attempt_201003060739_0002_m_000063_0
2010-03-06 07:54:42,997 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000063_0 -> (29, 22) from hd13.dfs.returnpath.net
2010-03-06 07:54:42,997 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10124 dup hosts)
2010-03-06 07:54:43,000 INFO org.apache.hadoop.mapred.ReduceTask: Read 4668635 bytes from map-output for attempt_201003060739_0002_m_000036_0
2010-03-06 07:54:43,000 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000036_0 -> (28, 22) from hd17.dfs.returnpath.net
2010-03-06 07:54:43,000 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10116 dup hosts)
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Read 4758093 bytes from map-output for attempt_201003060739_0002_m_000039_0
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000145_0, compressed len: 382166, decompressed len: 2521200
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2521200 bytes (382166 raw bytes) into RAM from attempt_201003060739_0002_m_000145_0
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000039_0 -> (28, 22) from hd33.dfs.returnpath.net
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000046_0, compressed len: 587827, decompressed len: 4415671
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10114 dup hosts)
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Read 2892647 bytes from map-output for attempt_201003060739_0002_m_000113_0
2010-03-06 07:54:43,001 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4415671 bytes (587827 raw bytes) into RAM from attempt_201003060739_0002_m_000046_0
2010-03-06 07:54:43,002 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000113_0 -> (31, 22) from hd20.dfs.returnpath.net
2010-03-06 07:54:43,020 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10065 dup hosts)
2010-03-06 07:54:43,023 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000047_0, compressed len: 600645, decompressed len: 4279480
2010-03-06 07:54:43,023 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4279480 bytes (600645 raw bytes) into RAM from attempt_201003060739_0002_m_000047_0
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000121_0, compressed len: 406002, decompressed len: 2801631
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2801631 bytes (406002 raw bytes) into RAM from attempt_201003060739_0002_m_000121_0
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000093_0, compressed len: 500298, decompressed len: 3648406
2010-03-06 07:54:43,026 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3648406 bytes (500298 raw bytes) into RAM from attempt_201003060739_0002_m_000093_0
2010-03-06 07:54:43,061 INFO org.apache.hadoop.mapred.ReduceTask: Read 2521200 bytes from map-output for attempt_201003060739_0002_m_000145_0
2010-03-06 07:54:43,061 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000145_0 -> (31, 22) from hd16.dfs.returnpath.net
2010-03-06 07:54:43,061 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10052 dup hosts)
2010-03-06 07:54:43,066 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000134_0, compressed len: 385962, decompressed len: 2577331
2010-03-06 07:54:43,066 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2577331 bytes (385962 raw bytes) into RAM from attempt_201003060739_0002_m_000134_0
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Read 4415671 bytes from map-output for attempt_201003060739_0002_m_000046_0
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Read 4279480 bytes from map-output for attempt_201003060739_0002_m_000047_0
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000046_0 -> (30, 22) from hd28.dfs.returnpath.net
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000047_0 -> (28, 24) from hd36.dfs.returnpath.net
2010-03-06 07:54:43,067 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 2 outputs (0 slow hosts and9465 dup hosts)
2010-03-06 07:54:43,068 INFO org.apache.hadoop.mapred.ReduceTask: Read 3648406 bytes from map-output for attempt_201003060739_0002_m_000093_0
2010-03-06 07:54:43,068 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000093_0 -> (30, 22) from hd37.dfs.returnpath.net
2010-03-06 07:54:43,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10037 dup hosts)
2010-03-06 07:54:43,074 INFO org.apache.hadoop.mapred.ReduceTask: Read 2801631 bytes from map-output for attempt_201003060739_0002_m_000121_0
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000121_0 -> (29, 26) from hd34.dfs.returnpath.net
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000129_0, compressed len: 373233, decompressed len: 2757140
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10077 dup hosts)
2010-03-06 07:54:43,075 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2757140 bytes (373233 raw bytes) into RAM from attempt_201003060739_0002_m_000129_0
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000135_0, compressed len: 342917, decompressed len: 2567595
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000094_0, compressed len: 378557, decompressed len: 3088969
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2567595 bytes (342917 raw bytes) into RAM from attempt_201003060739_0002_m_000135_0
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000077_0, compressed len: 477837, decompressed len: 4013422
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4013422 bytes (477837 raw bytes) into RAM from attempt_201003060739_0002_m_000077_0
2010-03-06 07:54:43,099 INFO org.apache.hadoop.mapred.ReduceTask: Read 2577331 bytes from map-output for attempt_201003060739_0002_m_000134_0
2010-03-06 07:54:43,100 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000134_0 -> (31, 22) from hd14.dfs.returnpath.net
2010-03-06 07:54:43,100 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10092 dup hosts)
2010-03-06 07:54:43,098 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3088969 bytes (378557 raw bytes) into RAM from attempt_201003060739_0002_m_000094_0
2010-03-06 07:54:43,137 INFO org.apache.hadoop.mapred.ReduceTask: Read 2567595 bytes from map-output for attempt_201003060739_0002_m_000135_0
2010-03-06 07:54:43,137 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000135_0 -> (28, 22) from hd27.dfs.returnpath.net
2010-03-06 07:54:43,138 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10070 dup hosts)
2010-03-06 07:54:43,140 INFO org.apache.hadoop.mapred.ReduceTask: Read 2757140 bytes from map-output for attempt_201003060739_0002_m_000129_0
2010-03-06 07:54:43,140 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000129_0 -> (29, 22) from hd10.dfs.returnpath.net
2010-03-06 07:54:43,140 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10035 dup hosts)
2010-03-06 07:54:43,145 INFO org.apache.hadoop.mapred.ReduceTask: Read 4013422 bytes from map-output for attempt_201003060739_0002_m_000077_0
2010-03-06 07:54:43,146 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000077_0 -> (31, 22) from hd30.dfs.returnpath.net
2010-03-06 07:54:43,146 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10071 dup hosts)
2010-03-06 07:54:43,151 INFO org.apache.hadoop.mapred.ReduceTask: Read 3088969 bytes from map-output for attempt_201003060739_0002_m_000094_0
2010-03-06 07:54:43,151 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000094_0 -> (31, 22) from hd11.dfs.returnpath.net
2010-03-06 07:54:43,151 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10070 dup hosts)
2010-03-06 07:54:43,154 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000072_0, compressed len: 622722, decompressed len: 3828178
2010-03-06 07:54:43,154 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3828178 bytes (622722 raw bytes) into RAM from attempt_201003060739_0002_m_000072_0
2010-03-06 07:54:43,167 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000060_0, compressed len: 588836, decompressed len: 5015957
2010-03-06 07:54:43,167 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5015957 bytes (588836 raw bytes) into RAM from attempt_201003060739_0002_m_000060_0
2010-03-06 07:54:43,170 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000115_0, compressed len: 410596, decompressed len: 3018449
2010-03-06 07:54:43,170 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3018449 bytes (410596 raw bytes) into RAM from attempt_201003060739_0002_m_000115_0
2010-03-06 07:54:43,170 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000048_0, compressed len: 647062, decompressed len: 4615345
2010-03-06 07:54:43,427 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4615345 bytes (647062 raw bytes) into RAM from attempt_201003060739_0002_m_000048_0
2010-03-06 07:54:43,427 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000110_0, compressed len: 433498, decompressed len: 2939207
2010-03-06 07:54:43,459 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2939207 bytes (433498 raw bytes) into RAM from attempt_201003060739_0002_m_000110_0
2010-03-06 07:54:43,460 INFO org.apache.hadoop.mapred.ReduceTask: Read 3828178 bytes from map-output for attempt_201003060739_0002_m_000072_0
2010-03-06 07:54:43,491 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000072_0 -> (30, 22) from hd38.dfs.returnpath.net
2010-03-06 07:54:43,491 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10076 dup hosts)
2010-03-06 07:54:43,495 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 152 new map-outputs
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: Read 3018449 bytes from map-output for attempt_201003060739_0002_m_000115_0
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000045_0, compressed len: 679831, decompressed len: 5702627
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5702627 bytes (679831 raw bytes) into RAM from attempt_201003060739_0002_m_000045_0
2010-03-06 07:54:43,499 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000115_0 -> (31, 22) from hd19.dfs.returnpath.net
2010-03-06 07:54:43,500 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10172 dup hosts)
2010-03-06 07:54:43,504 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000335_0, compressed len: 245324, decompressed len: 1097576
2010-03-06 07:54:43,504 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1097576 bytes (245324 raw bytes) into RAM from attempt_201003060739_0002_m_000335_0
2010-03-06 07:54:43,531 INFO org.apache.hadoop.mapred.ReduceTask: Read 2939207 bytes from map-output for attempt_201003060739_0002_m_000110_0
2010-03-06 07:54:43,531 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000110_0 -> (26, 24) from hd21.dfs.returnpath.net
2010-03-06 07:54:43,532 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts)
2010-03-06 07:54:43,535 INFO org.apache.hadoop.mapred.ReduceTask: Read 4615345 bytes from map-output for attempt_201003060739_0002_m_000048_0
2010-03-06 07:54:43,535 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000048_0 -> (27, 24) from hd13.dfs.returnpath.net
2010-03-06 07:54:43,535 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10252 dup hosts)
2010-03-06 07:54:43,537 INFO org.apache.hadoop.mapred.ReduceTask: Read 1097576 bytes from map-output for attempt_201003060739_0002_m_000335_0
2010-03-06 07:54:43,537 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000335_0 -> (31, 22) from hd33.dfs.returnpath.net
2010-03-06 07:54:43,537 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10243 dup hosts)
2010-03-06 07:54:43,539 INFO org.apache.hadoop.mapred.ReduceTask: Read 5015957 bytes from map-output for attempt_201003060739_0002_m_000060_0
2010-03-06 07:54:43,539 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000060_0 -> (26, 22) from hd31.dfs.returnpath.net
2010-03-06 07:54:43,540 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10251 dup hosts)
2010-03-06 07:54:43,540 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000065_0, compressed len: 435003, decompressed len: 4127846
2010-03-06 07:54:43,540 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4127846 bytes (435003 raw bytes) into RAM from attempt_201003060739_0002_m_000065_0
2010-03-06 07:54:43,544 INFO org.apache.hadoop.mapred.ReduceTask: Read 5702627 bytes from map-output for attempt_201003060739_0002_m_000045_0
2010-03-06 07:54:43,544 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000045_0 -> (31, 22) from hd17.dfs.returnpath.net
2010-03-06 07:54:43,545 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10242 dup hosts)
2010-03-06 07:54:43,548 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000109_0, compressed len: 334086, decompressed len: 2979814
2010-03-06 07:54:43,548 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2979814 bytes (334086 raw bytes) into RAM from attempt_201003060739_0002_m_000109_0
2010-03-06 07:54:43,759 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000103_0, compressed len: 472438, decompressed len: 3395785
2010-03-06 07:54:43,760 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000054_0, compressed len: 582801, decompressed len: 4047887
2010-03-06 07:54:43,760 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3395785 bytes (472438 raw bytes) into RAM from attempt_201003060739_0002_m_000103_0
2010-03-06 07:54:43,759 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000038_0, compressed len: 679731, decompressed len: 5003500
2010-03-06 07:54:43,760 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4047887 bytes (582801 raw bytes) into RAM from attempt_201003060739_0002_m_000054_0
2010-03-06 07:54:43,777 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5003500 bytes (679731 raw bytes) into RAM from attempt_201003060739_0002_m_000038_0
2010-03-06 07:54:43,797 INFO org.apache.hadoop.mapred.ReduceTask: Read 2979814 bytes from map-output for attempt_201003060739_0002_m_000109_0
2010-03-06 07:54:43,797 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000109_0 -> (28, 22) from hd16.dfs.returnpath.net
2010-03-06 07:54:43,797 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10180 dup hosts)
2010-03-06 07:54:43,798 INFO org.apache.hadoop.mapred.ReduceTask: Read 4127846 bytes from map-output for attempt_201003060739_0002_m_000065_0
2010-03-06 07:54:43,798 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000065_0 -> (27, 22) from hd28.dfs.returnpath.net
2010-03-06 07:54:43,798 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10178 dup hosts)
2010-03-06 07:54:43,801 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000149_0, compressed len: 402034, decompressed len: 2424085
2010-03-06 07:54:43,802 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2424085 bytes (402034 raw bytes) into RAM from attempt_201003060739_0002_m_000149_0
2010-03-06 07:54:43,806 INFO org.apache.hadoop.mapred.ReduceTask: Read 4047887 bytes from map-output for attempt_201003060739_0002_m_000054_0
2010-03-06 07:54:43,806 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000054_0 -> (30, 22) from hd37.dfs.returnpath.net
2010-03-06 07:54:43,806 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10166 dup hosts)
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000095_0, compressed len: 393676, decompressed len: 3250049
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3250049 bytes (393676 raw bytes) into RAM from attempt_201003060739_0002_m_000095_0
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: Read 2424085 bytes from map-output for attempt_201003060739_0002_m_000149_0
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000149_0 -> (31, 22) from hd14.dfs.returnpath.net
2010-03-06 07:54:43,810 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10222 dup hosts)
2010-03-06 07:54:43,811 INFO org.apache.hadoop.mapred.ReduceTask: Read 3395785 bytes from map-output for attempt_201003060739_0002_m_000103_0
2010-03-06 07:54:43,811 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000103_0 -> (29, 22) from hd20.dfs.returnpath.net
2010-03-06 07:54:43,811 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts)
2010-03-06 07:54:43,813 INFO org.apache.hadoop.mapred.ReduceTask: Read 5003500 bytes from map-output for attempt_201003060739_0002_m_000038_0
2010-03-06 07:54:43,813 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000038_0 -> (27, 22) from hd36.dfs.returnpath.net
2010-03-06 07:54:43,813 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10209 dup hosts)
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000043_0, compressed len: 682335, decompressed len: 4907967
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000070_0, compressed len: 431637, decompressed len: 4016204
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4016204 bytes (431637 raw bytes) into RAM from attempt_201003060739_0002_m_000070_0
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000139_0, compressed len: 412081, decompressed len: 2432814
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2432814 bytes (412081 raw bytes) into RAM from attempt_201003060739_0002_m_000139_0
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4907967 bytes (682335 raw bytes) into RAM from attempt_201003060739_0002_m_000043_0
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000126_0, compressed len: 420656, decompressed len: 2728620
2010-03-06 07:54:43,979 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2728620 bytes (420656 raw bytes) into RAM from attempt_201003060739_0002_m_000126_0
2010-03-06 07:54:43,993 INFO org.apache.hadoop.mapred.ReduceTask: Read 3250049 bytes from map-output for attempt_201003060739_0002_m_000095_0
2010-03-06 07:54:43,993 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000095_0 -> (31, 22) from hd34.dfs.returnpath.net
2010-03-06 07:54:43,993 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10203 dup hosts)
2010-03-06 07:54:44,000 INFO org.apache.hadoop.mapred.ReduceTask: Read 2728620 bytes from map-output for attempt_201003060739_0002_m_000126_0
2010-03-06 07:54:44,000 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000126_0 -> (31, 22) from hd10.dfs.returnpath.net
2010-03-06 07:54:44,000 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10163 dup hosts)
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000106_0, compressed len: 481712, decompressed len: 3530032
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3530032 bytes (481712 raw bytes) into RAM from attempt_201003060739_0002_m_000106_0
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: Read 2432814 bytes from map-output for attempt_201003060739_0002_m_000139_0
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000139_0 -> (29, 23) from hd27.dfs.returnpath.net
2010-03-06 07:54:44,003 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10196 dup hosts)
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Read 4016204 bytes from map-output for attempt_201003060739_0002_m_000070_0
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000070_0 -> (28, 22) from hd11.dfs.returnpath.net
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Read 4907967 bytes from map-output for attempt_201003060739_0002_m_000043_0
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10198 dup hosts)
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000043_0 -> (30, 22) from hd30.dfs.returnpath.net
2010-03-06 07:54:44,007 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10197 dup hosts)
2010-03-06 07:54:44,011 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000506_0, compressed len: 181306, decompressed len: 718179
2010-03-06 07:54:44,011 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 718179 bytes (181306 raw bytes) into RAM from attempt_201003060739_0002_m_000506_0
2010-03-06 07:54:44,015 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000033_0, compressed len: 699786, decompressed len: 5360652
2010-03-06 07:54:44,015 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5360652 bytes (699786 raw bytes) into RAM from attempt_201003060739_0002_m_000033_0
2010-03-06 07:54:44,028 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000165_0, compressed len: 335219, decompressed len: 2305914
2010-03-06 07:54:44,028 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2305914 bytes (335219 raw bytes) into RAM from attempt_201003060739_0002_m_000165_0
2010-03-06 07:54:44,028 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000037_0, compressed len: 692329, decompressed len: 4965738
2010-03-06 07:54:44,029 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4965738 bytes (692329 raw bytes) into RAM from attempt_201003060739_0002_m_000037_0
2010-03-06 07:54:44,033 INFO org.apache.hadoop.mapred.ReduceTask: Read 3530032 bytes from map-output for attempt_201003060739_0002_m_000106_0
2010-03-06 07:54:44,033 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000106_0 -> (29, 22) from hd19.dfs.returnpath.net
2010-03-06 07:54:44,033 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10156 dup hosts)
2010-03-06 07:54:44,035 INFO org.apache.hadoop.mapred.ReduceTask: Read 2305914 bytes from map-output for attempt_201003060739_0002_m_000165_0
2010-03-06 07:54:44,035 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000165_0 -> (31, 22) from hd21.dfs.returnpath.net
2010-03-06 07:54:44,035 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10172 dup hosts)
2010-03-06 07:54:44,047 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000034_0, compressed len: 731122, decompressed len: 5279297
2010-03-06 07:54:44,047 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5279297 bytes (731122 raw bytes) into RAM from attempt_201003060739_0002_m_000034_0
2010-03-06 07:54:44,058 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000055_0, compressed len: 576568, decompressed len: 4811086
2010-03-06 07:54:44,058 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4811086 bytes (576568 raw bytes) into RAM from attempt_201003060739_0002_m_000055_0
2010-03-06 07:54:44,059 INFO org.apache.hadoop.mapred.ReduceTask: Read 718179 bytes from map-output for attempt_201003060739_0002_m_000506_0
2010-03-06 07:54:44,059 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000506_0 -> (31, 24) from hd33.dfs.returnpath.net
2010-03-06 07:54:44,060 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10228 dup hosts)
2010-03-06 07:54:44,062 INFO org.apache.hadoop.mapred.ReduceTask: Read 4965738 bytes from map-output for attempt_201003060739_0002_m_000037_0
2010-03-06 07:54:44,062 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000037_0 -> (28, 24) from hd13.dfs.returnpath.net
2010-03-06 07:54:44,063 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10235 dup hosts)
2010-03-06 07:54:44,067 INFO org.apache.hadoop.mapred.ReduceTask: Read 5360652 bytes from map-output for attempt_201003060739_0002_m_000033_0
2010-03-06 07:54:44,067 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000033_0 -> (29, 22) from hd38.dfs.returnpath.net
2010-03-06 07:54:44,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10199 dup hosts)
2010-03-06 07:54:44,068 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000062_0, compressed len: 446401, decompressed len: 4264318
2010-03-06 07:54:44,069 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4264318 bytes (446401 raw bytes) into RAM from attempt_201003060739_0002_m_000062_0
2010-03-06 07:54:44,071 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000087_0, compressed len: 493666, decompressed len: 3877817
2010-03-06 07:54:44,071 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3877817 bytes (493666 raw bytes) into RAM from attempt_201003060739_0002_m_000087_0
2010-03-06 07:54:44,323 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000124_0, compressed len: 325072, decompressed len: 2794092
2010-03-06 07:54:44,323 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2794092 bytes (325072 raw bytes) into RAM from attempt_201003060739_0002_m_000124_0
2010-03-06 07:54:44,325 INFO org.apache.hadoop.mapred.ReduceTask: Read 4811086 bytes from map-output for attempt_201003060739_0002_m_000055_0
2010-03-06 07:54:44,325 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000055_0 -> (28, 22) from hd31.dfs.returnpath.net
2010-03-06 07:54:44,325 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10234 dup hosts)
2010-03-06 07:54:44,328 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000152_0, compressed len: 386585, decompressed len: 2362784
2010-03-06 07:54:44,328 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2362784 bytes (386585 raw bytes) into RAM from attempt_201003060739_0002_m_000152_0
2010-03-06 07:54:44,331 INFO org.apache.hadoop.mapred.ReduceTask: Read 2794092 bytes from map-output for attempt_201003060739_0002_m_000124_0
2010-03-06 07:54:44,331 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000124_0 -> (30, 22) from hd16.dfs.returnpath.net
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: Read 5279297 bytes from map-output for attempt_201003060739_0002_m_000034_0
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10164 dup hosts)
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000034_0 -> (30, 22) from hd17.dfs.returnpath.net
2010-03-06 07:54:44,332 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10224 dup hosts)
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Read 4264318 bytes from map-output for attempt_201003060739_0002_m_000062_0
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Read 3877817 bytes from map-output for attempt_201003060739_0002_m_000087_0
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000062_0 -> (28, 22) from hd28.dfs.returnpath.net
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000087_0 -> (30, 22) from hd37.dfs.returnpath.net
2010-03-06 07:54:44,334 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 2 outputs (0 slow hosts and9524 dup hosts)
2010-03-06 07:54:44,338 INFO org.apache.hadoop.mapred.ReduceTask: Read 2362784 bytes from map-output for attempt_201003060739_0002_m_000152_0
2010-03-06 07:54:44,338 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000152_0 -> (31, 24) from hd14.dfs.returnpath.net
2010-03-06 07:54:44,338 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10205 dup hosts)
2010-03-06 07:54:44,346 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000099_0, compressed len: 376129, decompressed len: 3001061
2010-03-06 07:54:44,346 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3001061 bytes (376129 raw bytes) into RAM from attempt_201003060739_0002_m_000099_0
2010-03-06 07:54:44,347 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000051_0, compressed len: 663744, decompressed len: 5480925
2010-03-06 07:54:44,347 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5480925 bytes (663744 raw bytes) into RAM from attempt_201003060739_0002_m_000051_0
2010-03-06 07:54:44,352 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000098_0, compressed len: 393809, decompressed len: 3243667
2010-03-06 07:54:44,352 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3243667 bytes (393809 raw bytes) into RAM from attempt_201003060739_0002_m_000098_0
2010-03-06 07:54:44,353 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000108_0, compressed len: 403609, decompressed len: 3017253
2010-03-06 07:54:44,353 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3017253 bytes (403609 raw bytes) into RAM from attempt_201003060739_0002_m_000108_0
2010-03-06 07:54:44,357 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000131_0, compressed len: 372289, decompressed len: 2736166
2010-03-06 07:54:44,357 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2736166 bytes (372289 raw bytes) into RAM from attempt_201003060739_0002_m_000131_0
2010-03-06 07:54:44,361 INFO org.apache.hadoop.mapred.ReduceTask: Read 3001061 bytes from map-output for attempt_201003060739_0002_m_000099_0
2010-03-06 07:54:44,361 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000099_0 -> (31, 22) from hd34.dfs.returnpath.net
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts)
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: Read 3243667 bytes from map-output for attempt_201003060739_0002_m_000098_0
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000098_0 -> (27, 22) from hd10.dfs.returnpath.net
2010-03-06 07:54:44,362 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10148 dup hosts)
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000083_0, compressed len: 493433, decompressed len: 3888726
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000075_0, compressed len: 411041, decompressed len: 3947538
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3888726 bytes (493433 raw bytes) into RAM from attempt_201003060739_0002_m_000083_0
2010-03-06 07:54:44,373 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3947538 bytes (411041 raw bytes) into RAM from attempt_201003060739_0002_m_000075_0
2010-03-06 07:54:44,375 INFO org.apache.hadoop.mapred.ReduceTask: Read 3017253 bytes from map-output for attempt_201003060739_0002_m_000108_0
2010-03-06 07:54:44,375 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000108_0 -> (30, 22) from hd20.dfs.returnpath.net
2010-03-06 07:54:44,376 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10169 dup hosts)
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Read 3947538 bytes from map-output for attempt_201003060739_0002_m_000075_0
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000075_0 -> (31, 22) from hd11.dfs.returnpath.net
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Read 3888726 bytes from map-output for attempt_201003060739_0002_m_000083_0
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10183 dup hosts)
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000083_0 -> (30, 22) from hd30.dfs.returnpath.net
2010-03-06 07:54:44,384 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10182 dup hosts)
2010-03-06 07:54:44,385 INFO org.apache.hadoop.mapred.ReduceTask: Read 5480925 bytes from map-output for attempt_201003060739_0002_m_000051_0
2010-03-06 07:54:44,385 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000051_0 -> (31, 22) from hd36.dfs.returnpath.net
2010-03-06 07:54:44,386 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts)
2010-03-06 07:54:44,390 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000027_0, compressed len: 249012, decompressed len: 8740634
2010-03-06 07:54:44,390 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 8740634 bytes (249012 raw bytes) into RAM from attempt_201003060739_0002_m_000027_0
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000052_0, compressed len: 597319, decompressed len: 5304225
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000114_0, compressed len: 430690, decompressed len: 3226138
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5304225 bytes (597319 raw bytes) into RAM from attempt_201003060739_0002_m_000052_0
2010-03-06 07:54:44,403 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3226138 bytes (430690 raw bytes) into RAM from attempt_201003060739_0002_m_000114_0
2010-03-06 07:54:44,421 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000074_0, compressed len: 417314, decompressed len: 3687377
2010-03-06 07:54:44,421 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3687377 bytes (417314 raw bytes) into RAM from attempt_201003060739_0002_m_000074_0
2010-03-06 07:54:44,425 INFO org.apache.hadoop.mapred.ReduceTask: Read 3226138 bytes from map-output for attempt_201003060739_0002_m_000114_0
2010-03-06 07:54:44,425 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000114_0 -> (31, 22) from hd21.dfs.returnpath.net
2010-03-06 07:54:44,425 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10157 dup hosts)
2010-03-06 07:54:44,426 INFO org.apache.hadoop.mapred.ReduceTask: Read 8740634 bytes from map-output for attempt_201003060739_0002_m_000027_0
2010-03-06 07:54:44,427 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000027_0 -> (30, 22) from hd33.dfs.returnpath.net
2010-03-06 07:54:44,427 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10213 dup hosts)
2010-03-06 07:54:44,428 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000057_0, compressed len: 574958, decompressed len: 4809270
2010-03-06 07:54:44,428 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4809270 bytes (574958 raw bytes) into RAM from attempt_201003060739_0002_m_000057_0
2010-03-06 07:54:44,431 INFO org.apache.hadoop.mapred.ReduceTask: Read 5304225 bytes from map-output for attempt_201003060739_0002_m_000052_0
2010-03-06 07:54:44,432 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000052_0 -> (26, 22) from hd13.dfs.returnpath.net
2010-03-06 07:54:44,432 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10220 dup hosts)
2010-03-06 07:54:44,436 INFO org.apache.hadoop.mapred.ReduceTask: Read 3687377 bytes from map-output for attempt_201003060739_0002_m_000074_0
2010-03-06 07:54:44,436 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000074_0 -> (30, 22) from hd19.dfs.returnpath.net
2010-03-06 07:54:44,436 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10137 dup hosts)
2010-03-06 07:54:44,439 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000229_0, compressed len: 331874, decompressed len: 1541274
2010-03-06 07:54:44,439 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1541274 bytes (331874 raw bytes) into RAM from attempt_201003060739_0002_m_000229_0
2010-03-06 07:54:44,441 INFO org.apache.hadoop.mapred.ReduceTask: Read 4809270 bytes from map-output for attempt_201003060739_0002_m_000057_0
2010-03-06 07:54:44,441 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000057_0 -> (28, 22) from hd38.dfs.returnpath.net
2010-03-06 07:54:44,441 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10183 dup hosts)
2010-03-06 07:54:44,457 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000044_0, compressed len: 631644, decompressed len: 4526587
2010-03-06 07:54:44,457 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000042_0, compressed len: 453682, decompressed len: 4582537
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4526587 bytes (631644 raw bytes) into RAM from attempt_201003060739_0002_m_000044_0
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000148_0, compressed len: 339516, decompressed len: 2404661
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4582537 bytes (453682 raw bytes) into RAM from attempt_201003060739_0002_m_000042_0
2010-03-06 07:54:44,458 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2404661 bytes (339516 raw bytes) into RAM from attempt_201003060739_0002_m_000148_0
2010-03-06 07:54:44,461 INFO org.apache.hadoop.mapred.ReduceTask: Read 1541274 bytes from map-output for attempt_201003060739_0002_m_000229_0
2010-03-06 07:54:44,461 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000229_0 -> (29, 24) from hd17.dfs.returnpath.net
2010-03-06 07:54:44,461 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10210 dup hosts)
2010-03-06 07:54:44,468 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000049_0, compressed len: 434703, decompressed len: 4549278
2010-03-06 07:54:44,468 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4549278 bytes (434703 raw bytes) into RAM from attempt_201003060739_0002_m_000049_0
2010-03-06 07:54:44,472 INFO org.apache.hadoop.mapred.ReduceTask: Read 4582537 bytes from map-output for attempt_201003060739_0002_m_000042_0
2010-03-06 07:54:44,472 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000042_0 -> (28, 22) from hd37.dfs.returnpath.net
2010-03-06 07:54:44,472 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10136 dup hosts)
2010-03-06 07:54:44,474 INFO org.apache.hadoop.mapred.ReduceTask: Read 4526587 bytes from map-output for attempt_201003060739_0002_m_000044_0
2010-03-06 07:54:44,474 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000044_0 -> (28, 22) from hd31.dfs.returnpath.net
2010-03-06 07:54:44,474 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10216 dup hosts)
2010-03-06 07:54:44,475 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000100_0, compressed len: 378728, decompressed len: 2993498
2010-03-06 07:54:44,475 INFO org.apache.hadoop.mapred.ReduceTask: Read 2404661 bytes from map-output for attempt_201003060739_0002_m_000148_0
2010-03-06 07:54:44,475 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2993498 bytes (378728 raw bytes) into RAM from attempt_201003060739_0002_m_000100_0
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000148_0 -> (30, 22) from hd16.dfs.returnpath.net
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000107_0, compressed len: 536132, decompressed len: 3925927
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3925927 bytes (536132 raw bytes) into RAM from attempt_201003060739_0002_m_000107_0
2010-03-06 07:54:44,494 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10146 dup hosts)
2010-03-06 07:54:44,499 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000101_0, compressed len: 457619, decompressed len: 3526411
2010-03-06 07:54:44,499 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3526411 bytes (457619 raw bytes) into RAM from attempt_201003060739_0002_m_000101_0
2010-03-06 07:54:44,503 INFO org.apache.hadoop.mapred.ReduceTask: Read 4549278 bytes from map-output for attempt_201003060739_0002_m_000049_0
2010-03-06 07:54:44,503 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000049_0 -> (29, 22) from hd28.dfs.returnpath.net
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10144 dup hosts)
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: Read 2993498 bytes from map-output for attempt_201003060739_0002_m_000100_0
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000100_0 -> (31, 22) from hd14.dfs.returnpath.net
2010-03-06 07:54:44,504 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10189 dup hosts)
2010-03-06 07:54:44,507 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000090_0, compressed len: 468872, decompressed len: 3517018
2010-03-06 07:54:44,507 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3517018 bytes (468872 raw bytes) into RAM from attempt_201003060739_0002_m_000090_0
2010-03-06 07:54:44,510 INFO org.apache.hadoop.mapred.ReduceTask: Read 3526411 bytes from map-output for attempt_201003060739_0002_m_000101_0
2010-03-06 07:54:44,510 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000101_0 -> (28, 22) from hd10.dfs.returnpath.net
2010-03-06 07:54:44,510 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10133 dup hosts)
2010-03-06 07:54:44,512 INFO org.apache.hadoop.mapred.ReduceTask: Read 3925927 bytes from map-output for attempt_201003060739_0002_m_000107_0
2010-03-06 07:54:44,512 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000107_0 -> (31, 22) from hd34.dfs.returnpath.net
2010-03-06 07:54:44,512 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10171 dup hosts)
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000029_0, compressed len: 796853, decompressed len: 7416176
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000105_0, compressed len: 437827, decompressed len: 3179052
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 7416176 bytes (796853 raw bytes) into RAM from attempt_201003060739_0002_m_000029_0
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000089_0, compressed len: 527790, decompressed len: 3989322
2010-03-06 07:54:44,700 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3179052 bytes (437827 raw bytes) into RAM from attempt_201003060739_0002_m_000105_0
2010-03-06 07:54:44,724 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3989322 bytes (527790 raw bytes) into RAM from attempt_201003060739_0002_m_000089_0
2010-03-06 07:54:44,728 INFO org.apache.hadoop.mapred.ReduceTask: Read 3517018 bytes from map-output for attempt_201003060739_0002_m_000090_0
2010-03-06 07:54:44,728 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000090_0 -> (30, 22) from hd11.dfs.returnpath.net
2010-03-06 07:54:44,728 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10168 dup hosts)
2010-03-06 07:54:44,735 INFO org.apache.hadoop.mapred.ReduceTask: Read 3179052 bytes from map-output for attempt_201003060739_0002_m_000105_0
2010-03-06 07:54:44,735 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000105_0 -> (31, 22) from hd20.dfs.returnpath.net
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10152 dup hosts)
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: Read 2736166 bytes from map-output for attempt_201003060739_0002_m_000131_0
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000131_0 -> (28, 22) from hd27.dfs.returnpath.net
2010-03-06 07:54:44,736 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10162 dup hosts)
2010-03-06 07:54:44,738 INFO org.apache.hadoop.mapred.ReduceTask: Read 3989322 bytes from map-output for attempt_201003060739_0002_m_000089_0
2010-03-06 07:54:44,738 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000089_0 -> (30, 22) from hd30.dfs.returnpath.net
2010-03-06 07:54:44,738 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10165 dup hosts)
2010-03-06 07:54:44,740 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000199_0, compressed len: 303132, decompressed len: 1685092
2010-03-06 07:54:44,740 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1685092 bytes (303132 raw bytes) into RAM from attempt_201003060739_0002_m_000199_0
2010-03-06 07:54:44,741 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000599_0, compressed len: 175609, decompressed len: 739834
2010-03-06 07:54:44,741 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 739834 bytes (175609 raw bytes) into RAM from attempt_201003060739_0002_m_000599_0
2010-03-06 07:54:44,744 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000141_0, compressed len: 395517, decompressed len: 2480855
2010-03-06 07:54:44,744 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2480855 bytes (395517 raw bytes) into RAM from attempt_201003060739_0002_m_000141_0
2010-03-06 07:54:44,745 WARN org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: Failed to create /hadoop.admin/tmp/mapred/local
2010-03-06 07:54:44,762 INFO org.apache.hadoop.mapred.ReduceTask: Read 739834 bytes from map-output for attempt_201003060739_0002_m_000599_0
2010-03-06 07:54:44,763 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000599_0 -> (30, 24) from hd33.dfs.returnpath.net
2010-03-06 07:54:44,763 INFO org.apache.hadoop.mapred.ReduceTask: Read 1685092 bytes from map-output for attempt_201003060739_0002_m_000199_0
2010-03-06 07:54:44,764 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000199_0 -> (26, 22) from hd13.dfs.returnpath.net
2010-03-06 07:54:44,764 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10198 dup hosts)
2010-03-06 07:54:44,764 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10205 dup hosts)
2010-03-06 07:54:44,808 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000085_0, compressed len: 396123, decompressed len: 3461041
2010-03-06 07:54:44,809 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3461041 bytes (396123 raw bytes) into RAM from attempt_201003060739_0002_m_000085_0
2010-03-06 07:54:44,814 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000267_0, compressed len: 133127, decompressed len: 1229110
2010-03-06 07:54:44,814 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1229110 bytes (133127 raw bytes) into RAM from attempt_201003060739_0002_m_000267_0
2010-03-06 07:54:44,819 INFO org.apache.hadoop.mapred.ReduceTask: Read 1229110 bytes from map-output for attempt_201003060739_0002_m_000267_0
2010-03-06 07:54:44,820 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000267_0 -> (28, 22) from hd17.dfs.returnpath.net
2010-03-06 07:54:44,820 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10197 dup hosts)
2010-03-06 07:54:44,821 INFO org.apache.hadoop.mapred.ReduceTask: Read 2480855 bytes from map-output for attempt_201003060739_0002_m_000141_0
2010-03-06 07:54:44,821 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000141_0 -> (26, 22) from hd21.dfs.returnpath.net
2010-03-06 07:54:44,821 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10138 dup hosts)
2010-03-06 07:54:44,822 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor
2010-03-06 07:54:44,824 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000050_0, compressed len: 453201, decompressed len: 4570821
2010-03-06 07:54:44,824 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4570821 bytes (453201 raw bytes) into RAM from attempt_201003060739_0002_m_000050_0
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: Read 7416176 bytes from map-output for attempt_201003060739_0002_m_000029_0
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000029_0 -> (27, 24) from hd36.dfs.returnpath.net
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000040_0, compressed len: 670246, decompressed len: 4732797
2010-03-06 07:54:44,825 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4732797 bytes (670246 raw bytes) into RAM from attempt_201003060739_0002_m_000040_0
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10167 dup hosts)
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: Read 3461041 bytes from map-output for attempt_201003060739_0002_m_000085_0
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000085_0 -> (31, 22) from hd19.dfs.returnpath.net
2010-03-06 07:54:44,826 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10119 dup hosts)
2010-03-06 07:54:44,827 INFO org.apache.hadoop.mapred.ReduceTask: Initiating in-memory merge with 77 segments...
2010-03-06 07:54:44,828 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000150_0, compressed len: 383803, decompressed len: 2452585
2010-03-06 07:54:44,828 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2452585 bytes (383803 raw bytes) into RAM from attempt_201003060739_0002_m_000150_0
2010-03-06 07:54:44,829 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000066_0, compressed len: 673867, decompressed len: 5205165
2010-03-06 07:54:44,830 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5205165 bytes (673867 raw bytes) into RAM from attempt_201003060739_0002_m_000066_0
2010-03-06 07:54:44,830 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000067_0, compressed len: 667750, decompressed len: 5138904
2010-03-06 07:54:44,830 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5138904 bytes (667750 raw bytes) into RAM from attempt_201003060739_0002_m_000067_0
2010-03-06 07:54:45,123 INFO org.apache.hadoop.mapred.Merger: Merging 77 sorted segments
2010-03-06 07:54:45,124 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 77 segments left of total size: 279004282 bytes
2010-03-06 07:54:45,129 INFO org.apache.hadoop.mapred.ReduceTask: Read 2452585 bytes from map-output for attempt_201003060739_0002_m_000150_0
2010-03-06 07:54:45,130 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000150_0 -> (31, 22) from hd16.dfs.returnpath.net
2010-03-06 07:54:45,130 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10132 dup hosts)
2010-03-06 07:54:45,132 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000144_0, compressed len: 381957, decompressed len: 2514288
2010-03-06 07:54:45,132 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2514288 bytes (381957 raw bytes) into RAM from attempt_201003060739_0002_m_000144_0
2010-03-06 07:54:45,136 INFO org.apache.hadoop.mapred.ReduceTask: Read 4570821 bytes from map-output for attempt_201003060739_0002_m_000050_0
2010-03-06 07:54:45,137 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000050_0 -> (28, 22) from hd31.dfs.returnpath.net
2010-03-06 07:54:45,137 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10200 dup hosts)
2010-03-06 07:54:45,140 INFO org.apache.hadoop.mapred.ReduceTask: Read 5138904 bytes from map-output for attempt_201003060739_0002_m_000067_0
2010-03-06 07:54:45,140 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000067_0 -> (31, 22) from hd37.dfs.returnpath.net
2010-03-06 07:54:45,140 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10118 dup hosts)
2010-03-06 07:54:45,141 INFO org.apache.hadoop.mapred.ReduceTask: Read 4732797 bytes from map-output for attempt_201003060739_0002_m_000040_0
2010-03-06 07:54:45,141 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000040_0 -> (29, 22) from hd38.dfs.returnpath.net
2010-03-06 07:54:45,141 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10162 dup hosts)
2010-03-06 07:54:45,143 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000064_0, compressed len: 427151, decompressed len: 4243953
2010-03-06 07:54:45,143 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4243953 bytes (427151 raw bytes) into RAM from attempt_201003060739_0002_m_000064_0
2010-03-06 07:54:45,166 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000035_0, compressed len: 711096, decompressed len: 5224180
2010-03-06 07:54:45,166 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5224180 bytes (711096 raw bytes) into RAM from attempt_201003060739_0002_m_000035_0
2010-03-06 07:54:45,168 INFO org.apache.hadoop.mapred.ReduceTask: Read 5205165 bytes from map-output for attempt_201003060739_0002_m_000066_0
2010-03-06 07:54:45,168 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000066_0 -> (31, 22) from hd28.dfs.returnpath.net
2010-03-06 07:54:45,168 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10127 dup hosts)
2010-03-06 07:54:45,171 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000086_0, compressed len: 497182, decompressed len: 3146262
2010-03-06 07:54:45,171 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3146262 bytes (497182 raw bytes) into RAM from attempt_201003060739_0002_m_000086_0
2010-03-06 07:54:45,178 INFO org.apache.hadoop.mapred.ReduceTask: Read 4243953 bytes from map-output for attempt_201003060739_0002_m_000064_0
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000064_0 -> (31, 22) from hd34.dfs.returnpath.net
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: Read 2514288 bytes from map-output for attempt_201003060739_0002_m_000144_0
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10156 dup hosts)
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000144_0 -> (31, 22) from hd14.dfs.returnpath.net
2010-03-06 07:54:45,179 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10171 dup hosts)
2010-03-06 07:54:45,183 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000136_0, compressed len: 377105, decompressed len: 2751049
2010-03-06 07:54:45,183 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2751049 bytes (377105 raw bytes) into RAM from attempt_201003060739_0002_m_000136_0
2010-03-06 07:54:45,184 INFO org.apache.hadoop.mapred.ReduceTask: Read 3146262 bytes from map-output for attempt_201003060739_0002_m_000086_0
2010-03-06 07:54:45,184 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000086_0 -> (29, 22) from hd20.dfs.returnpath.net
2010-03-06 07:54:45,184 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10137 dup hosts)
2010-03-06 07:54:45,189 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000642_0, compressed len: 316992, decompressed len: 1075927
2010-03-06 07:54:45,189 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1075927 bytes (316992 raw bytes) into RAM from attempt_201003060739_0002_m_000642_0
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000122_0, compressed len: 440683, decompressed len: 3064435
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000056_0, compressed len: 693118, decompressed len: 4400126
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4400126 bytes (693118 raw bytes) into RAM from attempt_201003060739_0002_m_000056_0
2010-03-06 07:54:45,486 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3064435 bytes (440683 raw bytes) into RAM from attempt_201003060739_0002_m_000122_0
2010-03-06 07:54:45,488 INFO org.apache.hadoop.mapred.ReduceTask: Read 1075927 bytes from map-output for attempt_201003060739_0002_m_000642_0
2010-03-06 07:54:45,488 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000642_0 -> (31, 26) from hd33.dfs.returnpath.net
2010-03-06 07:54:45,488 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10185 dup hosts)
2010-03-06 07:54:45,490 INFO org.apache.hadoop.mapred.ReduceTask: Read 5224180 bytes from map-output for attempt_201003060739_0002_m_000035_0
2010-03-06 07:54:45,490 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000035_0 -> (28, 26) from hd11.dfs.returnpath.net
2010-03-06 07:54:45,490 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10150 dup hosts)
2010-03-06 07:54:45,491 INFO org.apache.hadoop.mapred.ReduceTask: Read 2751049 bytes from map-output for attempt_201003060739_0002_m_000136_0
2010-03-06 07:54:45,492 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000136_0 -> (31, 22) from hd27.dfs.returnpath.net
2010-03-06 07:54:45,492 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10145 dup hosts)
2010-03-06 07:54:45,497 INFO org.apache.hadoop.mapred.ReduceTask: Read 3064435 bytes from map-output for attempt_201003060739_0002_m_000122_0
2010-03-06 07:54:45,498 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000122_0 -> (29, 22) from hd10.dfs.returnpath.net
2010-03-06 07:54:45,498 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10111 dup hosts)
2010-03-06 07:54:45,500 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000111_0, compressed len: 411355, decompressed len: 3044597
2010-03-06 07:54:45,500 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3044597 bytes (411355 raw bytes) into RAM from attempt_201003060739_0002_m_000111_0
2010-03-06 07:54:45,502 INFO org.apache.hadoop.mapred.ReduceTask: Read 4400126 bytes from map-output for attempt_201003060739_0002_m_000056_0
2010-03-06 07:54:45,502 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000056_0 -> (29, 24) from hd30.dfs.returnpath.net
2010-03-06 07:54:45,502 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10147 dup hosts)
2010-03-06 07:54:45,503 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000298_0, compressed len: 255296, decompressed len: 1104934
2010-03-06 07:54:45,503 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1104934 bytes (255296 raw bytes) into RAM from attempt_201003060739_0002_m_000298_0
2010-03-06 07:54:45,508 INFO org.apache.hadoop.mapred.ReduceTask: Read 1104934 bytes from map-output for attempt_201003060739_0002_m_000298_0
2010-03-06 07:54:45,508 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000298_0 -> (30, 26) from hd13.dfs.returnpath.net
2010-03-06 07:54:45,509 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10188 dup hosts)
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000076_0, compressed len: 369696, decompressed len: 3760271
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000096_0, compressed len: 496540, decompressed len: 3604111
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3760271 bytes (369696 raw bytes) into RAM from attempt_201003060739_0002_m_000076_0
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000201_0, compressed len: 324724, decompressed len: 2060091
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000163_0, compressed len: 365476, decompressed len: 2130748
2010-03-06 07:54:46,090 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2060091 bytes (324724 raw bytes) into RAM from attempt_201003060739_0002_m_000201_0
2010-03-06 07:54:46,089 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3604111 bytes (496540 raw bytes) into RAM from attempt_201003060739_0002_m_000096_0
2010-03-06 07:54:46,090 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2130748 bytes (365476 raw bytes) into RAM from attempt_201003060739_0002_m_000163_0
2010-03-06 07:54:46,103 INFO org.apache.hadoop.mapred.ReduceTask: Read 3044597 bytes from map-output for attempt_201003060739_0002_m_000111_0
2010-03-06 07:54:46,103 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000111_0 -> (29, 22) from hd36.dfs.returnpath.net
2010-03-06 07:54:46,103 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10152 dup hosts)
2010-03-06 07:54:46,109 INFO org.apache.hadoop.mapred.ReduceTask: Read 3760271 bytes from map-output for attempt_201003060739_0002_m_000076_0
2010-03-06 07:54:46,109 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000076_0 -> (28, 22) from hd16.dfs.returnpath.net
2010-03-06 07:54:46,109 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10118 dup hosts)
2010-03-06 07:54:46,113 INFO org.apache.hadoop.mapred.ReduceTask: Read 2130748 bytes from map-output for attempt_201003060739_0002_m_000163_0
2010-03-06 07:54:46,113 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000163_0 -> (29, 22) from hd21.dfs.returnpath.net
2010-03-06 07:54:46,114 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10120 dup hosts)
2010-03-06 07:54:46,117 INFO org.apache.hadoop.mapred.ReduceTask: Read 2060091 bytes from map-output for attempt_201003060739_0002_m_000201_0
2010-03-06 07:54:46,117 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000201_0 -> (29, 22) from hd17.dfs.returnpath.net
2010-03-06 07:54:46,118 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10177 dup hosts)
2010-03-06 07:54:46,119 INFO org.apache.hadoop.mapred.ReduceTask: Read 3604111 bytes from map-output for attempt_201003060739_0002_m_000096_0
2010-03-06 07:54:46,119 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000096_0 -> (30, 22) from hd19.dfs.returnpath.net
2010-03-06 07:54:46,120 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10101 dup hosts)
2010-03-06 07:54:46,125 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000117_0, compressed len: 442108, decompressed len: 3024337
2010-03-06 07:54:46,126 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3024337 bytes (442108 raw bytes) into RAM from attempt_201003060739_0002_m_000117_0
2010-03-06 07:54:46,131 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000179_0, compressed len: 331831, decompressed len: 1967778
2010-03-06 07:54:46,131 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1967778 bytes (331831 raw bytes) into RAM from attempt_201003060739_0002_m_000179_0
2010-03-06 07:54:46,138 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000079_0, compressed len: 525950, decompressed len: 4481022
2010-03-06 07:54:46,138 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4481022 bytes (525950 raw bytes) into RAM from attempt_201003060739_0002_m_000079_0
2010-03-06 07:54:46,391 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000082_0, compressed len: 388614, decompressed len: 3472789
2010-03-06 07:54:46,391 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000041_0, compressed len: 462721, decompressed len: 4692670
2010-03-06 07:54:46,392 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3472789 bytes (388614 raw bytes) into RAM from attempt_201003060739_0002_m_000082_0
2010-03-06 07:54:46,392 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4692670 bytes (462721 raw bytes) into RAM from attempt_201003060739_0002_m_000041_0
2010-03-06 07:54:46,399 INFO org.apache.hadoop.mapred.ReduceTask: Read 1967778 bytes from map-output for attempt_201003060739_0002_m_000179_0
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: Read 3024337 bytes from map-output for attempt_201003060739_0002_m_000117_0
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000179_0 -> (29, 22) from hd37.dfs.returnpath.net
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000117_0 -> (27, 22) from hd38.dfs.returnpath.net
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10102 dup hosts)
2010-03-06 07:54:46,400 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10146 dup hosts)
2010-03-06 07:54:46,412 INFO org.apache.hadoop.mapred.ReduceTask: Read 4692670 bytes from map-output for attempt_201003060739_0002_m_000041_0
2010-03-06 07:54:46,412 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000041_0 -> (29, 22) from hd31.dfs.returnpath.net
2010-03-06 07:54:46,412 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10181 dup hosts)
2010-03-06 07:54:46,416 INFO org.apache.hadoop.mapred.ReduceTask: Read 4481022 bytes from map-output for attempt_201003060739_0002_m_000079_0
2010-03-06 07:54:46,416 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000079_0 -> (30, 22) from hd28.dfs.returnpath.net
2010-03-06 07:54:46,416 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10110 dup hosts)
2010-03-06 07:54:46,425 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000116_0, compressed len: 437608, decompressed len: 3164252
2010-03-06 07:54:46,425 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3164252 bytes (437608 raw bytes) into RAM from attempt_201003060739_0002_m_000116_0
2010-03-06 07:54:46,431 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000171_0, compressed len: 354564, decompressed len: 2276135
2010-03-06 07:54:46,431 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2276135 bytes (354564 raw bytes) into RAM from attempt_201003060739_0002_m_000171_0
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000022_0, compressed len: 287169, decompressed len: 10333848
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000068_0, compressed len: 552362, decompressed len: 4466728
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 10333848 bytes (287169 raw bytes) into RAM from attempt_201003060739_0002_m_000022_0
2010-03-06 07:54:46,905 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4466728 bytes (552362 raw bytes) into RAM from attempt_201003060739_0002_m_000068_0
2010-03-06 07:54:46,909 INFO org.apache.hadoop.mapred.ReduceTask: Read 3472789 bytes from map-output for attempt_201003060739_0002_m_000082_0
2010-03-06 07:54:46,909 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000082_0 -> (29, 22) from hd34.dfs.returnpath.net
2010-03-06 07:54:46,910 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10139 dup hosts)
2010-03-06 07:54:46,915 INFO org.apache.hadoop.mapred.ReduceTask: Read 3164252 bytes from map-output for attempt_201003060739_0002_m_000116_0
2010-03-06 07:54:46,915 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000116_0 -> (29, 22) from hd20.dfs.returnpath.net
2010-03-06 07:54:46,915 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10121 dup hosts)
2010-03-06 07:54:46,917 INFO org.apache.hadoop.mapred.ReduceTask: Read 2276135 bytes from map-output for attempt_201003060739_0002_m_000171_0
2010-03-06 07:54:46,917 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000171_0 -> (31, 22) from hd14.dfs.returnpath.net
2010-03-06 07:54:46,918 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10153 dup hosts)
2010-03-06 07:54:46,930 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000112_0, compressed len: 439879, decompressed len: 3217070
2010-03-06 07:54:46,930 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3217070 bytes (439879 raw bytes) into RAM from attempt_201003060739_0002_m_000112_0
2010-03-06 07:54:46,932 INFO org.apache.hadoop.mapred.ReduceTask: Read 4466728 bytes from map-output for attempt_201003060739_0002_m_000068_0
2010-03-06 07:54:46,933 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000068_0 -> (29, 22) from hd11.dfs.returnpath.net
2010-03-06 07:54:46,934 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10134 dup hosts)
2010-03-06 07:54:46,935 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000118_0, compressed len: 430628, decompressed len: 3213259
2010-03-06 07:54:46,936 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3213259 bytes (430628 raw bytes) into RAM from attempt_201003060739_0002_m_000118_0
2010-03-06 07:54:46,937 INFO org.apache.hadoop.mapred.ReduceTask: Read 10333848 bytes from map-output for attempt_201003060739_0002_m_000022_0
2010-03-06 07:54:46,938 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000022_0 -> (30, 22) from hd33.dfs.returnpath.net
2010-03-06 07:54:46,938 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10167 dup hosts)
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000069_0, compressed len: 663932, decompressed len: 5097350
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000258_0, compressed len: 262692, decompressed len: 1320897
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 5097350 bytes (663932 raw bytes) into RAM from attempt_201003060739_0002_m_000069_0
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000031_0, compressed len: 202287, decompressed len: 6736732
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1320897 bytes (262692 raw bytes) into RAM from attempt_201003060739_0002_m_000258_0
2010-03-06 07:54:47,261 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 6736732 bytes (202287 raw bytes) into RAM from attempt_201003060739_0002_m_000031_0
2010-03-06 07:54:47,266 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 144 new map-outputs
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Read 3217070 bytes from map-output for attempt_201003060739_0002_m_000112_0
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000112_0 -> (29, 22) from hd27.dfs.returnpath.net
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Read 1320897 bytes from map-output for attempt_201003060739_0002_m_000258_0
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10264 dup hosts)
2010-03-06 07:54:47,735 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000258_0 -> (26, 22) from hd36.dfs.returnpath.net
2010-03-06 07:54:47,736 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10274 dup hosts)
2010-03-06 07:54:47,738 INFO org.apache.hadoop.mapred.ReduceTask: Read 3213259 bytes from map-output for attempt_201003060739_0002_m_000118_0
2010-03-06 07:54:47,738 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000118_0 -> (30, 22) from hd10.dfs.returnpath.net
2010-03-06 07:54:47,738 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10229 dup hosts)
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000081_0, compressed len: 469890, decompressed len: 3875947
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000133_0, compressed len: 384904, decompressed len: 2812800
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3875947 bytes (469890 raw bytes) into RAM from attempt_201003060739_0002_m_000081_0
2010-03-06 07:54:47,931 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 2812800 bytes (384904 raw bytes) into RAM from attempt_201003060739_0002_m_000133_0
2010-03-06 07:54:48,188 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000028_0, compressed len: 246012, decompressed len: 8497700
2010-03-06 07:54:48,188 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 8497700 bytes (246012 raw bytes) into RAM from attempt_201003060739_0002_m_000028_0
2010-03-06 07:54:49,150 INFO org.apache.hadoop.mapred.ReduceTask: Read 5097350 bytes from map-output for attempt_201003060739_0002_m_000069_0
2010-03-06 07:54:49,151 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000069_0 -> (31, 22) from hd30.dfs.returnpath.net
2010-03-06 07:54:49,151 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10265 dup hosts)
2010-03-06 07:54:49,391 INFO org.apache.hadoop.mapred.ReduceTask: Read 3875947 bytes from map-output for attempt_201003060739_0002_m_000081_0
2010-03-06 07:54:49,392 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201003060739_0002_m_000081_0 -> (31, 22) from hd16.dfs.returnpath.net
2010-03-06 07:54:49,392 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and10238 dup hosts)
2010-03-06 07:54:49,621 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000061_0, compressed len: 435311, decompressed len: 4191933
2010-03-06 07:54:49,621 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000202_0, compressed len: 295631, decompressed len: 1734546
2010-03-06 07:54:49,622 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 1734546 bytes (295631 raw bytes) into RAM from attempt_201003060739_0002_m_000202_0
2010-03-06 07:54:49,621 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 4191933 bytes (435311 raw bytes) into RAM from attempt_201003060739_0002_m_000061_0
2010-03-06 07:54:50,222 INFO org.apache.hadoop.mapred.ReduceTask: Task attempt_201003060739_0002_r_000000_0: Failed fetch #1 from attempt_201003060739_0002_m_000202_0
2010-03-06 07:54:50,223 WARN org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0 adding host hd37.dfs.returnpath.net to penalty box, next contact in 4 seconds
2010-03-06 07:54:50,223 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 1 map-outputs from previous failures
2010-03-06 07:54:50,223 FATAL org.apache.hadoop.mapred.TaskRunner: attempt_201003060739_0002_r_000000_0 : Map output copy failure : java.lang.OutOfMemoryError: Java heap space
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.shuffleInMemory(ReduceTask.java:1508)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1408)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1261)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1195)
2010-03-06 07:54:51,674 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: fs.default.name; Ignoring.
2010-03-06 07:54:51,728 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=CLEANUP, sessionId=
2010-03-06 07:54:51,814 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: fs.default.name; Ignoring.
2010-03-06 07:54:51,816 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2010-03-06 07:54:51,817 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2010-03-06 07:54:51,818 WARN org.apache.hadoop.conf.Configuration: /hadoop.data.0/tmp/mapred/local/taskTracker/jobcache/job_201003060739_0002/attempt_201003060739_0002_r_000000_0.cleanup/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2010-03-06 07:54:51,863 INFO org.apache.hadoop.mapred.TaskRunner: Runnning cleanup for the task
2010-03-06 07:54:51,866 INFO org.apache.hadoop.mapred.TaskRunner: Task:attempt_201003060739_0002_r_000000_0 is done. And is in the process of commiting
2010-03-06 07:54:51,872 INFO org.apache.hadoop.mapred.TaskRunner: Task 'attempt_201003060739_0002_r_000000_0' done.
2010-03-06 07:54:53,561 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201003060739_0002_m_000032_0, compressed len: 803639, decompressed len: 6022276
2010-03-06 07:54:53,564 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 6022276 bytes (803639 raw bytes) into RAM from attempt_201003060739_0002_m_000032_0
2010-03-06 07:54:53,564 WARN org.apache.hadoop.mapred.TaskRunner: Parent died. Exiting attempt_201003060739_0002_r_000000_0
2010-03-06 07:54:53,565 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201003060739_0002_r_000000_0: Got 152 new map-outputs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment