Skip to content

Instantly share code, notes, and snippets.

@kawamon
Created November 14, 2013 03:54
Show Gist options
  • Save kawamon/7461079 to your computer and use it in GitHub Desktop.
Save kawamon/7461079 to your computer and use it in GitHub Desktop.
MapReduceのReduceでのログ (TT)
2013-11-13 19:10:34,998 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:10:34,998 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:10:34,998 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_m_000002_0 task's state:UNASSIGNED
2013-11-13 19:10:34,999 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_m_000003_0 task's state:UNASSIGNED
2013-11-13 19:10:34,999 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_m_000002_0 which needs 1 slots
2013-11-13 19:10:34,999 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201311131900_0003_m_000002_0 which needs 1 slots
2013-11-13 19:10:35,058 INFO org.apache.hadoop.mapred.JobLocalizer: Initializing user training on this TT.
2013-11-13 19:10:35,227 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_m_000003_0 which needs 1 slots
2013-11-13 19:10:35,227 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201311131900_0003_m_000003_0 which needs 1 slots
2013-11-13 19:10:35,289 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_m_467440510
2013-11-13 19:10:35,292 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_m_467440510 spawned.
2013-11-13 19:10:35,292 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_m_103935889
2013-11-13 19:10:35,294 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_m_103935889 spawned.
2013-11-13 19:10:35,297 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk1/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_m_000003_0/taskjvm.sh
2013-11-13 19:10:35,301 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk2/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_m_000002_0/taskjvm.sh
2013-11-13 19:10:38,806 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_m_467440510 given task: attempt_201311131900_0003_m_000003_0
2013-11-13 19:10:38,839 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_m_103935889 given task: attempt_201311131900_0003_m_000002_0
2013-11-13 19:10:48,846 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.08962435%
2013-11-13 19:10:48,889 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.0981239%
2013-11-13 19:10:52,005 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.20174637%
2013-11-13 19:10:52,023 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.21141987%
2013-11-13 19:10:55,195 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.3209753%
2013-11-13 19:10:55,221 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.32367626%
2013-11-13 19:10:58,294 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.45412695%
2013-11-13 19:10:58,326 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.44939786%
2013-11-13 19:11:01,406 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.5829881%
2013-11-13 19:11:01,440 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.5871207%
2013-11-13 19:11:04,549 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.7105595%
2013-11-13 19:11:04,614 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.7117935%
2013-11-13 19:11:06,260 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:11:06,260 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_r_000002_0 task's state:UNASSIGNED
2013-11-13 19:11:06,261 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_r_000002_0 which needs 1 slots
2013-11-13 19:11:06,261 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201311131900_0003_r_000002_0 which needs 1 slots
2013-11-13 19:11:06,366 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_r_-2144537224
2013-11-13 19:11:06,367 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_r_-2144537224 spawned.
2013-11-13 19:11:06,376 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk1/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_r_000002_0/taskjvm.sh
2013-11-13 19:11:07,709 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.80139005%
2013-11-13 19:11:07,807 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.8114679%
2013-11-13 19:11:10,964 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.8845954%
2013-11-13 19:11:11,050 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.89932466%
2013-11-13 19:11:11,885 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_r_-2144537224 given task: attempt_201311131900_0003_r_000002_0
2013-11-13 19:11:14,134 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.9351196%
2013-11-13 19:11:14,235 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.9499217%
2013-11-13 19:11:16,720 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 0.9499217%
2013-11-13 19:11:17,195 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.99999875%
2013-11-13 19:11:17,225 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 0.99999875%
2013-11-13 19:11:17,285 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 1.0%
2013-11-13 19:11:20,373 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 1.0%
2013-11-13 19:11:20,407 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 1.0%
2013-11-13 19:11:20,661 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000003_0 1.0%
2013-11-13 19:11:20,661 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201311131900_0003_m_000003_0 is done.
2013-11-13 19:11:20,661 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201311131900_0003_m_000003_0 was 10746648
2013-11-13 19:11:20,662 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1
2013-11-13 19:11:20,842 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000002_0 1.0%
2013-11-13 19:11:20,843 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201311131900_0003_m_000002_0 is done.
2013-11-13 19:11:20,843 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201311131900_0003_m_000002_0 was 9247715
2013-11-13 19:11:20,843 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2013-11-13 19:11:20,931 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_m_103935889 exited with exit code 0. Number of tasks it ran: 1
2013-11-13 19:11:20,932 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_m_467440510 exited with exit code 0. Number of tasks it ran: 1
2013-11-13 19:11:21,262 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.1:60683, bytes: 2689235, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000003_0, duration: 21534808
2013-11-13 19:11:21,409 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.2:53590, bytes: 2690857, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000003_0, duration: 59910324
2013-11-13 19:11:21,451 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.2:53590, bytes: 2315061, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000002_0, duration: 34867962
2013-11-13 19:11:21,579 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.3:49421, bytes: 2690903, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000003_0, duration: 59873937
2013-11-13 19:11:21,677 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.3:49421, bytes: 2357997, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000002_0, duration: 82520910
2013-11-13 19:11:22,318 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.1:60684, bytes: 2288386, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000002_0, duration: 75592548
2013-11-13 19:11:22,337 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000002_0 0.0%
2013-11-13 19:11:22,845 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000002_0 0.33333334% reduce > sort
2013-11-13 19:11:24,267 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000002_0 0.33333334% reduce > sort
2013-11-13 19:11:25,887 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000002_0 0.80448055% reduce > reduce
2013-11-13 19:11:28,907 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000002_0 0.80448055% reduce > reduce
2013-11-13 19:11:34,644 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.2:53600, bytes: 2675653, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000003_0, duration: 99820335
2013-11-13 19:11:36,724 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.2:53601, bytes: 2286271, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000002_0, duration: 72251124
2013-11-13 19:12:28,881 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201311131900_0003_r_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-11-13 19:12:28,881 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000002_0 0.80448055% reduce > reduce
2013-11-13 19:12:29,049 INFO org.apache.hadoop.mapred.TaskTracker: Received commit task action for attempt_201311131900_0003_r_000002_0
2013-11-13 19:12:29,909 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000002_0 1.0% reduce > reduce
2013-11-13 19:12:29,909 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201311131900_0003_r_000002_0 is done.
2013-11-13 19:12:29,909 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201311131900_0003_r_000002_0 was -1
2013-11-13 19:12:29,910 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2013-11-13 19:12:29,937 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_r_-2144537224 exited with exit code 0. Number of tasks it ran: 1
2013-11-13 19:12:29,956 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201311131900_0003_r_000002_0
2013-11-13 19:12:29,956 INFO org.apache.hadoop.mapred.TaskTracker: About to purge task: attempt_201311131900_0003_r_000002_0
2013-11-13 19:24:12,559 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:24:12,559 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_r_000000_0 task's state:KILLED_UNCLEAN
2013-11-13 19:24:12,559 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_r_000000_0 which needs 1 slots
2013-11-13 19:24:12,560 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201311131900_0003_r_000000_0 which needs 1 slots
2013-11-13 19:24:12,601 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_r_467440510
2013-11-13 19:24:12,601 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_r_467440510 spawned.
2013-11-13 19:24:12,602 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk2/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_r_000000_0.cleanup/taskjvm.sh
2013-11-13 19:24:13,164 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:24:13,165 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_m_000005_2 task's state:UNASSIGNED
2013-11-13 19:24:13,165 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_m_000005_2 which needs 1 slots
2013-11-13 19:24:13,165 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201311131900_0003_m_000005_2 which needs 1 slots
2013-11-13 19:24:13,211 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_m_-2061551255
2013-11-13 19:24:13,214 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_m_-2061551255 spawned.
2013-11-13 19:24:13,217 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk1/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_m_000005_2/taskjvm.sh
2013-11-13 19:24:15,376 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_r_467440510 given task: attempt_201311131900_0003_r_000000_0
2013-11-13 19:24:16,847 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_m_-2061551255 given task: attempt_201311131900_0003_m_000005_2
2013-11-13 19:24:19,460 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_0 0.0%
2013-11-13 19:24:19,608 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_0 0.0% cleanup
2013-11-13 19:24:19,609 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201311131900_0003_r_000000_0 is done.
2013-11-13 19:24:19,609 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201311131900_0003_r_000000_0 was -1
2013-11-13 19:24:19,610 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2013-11-13 19:24:19,668 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_r_467440510 exited with exit code 0. Number of tasks it ran: 1
2013-11-13 19:24:19,823 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:24:19,824 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_r_000000_2 task's state:UNASSIGNED
2013-11-13 19:24:19,824 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_r_000000_2 which needs 1 slots
2013-11-13 19:24:19,824 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201311131900_0003_r_000000_2 which needs 1 slots
2013-11-13 19:24:19,857 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_r_103935889
2013-11-13 19:24:19,857 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_r_103935889 spawned.
2013-11-13 19:24:19,866 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk2/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_r_000000_2/taskjvm.sh
2013-11-13 19:24:23,074 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_r_103935889 given task: attempt_201311131900_0003_r_000000_2
2013-11-13 19:24:25,926 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000005_2 0.05833295%
2013-11-13 19:24:27,803 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.1:60711, bytes: 2675653, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000003_0, duration: 227301222
2013-11-13 19:24:28,094 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 192.168.123.1:50060, dest: 192.168.123.1:60711, bytes: 2286271, op: MAPRED_SHUFFLE, cliID: attempt_201311131900_0003_m_000002_0, duration: 26660935
2013-11-13 19:24:28,989 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000005_2 0.23077945%
2013-11-13 19:24:32,056 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000005_2 0.57476914%
2013-11-13 19:24:32,790 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_2 0.2916667% reduce > copy (7 of 8 at 4.93 MB/s) >
2013-11-13 19:24:33,461 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201311131900_0003_m_000005_2
2013-11-13 19:24:33,461 INFO org.apache.hadoop.mapred.TaskTracker: About to purge task: attempt_201311131900_0003_m_000005_2
2013-11-13 19:24:33,495 INFO org.apache.hadoop.util.ProcessTree: Killing process group24511 with signal TERM. Exit code 0
2013-11-13 19:24:33,495 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2013-11-13 19:24:33,495 INFO org.apache.hadoop.mapred.IndexCache: Map ID attempt_201311131900_0003_m_000005_2 not found in cache
2013-11-13 19:24:33,543 WARN org.apache.hadoop.mapred.DefaultTaskController: Exit code from task is : 143
2013-11-13 19:24:33,543 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_m_-2061551255 exited with exit code 143. Number of tasks it ran: 0
2013-11-13 19:24:33,763 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:24:33,763 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_m_000005_2 task's state:KILLED_UNCLEAN
2013-11-13 19:24:33,764 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_m_000005_2 which needs 1 slots
2013-11-13 19:24:33,764 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201311131900_0003_m_000005_2 which needs 1 slots
2013-11-13 19:24:33,840 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_m_-410756370
2013-11-13 19:24:33,840 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_m_-410756370 spawned.
2013-11-13 19:24:33,842 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk1/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_m_000005_2.cleanup/taskjvm.sh
2013-11-13 19:24:33,938 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_2 0.2916667% reduce > copy (7 of 8 at 4.93 MB/s) >
2013-11-13 19:24:36,375 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_2 0.2916667% reduce > copy (7 of 8 at 4.93 MB/s) >
2013-11-13 19:24:37,386 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_m_-410756370 given task: attempt_201311131900_0003_m_000005_2
2013-11-13 19:24:38,998 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_2 0.73245287% reduce > reduce
2013-11-13 19:24:40,728 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201311131900_0003_r_000000_2
2013-11-13 19:24:40,728 INFO org.apache.hadoop.mapred.TaskTracker: About to purge task: attempt_201311131900_0003_r_000000_2
2013-11-13 19:24:40,762 INFO org.apache.hadoop.util.ProcessTree: Killing process group24590 with signal TERM. Exit code 0
2013-11-13 19:24:40,763 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2013-11-13 19:24:40,842 WARN org.apache.hadoop.mapred.DefaultTaskController: Exit code from task is : 143
2013-11-13 19:24:40,842 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_r_103935889 exited with exit code 143. Number of tasks it ran: 0
2013-11-13 19:24:41,031 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2013-11-13 19:24:41,031 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311131900_0003_r_000000_2 task's state:KILLED_UNCLEAN
2013-11-13 19:24:41,031 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311131900_0003_r_000000_2 which needs 1 slots
2013-11-13 19:24:41,031 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201311131900_0003_r_000000_2 which needs 1 slots
2013-11-13 19:24:41,096 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311131900_0003_r_-2061551255
2013-11-13 19:24:41,101 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311131900_0003_r_-2061551255 spawned.
2013-11-13 19:24:41,106 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /disk1/mapred/local/ttprivate/taskTracker/training/jobcache/job_201311131900_0003/attempt_201311131900_0003_r_000000_2.cleanup/taskjvm.sh
2013-11-13 19:24:41,146 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000005_2 0.0%
2013-11-13 19:24:41,281 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_m_000005_2 0.0% cleanup
2013-11-13 19:24:41,281 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201311131900_0003_m_000005_2 is done.
2013-11-13 19:24:41,281 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201311131900_0003_m_000005_2 was -1
2013-11-13 19:24:41,282 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2013-11-13 19:24:41,337 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_m_-410756370 exited with exit code 0. Number of tasks it ran: 1
2013-11-13 19:24:42,692 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311131900_0003_r_-2061551255 given task: attempt_201311131900_0003_r_000000_2
2013-11-13 19:24:44,415 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_2 0.0%
2013-11-13 19:24:44,498 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311131900_0003_r_000000_2 0.0% cleanup
2013-11-13 19:24:44,499 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201311131900_0003_r_000000_2 is done.
2013-11-13 19:24:44,499 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201311131900_0003_r_000000_2 was -1
2013-11-13 19:24:44,499 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2013-11-13 19:24:44,537 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311131900_0003_r_-2061551255 exited with exit code 0. Number of tasks it ran: 1
2013-11-13 19:24:47,294 INFO org.apache.hadoop.mapred.TaskTracker: Received 'KillJobAction' for job: job_201311131900_0003
2013-11-13 19:24:47,295 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201311131900_0003 for user-log deletion with retainTimeStamp:1384475087295
2013-11-13 22:52:42,642 INFO logs: Aliases are enabled
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment