Skip to content

Instantly share code, notes, and snippets.

@miguno

miguno/gist:1190866

Created September 3, 2011 08:31
Show Gist options
  • Save miguno/1190866 to your computer and use it in GitHub Desktop.
Save miguno/1190866 to your computer and use it in GitHub Desktop.
Download ZIP
Brian K. Jones
Raw
gistfile1.txt
2011-09-02 14:54:19,733 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_m_000008_0 task’s state:UNASSIGNED
2011-09-02 14:54:19,733 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_m_000008_0 which needs 1 slots
2011-09-02 14:54:19,733 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201108251643_0006_m_000008_0 which needs 1 slots
2011-09-02 14:54:19,786 INFO org.apache.hadoop.mapred.JobLocalizer: Initializing user hadoop on this TT.
2011-09-02 14:54:19,878 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_m_-1954605197
2011-09-02 14:54:19,878 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_m_-1954605197 spawned.
2011-09-02 14:54:19,879 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643_0006/attempt_201108251643_0006_m_000008_0/taskjvm.sh
2011-09-02 14:54:20,403 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201108251643_0006_m_-1954605197 given task: attempt_201108251643_0006_m_000008_0
2011-09-02 14:54:23,858 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_m_000008_0 0.0% setup
2011-09-02 14:54:23,859 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_m_000008_0 is done.
2011-09-02 14:54:23,859 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201108251643_0006_m_000008_0 was -1
2011-09-02 14:54:23,859 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2011-09-02 14:54:24,017 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201108251643_0006_m_-1954605197 exited with exit code 0. Number of tasks it ran: 1
2011-09-02 14:54:25,743 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_m_000000_0 task’s state:UNASSIGNED
2011-09-02 14:54:25,743 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_m_000001_0 task’s state:UNASSIGNED
2011-09-02 14:54:25,743 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_m_000000_0 which needs 1 slots
2011-09-02 14:54:25,743 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201108251643_0006_m_000000_0 which needs 1 slots
2011-09-02 14:54:25,743 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201108251643_0006_m_000008_0
2011-09-02 14:54:25,743 INFO org.apache.hadoop.mapred.TaskTracker: About to purge task: attempt_201108251643_0006_m_000008_0
2011-09-02 14:54:25,743 INFO org.apache.hadoop.mapred.IndexCache: Map ID attempt_201108251643_0006_m_000008_0 not found in cache
2011-09-02 14:54:25,744 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_m_000001_0 which needs 1 slots
2011-09-02 14:54:25,744 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201108251643_0006_m_000001_0 which needs 1 slots
2011-09-02 14:54:25,745 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_m_1789581326
2011-09-02 14:54:25,745 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_m_1789581326 spawned.
2011-09-02 14:54:25,746 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_m_1264509168
2011-09-02 14:54:25,746 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_m_1264509168 spawned.
2011-09-02 14:54:25,747 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643_0006/attempt_201108251643_0006_m_000000_0/taskjvm.sh
2011-09-02 14:54:25,747 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643_0006/attempt_201108251643_0006_m_000001_0/taskjvm.sh
2011-09-02 14:54:26,276 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201108251643_0006_m_1789581326 given task: attempt_201108251643_0006_m_000000_0
2011-09-02 14:54:26,276 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201108251643_0006_m_1264509168 given task: attempt_201108251643_0006_m_000001_0
2011-09-02 14:54:29,737 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_m_000001_0 1.0%
2011-09-02 14:54:29,738 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_m_000001_0 is done.
2011-09-02 14:54:29,738 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201108251643_0006_m_000001_0 was 740452
2011-09-02 14:54:29,738 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1
2011-09-02 14:54:29,739 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_m_000000_0 1.0%
2011-09-02 14:54:29,740 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_m_000000_0 is done.
2011-09-02 14:54:29,740 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201108251643_0006_m_000000_0 was 807006
2011-09-02 14:54:29,740 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2011-09-02 14:54:29,912 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201108251643_0006_m_1789581326 exited with exit code 0. Number of tasks it ran: 1
2011-09-02 14:54:29,913 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201108251643_0006_m_1264509168 exited with exit code 0. Number of tasks it ran: 1
2011-09-02 14:54:31,757 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_m_000004_0 task’s state:UNASSIGNED
2011-09-02 14:54:31,758 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_m_000005_0 task’s state:UNASSIGNED
2011-09-02 14:54:31,758 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_m_000004_0 which needs 1 slots
2011-09-02 14:54:31,758 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_r_000000_0 task’s state:UNASSIGNED
2011-09-02 14:54:31,758 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201108251643_0006_m_000004_0 which needs 1 slots
2011-09-02 14:54:31,758 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_r_000000_0 which needs 1 slots
2011-09-02 14:54:31,758 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201108251643_0006_r_000000_0 which needs 1 slots
2011-09-02 14:54:31,758 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_m_000005_0 which needs 1 slots
2011-09-02 14:54:31,759 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201108251643_0006_m_000005_0 which needs 1 slots
2011-09-02 14:54:31,760 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_m_1112772055
2011-09-02 14:54:31,761 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_m_1112772055 spawned.
2011-09-02 14:54:31,761 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_m_-1810401375
2011-09-02 14:54:31,761 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_m_-1810401375 spawned.
2011-09-02 14:54:31,762 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_r_2047292160
2011-09-02 14:54:31,762 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_r_2047292160 spawned.
2011-09-02 14:54:31,763 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643_0006/attempt_201108251643_0006_m_000004_0/taskjvm.sh
2011-09-02 14:54:31,763 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643_0006/attempt_201108251643_0006_m_000005_0/taskjvm.sh
2011-09-02 14:54:31,763 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643_0006/attempt_201108251643_0006_r_000000_0/taskjvm.sh
2011-09-02 14:54:32,304 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201108251643_0006_r_2047292160 given task: attempt_201108251643_0006_r_000000_0
2011-09-02 14:54:32,309 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201108251643_0006_m_-1810401375 given task: attempt_201108251643_0006_m_000005_0
2011-09-02 14:54:32,311 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201108251643_0006_m_1112772055 given task: attempt_201108251643_0006_m_000004_0
2011-09-02 14:54:35,809 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_m_000005_0 1.0%
2011-09-02 14:54:35,810 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_m_000005_0 is done.
2011-09-02 14:54:35,810 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201108251643_0006_m_000005_0 was 252620
2011-09-02 14:54:35,810 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1
2011-09-02 14:54:35,826 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_m_000004_0 1.0%
2011-09-02 14:54:35,827 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_m_000004_0 is done.
2011-09-02 14:54:35,827 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201108251643_0006_m_000004_0 was 217654
2011-09-02 14:54:35,827 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2011-09-02 14:54:35,976 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201108251643_0006_m_-1810401375 exited with exit code 0. Number of tasks it ran: 1
2011-09-02 14:54:35,996 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201108251643_0006_m_1112772055 exited with exit code 0. Number of tasks it ran: 1
2011-09-02 14:54:38,086 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 127.0.0.1:50060, dest: 127.0.0.1:9782, bytes: 807006, op: MAPRED_SHUFFLE, cliID: attempt_201108251643_0006_m_000000_0, duration: 9621524
2011-09-02 14:54:38,097 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 127.0.0.1:50060, dest: 127.0.0.1:9784, bytes: 740452, op: MAPRED_SHUFFLE, cliID: attempt_201108251643_0006_m_000001_0, duration: 7262379
2011-09-02 14:54:38,863 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_r_000000_0 0.19047621% reduce > copy (4 of 7 at 0.36 MB/s) >
2011-09-02 14:54:41,866 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_r_000000_0 0.19047621% reduce > copy (4 of 7 at 0.36 MB/s) >
2011-09-02 14:54:43,105 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 127.0.0.1:50060, dest: 127.0.0.1:9785, bytes: 217654, op: MAPRED_SHUFFLE, cliID: attempt_201108251643_0006_m_000004_0, duration: 2454344
2011-09-02 14:54:43,108 INFO org.apache.hadoop.mapred.TaskTracker.clienttrace: src: 127.0.0.1:50060, dest: 127.0.0.1:9787, bytes: 252620, op: MAPRED_SHUFFLE, cliID: attempt_201108251643_0006_m_000005_0, duration: 1682488
2011-09-02 14:54:43,917 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_r_000000_0 0.19047621% reduce > copy (4 of 7 at 0.36 MB/s) >
2011-09-02 14:54:44,270 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_r_000000_0 0.19047621% reduce > copy (4 of 7 at 0.36 MB/s) >
2011-09-02 14:54:44,840 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2011-09-02 14:54:44,840 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_r_000000_0 0.19047621% reduce > copy (4 of 7 at 0.36 MB/s) >
2011-09-02 14:54:46,775 INFO org.apache.hadoop.mapred.TaskTracker: Received commit task action for attempt_201108251643_0006_r_000000_0
2011-09-02 14:54:47,872 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_r_000000_0 1.0% reduce > reduce
2011-09-02 14:54:47,874 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_r_000000_0 1.0% reduce > reduce
2011-09-02 14:54:47,875 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_r_000000_0 is done.
2011-09-02 14:54:47,875 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201108251643_0006_r_000000_0 was -1
2011-09-02 14:54:47,875 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2011-09-02 14:54:47,926 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201108251643_0006_r_2047292160 exited with exit code 0. Number of tasks it ran: 1
2011-09-02 14:54:49,784 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_m_000007_0 task’s state:UNASSIGNED
2011-09-02 14:54:49,784 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_m_000007_0 which needs 1 slots
2011-09-02 14:54:49,784 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201108251643_0006_m_000007_0 which needs 1 slots
2011-09-02 14:54:49,784 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201108251643_0006_r_000000_0
2011-09-02 14:54:49,785 INFO org.apache.hadoop.mapred.TaskTracker: About to purge task: attempt_201108251643_0006_r_000000_0
2011-09-02 14:54:49,786 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_m_-759776390
2011-09-02 14:54:49,786 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_m_-759776390 spawned.
2011-09-02 14:54:49,787 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643_0006/attempt_201108251643_0006_m_000007_0/taskjvm.sh
2011-09-02 14:54:50,310 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201108251643_0006_m_-759776390 given task: attempt_201108251643_0006_m_000007_0
2011-09-02 14:54:50,759 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_m_000007_0 0.0%
2011-09-02 14:54:53,754 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201108251643_0006_m_000007_0 0.0% cleanup
2011-09-02 14:54:53,755 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201108251643_0006_m_000007_0 is done.
2011-09-02 14:54:53,756 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201108251643_0006_m_000007_0 was -1
2011-09-02 14:54:53,756 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2011-09-02 14:54:53,913 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201108251643_0006_m_-759776390 exited with exit code 0. Number of tasks it ran: 1
2011-09-02 14:54:55,808 INFO org.apache.hadoop.mapred.TaskTracker: Received ‘KillJobAction’ for job: job_201108251643_0006
2011-09-02 14:54:55,808 INFO org.apache.hadoop.mapred.IndexCache: Map ID attempt_201108251643_0006_m_000007_0 not found in cache
2011-09-02 14:54:55,809 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201108251643_0006 for user-log deletion with retainTimeStamp:1315076095809
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment