Skip to content

Instantly share code, notes, and snippets.

@kawamon

kawamon/gist:5459146

Created April 25, 2013 11:42
Show Gist options
  • Save kawamon/5459146 to your computer and use it in GitHub Desktop.
Save kawamon/5459146 to your computer and use it in GitHub Desktop.
Download ZIP
MapReduceで途中でディスクフルになった場合のログ（CDH4)
Raw
gistfile1.txt
[training@localhost ~]$ hadoop jar /usr/lib/hadoop-0.20-mapreduce/hadoop-examples.jar wordcount 1G output2
13/04/25 07:35:54 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/04/25 07:35:55 INFO input.FileInputFormat: Total input paths to process : 1
13/04/25 07:35:55 WARN snappy.LoadSnappy: Snappy native library is available
13/04/25 07:35:55 INFO snappy.LoadSnappy: Snappy native library loaded
13/04/25 07:35:55 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
13/04/25 07:35:55 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 477079631bb6c2b47f15140548e2c0f4efa6996f]
13/04/25 07:35:55 INFO mapred.JobClient: Running job: job_201304250735_0001
13/04/25 07:35:56 INFO mapred.JobClient: map 0% reduce 0%
13/04/25 07:36:07 INFO mapred.JobClient: map 5% reduce 0%
13/04/25 07:36:10 INFO mapred.JobClient: map 8% reduce 0%
13/04/25 07:36:13 INFO mapred.JobClient: map 12% reduce 0%
13/04/25 07:36:17 INFO mapred.JobClient: map 13% reduce 0%
13/04/25 07:36:30 INFO mapred.JobClient: map 19% reduce 0%
13/04/25 07:36:33 INFO mapred.JobClient: map 21% reduce 0%
13/04/25 07:36:37 INFO mapred.JobClient: map 23% reduce 0%
13/04/25 07:36:40 INFO mapred.JobClient: map 26% reduce 0%
13/04/25 07:36:47 INFO mapred.JobClient: map 13% reduce 0%
13/04/25 07:36:49 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000002_0, Status : FAILED
FSError: java.io.IOException: No space left on device
attempt_201304250735_0001_m_000002_0: log4j:ERROR Failed to flush writer,
attempt_201304250735_0001_m_000002_0: java.io.IOException: No space left on device
13/04/25 07:36:49 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000003_0, Status : FAILED
FSError: java.io.IOException: No space left on device
13/04/25 07:36:59 INFO mapred.JobClient: map 19% reduce 0%
13/04/25 07:37:02 INFO mapred.JobClient: map 23% reduce 0%
13/04/25 07:37:05 INFO mapred.JobClient: map 26% reduce 0%
13/04/25 07:37:11 INFO mapred.JobClient: map 13% reduce 0%
13/04/25 07:37:12 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000002_1, Status : FAILED
FSError: java.io.IOException: No space left on device
attempt_201304250735_0001_m_000002_1: log4j:ERROR Failed to flush writer,
attempt_201304250735_0001_m_000002_1: java.io.IOException: No space left on device
13/04/25 07:37:13 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000003_1, Status : FAILED
FSError: java.io.IOException: No space left on device
13/04/25 07:37:21 INFO mapred.JobClient: map 16% reduce 0%
13/04/25 07:37:22 INFO mapred.JobClient: map 19% reduce 0%
13/04/25 07:37:25 INFO mapred.JobClient: map 23% reduce 0%
13/04/25 07:37:28 INFO mapred.JobClient: map 26% reduce 0%
13/04/25 07:37:33 INFO mapred.JobClient: map 13% reduce 0%
13/04/25 07:37:34 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000002_2, Status : FAILED
FSError: java.io.IOException: No space left on device
13/04/25 07:37:34 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000003_2, Status : FAILED
FSError: java.io.IOException: No space left on device
13/04/25 07:37:44 INFO mapred.JobClient: map 20% reduce 0%
13/04/25 07:37:47 INFO mapred.JobClient: map 23% reduce 0%
13/04/25 07:37:50 INFO mapred.JobClient: map 25% reduce 0%
13/04/25 07:37:53 INFO mapred.JobClient: map 26% reduce 0%
13/04/25 07:37:57 INFO mapred.JobClient: map 13% reduce 0%
13/04/25 07:38:04 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000015_0, Status : FAILED
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot delete /user/training/output2/_temporary. Name node is in safe mode.
Resources are low on NN. Safe mode must be turned off manually.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:2673)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInt(FSNamesystem.java:2643)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2626)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:612)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:406)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44094)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
at org.apache.
13/04/25 07:38:09 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000015_1, Status : FAILED
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot delete /user/training/output2/_temporary. Name node is in safe mode.
Resources are low on NN. Safe mode must be turned off manually.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:2673)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInt(FSNamesystem.java:2643)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2626)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:612)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:406)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44094)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
at org.apache.
13/04/25 07:38:13 INFO mapred.JobClient: Task Id : attempt_201304250735_0001_m_000015_2, Status : FAILED
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot delete /user/training/output2/_temporary. Name node is in safe mode.
Resources are low on NN. Safe mode must be turned off manually.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:2673)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInt(FSNamesystem.java:2643)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2626)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:612)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:406)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44094)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
at org.apache.
13/04/25 07:38:19 INFO mapred.JobClient: Job complete: job_201304250735_0001
13/04/25 07:38:19 INFO mapred.JobClient: Counters: 28
13/04/25 07:38:19 INFO mapred.JobClient: File System Counters
13/04/25 07:38:19 INFO mapred.JobClient: FILE: Number of bytes read=145604760
13/04/25 07:38:19 INFO mapred.JobClient: FILE: Number of bytes written=291469063
13/04/25 07:38:19 INFO mapred.JobClient: FILE: Number of read operations=0
13/04/25 07:38:19 INFO mapred.JobClient: FILE: Number of large read operations=0
13/04/25 07:38:19 INFO mapred.JobClient: FILE: Number of write operations=0
13/04/25 07:38:19 INFO mapred.JobClient: HDFS: Number of bytes read=134226145
13/04/25 07:38:19 INFO mapred.JobClient: HDFS: Number of bytes written=0
13/04/25 07:38:19 INFO mapred.JobClient: HDFS: Number of read operations=4
13/04/25 07:38:19 INFO mapred.JobClient: HDFS: Number of large read operations=0
13/04/25 07:38:19 INFO mapred.JobClient: HDFS: Number of write operations=0
13/04/25 07:38:19 INFO mapred.JobClient: Job Counters
13/04/25 07:38:19 INFO mapred.JobClient: Failed map tasks=1
13/04/25 07:38:19 INFO mapred.JobClient: Launched map tasks=10
13/04/25 07:38:19 INFO mapred.JobClient: Data-local map tasks=10
13/04/25 07:38:19 INFO mapred.JobClient: Total time spent by all maps in occupied slots (ms)=86698
13/04/25 07:38:19 INFO mapred.JobClient: Total time spent by all reduces in occupied slots (ms)=0
13/04/25 07:38:19 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
13/04/25 07:38:19 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0
13/04/25 07:38:19 INFO mapred.JobClient: Map-Reduce Framework
13/04/25 07:38:19 INFO mapred.JobClient: Map input records=1342178
13/04/25 07:38:19 INFO mapred.JobClient: Map output records=2823343
13/04/25 07:38:19 INFO mapred.JobClient: Map output bytes=140329459
13/04/25 07:38:19 INFO mapred.JobClient: Input split bytes=224
13/04/25 07:38:19 INFO mapred.JobClient: Combine input records=5600744
13/04/25 07:38:19 INFO mapred.JobClient: Combine output records=5542691
13/04/25 07:38:19 INFO mapred.JobClient: Spilled Records=5542691
13/04/25 07:38:19 INFO mapred.JobClient: CPU time spent (ms)=16900
13/04/25 07:38:19 INFO mapred.JobClient: Physical memory (bytes) snapshot=382787584
13/04/25 07:38:19 INFO mapred.JobClient: Virtual memory (bytes) snapshot=776003584
13/04/25 07:38:19 INFO mapred.JobClient: Total committed heap usage (bytes)=321003520
[training@localhost ~]$
[training@localhost ~]$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment