Skip to content

Instantly share code, notes, and snippets.

@nmreadelf
Created October 15, 2018 09:34
Show Gist options
  • Save nmreadelf/72096552eb6377ef38aeebb0ea105d29 to your computer and use it in GitHub Desktop.
Save nmreadelf/72096552eb6377ef38aeebb0ea105d29 to your computer and use it in GitHub Desktop.
hadoop dfs Exception
18/10/15 17:00:34 WARN hdfs.DFSClient: DataStreamer Exception
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)
at java.io.DataOutputStream.write(DataOutputStream.java:107)
at org.apache.hadoop.hdfs.DFSPacket.writeTo(DFSPacket.java:176)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:507)
18/10/15 17:00:34 WARN hdfs.DFSClient: DFSOutputStream ResponseProcessor exception for block BP-918046407-172.27.128.6-1530870818433:blk_1086813126_15357398
java.net.SocketTimeoutException: 75000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/172.27.130.130:44008 remote=/172.27.128.12:50010]
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118)
at java.io.FilterInputStream.read(FilterInputStream.java:83)
at java.io.FilterInputStream.read(FilterInputStream.java:83)
at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2280)
at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:244)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:733)
18/10/15 17:00:34 WARN hdfs.DFSClient: Error Recovery for block BP-918046407-172.27.128.6-1530870818433:blk_1086813126_15357398 in pipeline DatanodeInfoWithStorage[172.27.128.12:50010,DS-acf2dcfc-d14b-4309-b9a6-d629ed2e49b4,DISK], DatanodeInfoWithStorage[172.27.128.9:50010,DS-71a44dcf-3858-4138-ba14-bf87793f97dd,DISK], DatanodeInfoWithStorage[172.27.128.5:50010,DS-59d043d6-7d2f-4292-a0f9-d6c28166bee1,DISK]: bad datanode DatanodeInfoWithStorage[172.27.128.12:50010,DS-acf2dcfc-d14b-4309-b9a6-d629ed2e49b4,DISK]
Done!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment