Skip to content

Instantly share code, notes, and snippets.

@arinto

arinto/hdfs-append-DataStreamer Exception Secret

Created October 10, 2013 06:29
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save arinto/d37a56f449c61c9d1d9c to your computer and use it in GitHub Desktop.
Save arinto/d37a56f449c61c9d1d9c to your computer and use it in GitHub Desktop.
Download ZIP
DataStreamer exception while appending file in HDFS
Raw
hdfs-append-DataStreamer Exception
13/10/10 14:17:30 WARN hdfs.DFSClient: DataStreamer Exception
java.io.IOException: Failed to add a datanode. User may turn off this feature by setting dfs.client.block.write.replace-datanode-on-failure.policy in configuration, where the current policy is DEFAULT. (Nodes: current=[10.0.106.82:50010, 10.0.106.81:50010], original=[10.0.106.82:50010, 10.0.106.81:50010])
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.findNewDatanode(DFSOutputStream.java:778)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.addDatanode2ExistingPipeline(DFSOutputStream.java:838)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:934)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:461)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment