Skip to content

Instantly share code, notes, and snippets.

@kylebrandt
Created February 29, 2016 01:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kylebrandt/89a98f30680b799a6317 to your computer and use it in GitHub Desktop.
Save kylebrandt/89a98f30680b799a6317 to your computer and use it in GitHub Desktop.
Cloudera Non-Default HDFS Settings
io.compression.codecs:
org.apache.hadoop.io.compress.DefaultCodec
com.hadoop.compression.lzo.LzoCodec
com.hadoop.compression.lzo.LzopCodec
org.apache.hadoop.io.compress.GzipCodec
org.apache.hadoop.io.compress.BZip2Codec
org.apache.hadoop.io.compress.DeflateCodec
org.apache.hadoop.io.compress.SnappyCodec
org.apache.hadoop.io.compress.Lz4Codec
dfs.data.dir, dfs.datanode.data.dir:
/mnt/hdfs/hdfs01/dfs/dn
/mnt/hdfs/hdfs02/dfs/dn
... hdfs08 ...
dfs.datanode.failed.volumes.tolerated: 4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment