Skip to content

Instantly share code, notes, and snippets.

@dgadiraju
Last active October 23, 2018 02:06
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dgadiraju/0bc896a2aa7fc7b99a1b6fc52c4dcc4a to your computer and use it in GitHub Desktop.
Save dgadiraju/0bc896a2aa7fc7b99a1b6fc52c4dcc4a to your computer and use it in GitHub Desktop.
File Name Parameter Name Parameter Value Description
core-site.xml fs.defaultFS/fs.default.name hdfs://bigdataserver-2.c.cellular-axon-219405.internal:8020 Namenode ip address or nameservice (HA config)
hdfs-site.xml dfs.block.size/dfs.blocksize 128 MB Block size at which files will be stored physically.
hdfs-site.xml dfs.replication 3 Number of copies per block of a file for fault tolerance
hdfs-site.xml dfs.namenode.http-address bigdataserver-2.c.cellular-axon-219405.internal:50070 Namenode Web UI. By default it might use ip address of namenode.
hdfs-site.xml dfs.datanode.http.address 0.0.0.0:50075 Datanode Web UI
hdfs-site.xml dfs.name.dir/dfs.namenode.name.dir /data1/dfs/nn Directory location for FS Image and edit logs on name node
hdfs-site.xml dfs.data.dir/dfs.datanode.data.dir /data1/dfs/dn Directory location for storing blocks on data nodes
hdfs-site.xml fs.checkpoint.dir/dfs.namenode.checkpoint.dir /data1/dfs/snn Directory location which will be used by secondary namenode for checkpoint.
hdfs-site.xml fs.checkpoint.period/dfs.namenode.checkpoint.period 1 hour Checkpoint (merging edit logs with current fs image to create new fs image) interval.
hdfs-site.xml dfs.namenode.checkpoint.txns 1000000 Checkpoint (merging edit logs with current fs image to create new fs image) transactions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment