HdfsCommands.txt

0) hadoop jar mapReduceUtils-0.1.jar com.iwinner.m_techlearn.hadoop.mapreduce.custom1.TempuratureJob /data/OutputCust/


i) hadoop fs -Ddfs.block.size=67108864 -Ddfs.replication=4 -copyFromLocal pom.xml /app/data

ii) hdfs fsck -blocks -files -locations /app/data/pom.xml

iii)yarn application -list

iv)yarn application -kill <<Application_ID>>

v) yarn logs -applicationId <<Application_ID>>

vi) sudo hdfs oiv -i /dfs/nn/current/fsimage_00000003021 -o fsimage_output.txt (FSImage_Binay file to understable format)
vii) sudo hdfs oev -i /dfs/edits_00000 -o edits.xml (EDIT.log Binay to Understable format)
viii)hadoop fs -copyToLocal /data/joinsdb/* /home/hadoop/Desktop/joinsdb/

ix)hdfs fsck /public/randomtextwriter -files -blocks -locations to get the 

GFS  ===> HDFS

Google MapRedce ===>MapReduce

BigTable ===>HBase
BigQUery ===> Hive In IBM BigInsights






hadoop fs -ls – list the files in directory
hadoop fs -copyFromLocal or hadoop fs -put – To copy files/directories from local file system to HDFS
hadoop fs -copyToLocal or hadoop fs -get – To copy files/directories from HDFS to local filesystem
hadoop fs -mkdir – To create directories in HDFS
hadoop fs -rm – To delete files/directories in HDFS
hadoop fs -cat – To print contents of file(s) on to standard out in HDFS
hadoop fs -tail – To print last 1 KB of single file on to standard out in HDFS. It is typically used for previewing the data
hadoop fs -help – To get help of particular command
hadoop fs – will return all the commands available to deal with files in HDFS
hdfs fsck /public/randomtextwriter -files -blocks -locations to get the