Skip to content

Instantly share code, notes, and snippets.

@dgadiraju

dgadiraju/cdh-admin-yarn-fifo-01-wordcount.sh

Created December 24, 2018 22:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dgadiraju/f6aa41383703a8b6bb3bb902a8726581 to your computer and use it in GitHub Desktop.
Save dgadiraju/f6aa41383703a8b6bb3bb902a8726581 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
cdh-admin-yarn-fifo-01-wordcount.sh
#Delete /user/itversity/wordcount, if it exists
hadoop fs -rm -R /user/itversity/wordcount
#Override individual properties
hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar \
wordcount \
-Dmapreduce.job.reduces=8 \
/user/itversity/randomtextwriter \
/user/itversity/wordcount
#With Parcels
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar \
wordcount \
-Dmapreduce.job.reduces=8 \
/user/itversity/randomtextwriter \
/user/itversity/wordcount
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment