Skip to content

Instantly share code, notes, and snippets.

@svzdvd

svzdvd/cloudera hadoop bash aliases

Created December 31, 2014 14:51
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save svzdvd/667128d021d86adeefa8 to your computer and use it in GitHub Desktop.
Save svzdvd/667128d021d86adeefa8 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
cloudera hadoop bash aliases
run_mapreduce() {
hadoop jar /usr/lib/hadoop-0.20-mapreduce/contrib/streaming/hadoop-streaming-2.0.0-mr1-cdh4.1.1.jar -mapper $1 -reducer $2 -file $1 -file $2 -input $3 -output $4
}
alias hs=run_mapreduce
run_mapcombinereduce() {
hadoop jar /usr/lib/hadoop-0.20-mapreduce/contrib/streaming/hadoop-streaming-2.0.0-mr1-cdh4.1.1.jar -mapper $1 -reducer $2 -combiner $2 -file $1 -file $2 -input $
}
alias hsc=run_mapcombinereduce
@thewhitetulip
Copy link

This changes according to the cdh version

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment