Skip to content

Instantly share code, notes, and snippets.

@philz
Created April 3, 2013 21:17
Show Gist options
  • Save philz/5305400 to your computer and use it in GitHub Desktop.
Save philz/5305400 to your computer and use it in GitHub Desktop.
Executing a shell script via MR.
hadoop jar /usr/lib/hadoop-0.20-mapreduce/contrib/streaming/hadoop-streaming-2.0.0-mr1-cdh4.3.0-SNAPSHOT.jar -input /user/philip/single_line -output $(mktemp) -mapper 'touch /tmp/philip_was_here' -jobconf mapred.reduce.tasks=0 -jobconf mapred.map.tasks=0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment