Skip to content

Instantly share code, notes, and snippets.

@alienrobotwizard
Created July 27, 2010 21:45
Show Gist options
  • Save alienrobotwizard/492934 to your computer and use it in GitHub Desktop.
Save alienrobotwizard/492934 to your computer and use it in GitHub Desktop.
#
# Example azkaban job. Assumes you have two MR jobs to be run sequentially.
#
type=command
command=$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-*streaming*.jar -input /path/to/data -output /path/to/outputA -mapper mapperA.py -reducer reducerA.py
command.1=$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-*streaming*.jar -input /path/to/outputA -output /path/to/outputB -mapper mapperB.py -reducer reducerB.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment