Skip to content

Instantly share code, notes, and snippets.

@takus
Last active August 29, 2015 14:05
Show Gist options
  • Save takus/45412dcf784664277010 to your computer and use it in GitHub Desktop.
Save takus/45412dcf784664277010 to your computer and use it in GitHub Desktop.
#!/bin/sh
JOB_FLOW_ID=`mrjob create-job-flow`
for n in `seq 1 ${LOOP_NUMBER}`
do
python ${MRJOB_SCRIPT} -r emr --conf-path emr.conf --emr-job-flow-id=${JOB_FLOW_ID} ${MRJOB_OPTION} ${INPUT_DIR} > ${OUTPUT_FILE}
done
mrjob terminate-job-flow ${JOB_FLOW_ID}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment