Skip to content

Instantly share code, notes, and snippets.



Created Feb 26, 2019
What would you like to do?
EMR Steps
Hadoop Streaming step
"jobFlowId": "j-1JKGNMYXT59DP",
"steps": [
"name": "EMRHadoopLogPushingTest",
"actionOnFailure": "CANCEL_AND_WAIT",
"hadoopJarStep": {
"jar": "command-runner.jar",
"args": [
"<s3 location to py file containing mapper and reduer>",
"<s3 location to input file>",
"<s3 location for output>",
"<py file containing the mapper>",
"progressListener": {},
"requestClientOptions": {
"markers": {},
"readLimit": 131073
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment