ssh -i ~/.ssh/${EC2_KEY_NAME}.pem hadoop@${EMR_MASTER_DNS} \ | |
""" | |
spark-submit --deploy-mode cluster --master yarn \ | |
--conf spark.yarn.submit.waitAppCompletion=true \ | |
's3a://${WORK_BUCKET}/analyze/bakery_sales_ssm.py' | |
""" |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment