Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
cd ./pyspark/
export SPARK_BUCKET="<your-bucket-111222333444-us-east-1>"
aws s3 cp emr_jars/ "s3://${SPARK_BUCKET}/jars/" --recursive
aws s3 cp pyspark_scripts/ "s3://${SPARK_BUCKET}/spark/" --recursive
aws s3 cp emr_bootstrap/ "s3://${SPARK_BUCKET}/spark/" --recursive
aws s3 cp data/ "s3://${SPARK_BUCKET}/spark/" --recursive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment