Skip to content

Instantly share code, notes, and snippets.

@garystafford
Last active July 28, 2022 03:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save garystafford/dfedbd0e8c15a4ac6fb2a756d0dcfc25 to your computer and use it in GitHub Desktop.
Save garystafford/dfedbd0e8c15a4ac6fb2a756d0dcfc25 to your computer and use it in GitHub Desktop.
aws emr-serverless start-job-run \
--application-id <your_application_id> \
--execution-role-arn <your_execution_role_arn> \
--name 02-example-csv-s3 \
--job-driver '{
"sparkSubmit": {
"entryPoint": "s3://<your_s3_bucket>/scripts/02_example_csv_s3.py",
"entryPointArguments": [
"--bootstrap_servers=<your_bootstrap_server>",
"--s3_bucket=<your_s3_bucket>"
],
"sparkSubmitParameters": "--conf spark.jars=s3://<your_s3_bucket>/jars/*.jar"
}
}'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment