Skip to content

Instantly share code, notes, and snippets.

@pablete
Last active September 5, 2017 18:44
Show Gist options
  • Save pablete/521c1707f4919521c6463c086fd328ee to your computer and use it in GitHub Desktop.
Save pablete/521c1707f4919521c6463c086fd328ee to your computer and use it in GitHub Desktop.
:spark-submit-options [
"--conf" "spark.driver.maxResultSize=10G"
"--conf" "spark.cores.max=150"
"--conf" "spark.driver.cores=2"
"--conf" "spark.driver.memory=24G"
"--conf" "spark.executor.cores=2"
"--conf" "spark.executor.memory=24G"
"--conf" "spark.scheduler.minRegisteredResourcesRatio=1.0"
"--conf" "spark.scheduler.maxRegisteredResourcesWaitingTime=1200"
"--conf" "spark.mesos.role=pvr"
]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment