Skip to content

Instantly share code, notes, and snippets.

@linben
Created January 18, 2018 09:40
Show Gist options
  • Save linben/37c1bbb855abd9fbcfe2e5fa553453b5 to your computer and use it in GitHub Desktop.
Save linben/37c1bbb855abd9fbcfe2e5fa553453b5 to your computer and use it in GitHub Desktop.
{
"id": "/spark-cluster",
"cmd": "unset MESOS_EXECUTOR_ID MESOS_FRAMEWORK_ID MESOS_SLAVE_ID MESOS_SLAVE_PID MESOS_TASK_ID && /opt/spark/dist/bin/spark-submit --verbose --deploy-mode cluster --name SparkPi-Dispatcher-2-2-0 --master mesos://spark.marathon.l4lb.thisdcos.directory:7077 --conf spark.cores.max=4 --conf spark.executor.cores=2 --conf spark.mesos.executor.docker.image=mesosphere/spark:2.1.0-2.2.1-1-hadoop-2.6 --conf spark.executor.home=/opt/spark/dist --class org.apache.spark.examples.SparkPi http://downloads.mesosphere.com/spark/assets/spark-examples_2.11-2.0.1.jar 1000",
"container": {
"type": "DOCKER",
"volumes": [],
"docker": {
"image": "mesosphere/spark:2.1.0-2.2.1-1-hadoop-2.6",
"forcePullImage": false,
"privileged": false,
"parameters": []
}
},
"cpus": 1,
"disk": 0,
"instances": 1,
"maxLaunchDelaySeconds": 3600,
"mem": 1024,
"gpus": 0,
"networks": [
{
"mode": "host"
}
],
"requirePorts": false
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment