Skip to content

Instantly share code, notes, and snippets.

@damianknopp

damianknopp/livy-sparkpi.sh

Created March 14, 2020 20:30
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save damianknopp/59bc857653f8168c21e5f7d2622e1197 to your computer and use it in GitHub Desktop.
Save damianknopp/59bc857653f8168c21e5f7d2622e1197 to your computer and use it in GitHub Desktop.
Download ZIP
livy-sparkpi.sh
Raw
livy-sparkpi.sh
curl -k -H 'Content-Type: application/json' -X POST -d '{
"conf": {
"spark.kubernetes.container.image.pullPolicy": "Always",
"spark.kubernetes.authenticate.driver.serviceAccountName": "default"
},
"file": "local:///opt/spark/examples/jars/spark-examples_2.11-2.4.5.jar",
"className": "org.apache.spark.examples.SparkPi"
}' http://<ip>:<port>/batches
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment