Skip to content

Instantly share code, notes, and snippets.

@rafaelfelix
Last active November 13, 2019 17:53
Show Gist options
  • Save rafaelfelix/9c14a1a061689a368e9677f129e765d2 to your computer and use it in GitHub Desktop.
Save rafaelfelix/9c14a1a061689a368e9677f129e765d2 to your computer and use it in GitHub Desktop.
spark-on-k8s-sample-job-output.txt
Using properties file: null
Parsed arguments:
master k8s://https://192.168.99.105:8443
deployMode client
executorMemory null
executorCores null
totalExecutorCores null
propertiesFile null
driverMemory null
driverCores null
driverExtraClassPath null
driverExtraLibraryPath null
driverExtraJavaOptions null
supervise false
queue null
numExecutors null
files null
pyFiles null
archives null
mainClass org.apache.spark.examples.SparkPi
primaryResource file:/Users/rafael.correa/workspace/github/olx-global/spark-on-k8s/tmp/spark/examples/jars/spark-examples_2.11-2.4.3.jar
name org.apache.spark.examples.SparkPi
childArgs []
jars null
packages null
packagesExclusions null
repositories null
verbose true
Spark properties used, including those specified through
--conf and those from the properties file null:
(spark.kubernetes.container.image,10.99.82.129:5000/spark)
Main class:
org.apache.spark.examples.SparkPi
Arguments:
Spark config:
(spark.jars,file:/Users/rafael.correa/workspace/github/olx-global/spark-on-k8s/tmp/spark/examples/jars/spark-examples_2.11-2.4.3.jar)
(spark.app.name,org.apache.spark.examples.SparkPi)
(spark.kubernetes.container.image,10.99.82.129:5000/spark)
(spark.submit.deployMode,client)
(spark.master,k8s://https://192.168.99.108:8443)
Classpath elements:
file:/Users/rafael.correa/workspace/github/olx-global/spark-on-k8s/tmp/spark/examples/jars/spark-examples_2.11-2.4.3.jar
Pi is roughly 3.147275736378682
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment