Last active
November 13, 2019 17:53
-
-
Save rafaelfelix/9c14a1a061689a368e9677f129e765d2 to your computer and use it in GitHub Desktop.
spark-on-k8s-sample-job-output.txt
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Using properties file: null | |
Parsed arguments: | |
master k8s://https://192.168.99.105:8443 | |
deployMode client | |
executorMemory null | |
executorCores null | |
totalExecutorCores null | |
propertiesFile null | |
driverMemory null | |
driverCores null | |
driverExtraClassPath null | |
driverExtraLibraryPath null | |
driverExtraJavaOptions null | |
supervise false | |
queue null | |
numExecutors null | |
files null | |
pyFiles null | |
archives null | |
mainClass org.apache.spark.examples.SparkPi | |
primaryResource file:/Users/rafael.correa/workspace/github/olx-global/spark-on-k8s/tmp/spark/examples/jars/spark-examples_2.11-2.4.3.jar | |
name org.apache.spark.examples.SparkPi | |
childArgs [] | |
jars null | |
packages null | |
packagesExclusions null | |
repositories null | |
verbose true | |
Spark properties used, including those specified through | |
--conf and those from the properties file null: | |
(spark.kubernetes.container.image,10.99.82.129:5000/spark) | |
Main class: | |
org.apache.spark.examples.SparkPi | |
Arguments: | |
Spark config: | |
(spark.jars,file:/Users/rafael.correa/workspace/github/olx-global/spark-on-k8s/tmp/spark/examples/jars/spark-examples_2.11-2.4.3.jar) | |
(spark.app.name,org.apache.spark.examples.SparkPi) | |
(spark.kubernetes.container.image,10.99.82.129:5000/spark) | |
(spark.submit.deployMode,client) | |
(spark.master,k8s://https://192.168.99.108:8443) | |
Classpath elements: | |
file:/Users/rafael.correa/workspace/github/olx-global/spark-on-k8s/tmp/spark/examples/jars/spark-examples_2.11-2.4.3.jar | |
Pi is roughly 3.147275736378682 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment