Skip to content

Instantly share code, notes, and snippets.

@skonto
Created March 19, 2019 20:08
Show Gist options
  • Save skonto/ac95bd761535f46a107227a557a3c9f8 to your computer and use it in GitHub Desktop.
Save skonto/ac95bd761535f46a107227a557a3c9f8 to your computer and use it in GitHub Desktop.
log
I0319 20:01:21.505584 12 submission.go:63] spark-submit arguments: [/opt/spark/bin/spark-submit --class org.apache.spark.examples.SparkPi --master k8s://https://172.30.0.1:443 --deploy-mode cluster --conf spark.kubernetes.namespace=spark --conf spark.app.name=spark-pi --conf spark.kubernetes.driver.pod.name=spark-pi-driver --conf spark.kubernetes.container.image=lightbend/spark:2.1.0-OpenShift-2.4.0-rh --conf spark.kubernetes.container.image.pullPolicy=Always --conf spark.kubernetes.submission.waitAppCompletion=false --conf spark.metrics.namespace=spark.spark-pi --conf spark.metrics.conf=/etc/metrics/conf/metrics.properties --conf spark.kubernetes.driver.label.sparkoperator.k8s.io/app-name=spark-pi --conf spark.kubernetes.driver.label.sparkoperator.k8s.io/launched-by-spark-operator=true --conf spark.kubernetes.driver.label.sparkoperator.k8s.io/submission-id=spark-pi-1553025681505520024 --conf spark.kubernetes.driver.pod.name=spark-pi-driver --conf spark.driver.cores=1.000000 --conf spark.driver.memory=1g --conf spark.kubernetes.authenticate.driver.serviceAccountName=spark-sa --conf spark.kubernetes.driver.label.version=2.4.0 --conf spark.kubernetes.driver.annotation.prometheus.io/port=9100 --conf spark.kubernetes.driver.annotation.prometheus.io/path=/metrics --conf spark.kubernetes.driver.annotation.xxxxxxx.lightbend.io/port=9100 --conf spark.kubernetes.driver.annotation.xxxxxxx.lightbend.io/scrape=true --conf spark.kubernetes.driver.annotation.prometheus.io/scrape=true --conf spark.driver.extraJavaOptions=-javaagent:/prometheus/jmx_prometheus_javaagent-0.3.1.jar=9100:/etc/metrics/conf/prometheus.yaml --conf spark.kubernetes.executor.label.sparkoperator.k8s.io/app-name=spark-pi --conf spark.kubernetes.executor.label.sparkoperator.k8s.io/launched-by-spark-operator=true --conf spark.kubernetes.executor.label.sparkoperator.k8s.io/submission-id=spark-pi-1553025681505520024 --conf spark.executor.instances=2 --conf spark.executor.cores=2 --conf spark.executor.memory=1g --conf spark.kubernetes.executor.label.version=2.4.0 --conf spark.kubernetes.executor.annotation.prometheus.io/scrape=true --conf spark.kubernetes.executor.annotation.prometheus.io/port=9100 --conf spark.kubernetes.executor.annotation.prometheus.io/path=/metrics --conf spark.kubernetes.executor.annotation.xxxxxxx.lightbend.io/port=9100 --conf spark.kubernetes.executor.annotation.xxxxxxx.lightbend.io/scrape=true --conf spark.executor.extraJavaOptions=-javaagent:/prometheus/jmx_prometheus_javaagent-0.3.1.jar=9100:/etc/metrics/conf/prometheus.yaml local:///opt/spark/examples/jars/spark-examples_2.11-2.4.0.jar 10000]
I0319 20:01:21.505699 12 event.go:221] Event(v1.ObjectReference{Kind:"SparkApplication", Namespace:"spark", Name:"spark-pi", UID:"9d7031fd-4a81-11e9-b674-0288a0a0c3ec", APIVersion:"sparkoperator.k8s.io/v1beta1", ResourceVersion:"2594296", FieldPath:""}): type: 'Warning' reason: 'SparkApplicationPendingRerun' SparkApplication spark-pi is pending rerun
I0319 20:01:22.607870 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025648754-exec-1 updated in namespace spark.
I0319 20:01:22.610814 12 spark_pod_eventhandler.go:77] Pod spark-pi-1553025648754-exec-1 deleted in namespace spark.
I0319 20:01:23.895797 12 webhook.go:136] Serving admission request
I0319 20:01:23.896186 12 webhook.go:290] Pod spark-pi-driver in namespace spark is subject to mutation
I0319 20:01:23.906868 12 spark_pod_eventhandler.go:47] Pod spark-pi-driver added in namespace spark.
I0319 20:01:23.911784 12 spark_pod_eventhandler.go:58] Pod spark-pi-driver updated in namespace spark.
I0319 20:01:23.924438 12 spark_pod_eventhandler.go:58] Pod spark-pi-driver updated in namespace spark.
I0319 20:01:24.262655 12 controller.go:596] SparkApplication spark/spark-pi has been submitted
I0319 20:01:24.262743 12 sparkui.go:135] Creating a service spark-pi-ui-svc for the Spark UI for application spark-pi
I0319 20:01:24.262957 12 event.go:221] Event(v1.ObjectReference{Kind:"SparkApplication", Namespace:"spark", Name:"spark-pi", UID:"9d7031fd-4a81-11e9-b674-0288a0a0c3ec", APIVersion:"sparkoperator.k8s.io/v1beta1", ResourceVersion:"2594296", FieldPath:""}): type: 'Normal' reason: 'SparkApplicationSubmitted' SparkApplication spark-pi was submitted successfully
I0319 20:01:24.280213 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025647387553090 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 31774 spark-pi-driver} {PENDING_RERUN } map[] 0 0}] to [{ spark-pi-1553025681505520024 2019-03-19 20:01:24.262683396 +0000 UTC m=+331.004525183 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 30816 } {SUBMITTED } map[] 1 1}]
I0319 20:01:24.305277 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025647387553090 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 31774 spark-pi-driver} {PENDING_RERUN } map[] 0 0} new status: { spark-pi-1553025681505520024 2019-03-19 20:01:24.262683396 +0000 UTC m=+331.004525183 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 30816 } {SUBMITTED } map[] 1 1}
I0319 20:01:24.305332 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:01:24.305366 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:01:24.305447 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:01:24.305466 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:01:24.305991 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:01:24.323204 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:01:24.323969 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:01:24.324019 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:01:24.324049 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:01:24.324119 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:01:24.324139 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:01:24.329464 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:01:24.329905 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:01:24.329943 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:01:24.329973 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:01:24.330035 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:01:24.330057 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:01:24.335432 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:01:24.335473 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:01:30.481086 12 spark_pod_eventhandler.go:58] Pod spark-pi-driver updated in namespace spark.
I0319 20:01:39.155835 12 webhook.go:136] Serving admission request
I0319 20:01:39.166597 12 spark_pod_eventhandler.go:47] Pod spark-pi-1553025682813-exec-1 added in namespace spark.
I0319 20:01:39.171352 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-1 updated in namespace spark.
I0319 20:01:39.183776 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-1 updated in namespace spark.
I0319 20:01:39.230304 12 webhook.go:136] Serving admission request
I0319 20:01:39.240587 12 spark_pod_eventhandler.go:47] Pod spark-pi-1553025682813-exec-2 added in namespace spark.
I0319 20:01:39.244853 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-2 updated in namespace spark.
I0319 20:01:39.259449 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-2 updated in namespace spark.
I0319 20:01:44.505863 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-1 updated in namespace spark.
I0319 20:01:44.851201 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-2 updated in namespace spark.
I0319 20:01:54.329655 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:01:54.329710 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:01:54.329793 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:01:54.329819 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:01:54.341647 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:01:54.341696 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:02:24.329848 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:02:24.329911 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:02:24.329991 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:02:24.330016 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:02:24.341715 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:02:24.341772 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:02:54.330031 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:02:54.330095 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:02:54.330198 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:02:54.330224 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:02:54.343543 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:02:54.343593 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:03:24.330204 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:03:24.330292 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:03:24.330428 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:03:24.330459 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:03:24.342787 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:03:24.342834 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:03:28.698386 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-1 updated in namespace spark.
I0319 20:03:28.708037 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-2 updated in namespace spark.
I0319 20:03:29.743243 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-1 updated in namespace spark.
I0319 20:03:29.918948 12 spark_pod_eventhandler.go:58] Pod spark-pi-driver updated in namespace spark.
I0319 20:03:30.020608 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-2 updated in namespace spark.
I0319 20:03:31.041645 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-2 updated in namespace spark.
I0319 20:03:31.045990 12 spark_pod_eventhandler.go:77] Pod spark-pi-1553025682813-exec-2 deleted in namespace spark.
I0319 20:03:33.155181 12 spark_pod_eventhandler.go:58] Pod spark-pi-1553025682813-exec-1 updated in namespace spark.
I0319 20:03:33.158323 12 spark_pod_eventhandler.go:77] Pod spark-pi-1553025682813-exec-1 deleted in namespace spark.
I0319 20:03:54.330386 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:03:54.330448 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:03:54.330566 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:03:54.330589 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:03:54.342438 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:03:54.342496 12 controller.go:252] Ending processing key: "spark/spark-pi"
W0319 20:03:55.412440 12 reflector.go:341] github.com/GoogleCloudPlatform/spark-on-k8s-operator/pkg/client/informers/externalversions/factory.go:119: watch of *v1beta1.ScheduledSparkApplication ended with: The resourceVersion for the provided watch is too old.
I0319 20:04:24.330576 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:04:24.330629 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:04:24.330720 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:04:24.330738 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:04:24.342955 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:04:24.343003 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:04:54.330785 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:04:54.330845 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:04:54.330938 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:04:54.330961 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:04:54.351930 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:04:54.351973 12 controller.go:252] Ending processing key: "spark/spark-pi"
I0319 20:05:24.330979 12 controller.go:205] SparkApplication spark/spark-pi was updated, enqueueing it
I0319 20:05:24.331038 12 controller.go:245] Starting processing key: "spark/spark-pi"
W0319 20:05:24.331156 12 controller.go:334] driver not found for SparkApplication: spark/spark-pi
I0319 20:05:24.331177 12 controller.go:522] Trying to update SparkApplication spark/spark-pi, from: [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}] to [{ spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}]
I0319 20:05:24.344155 12 sparkapp_metrics.go:144] Exporting metrics for spark-pi; old status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1} new status: { spark-pi-1553025678548580441 2019-03-19 20:01:21 +0000 UTC 0001-01-01 00:00:00 +0000 UTC {spark-pi-ui-svc 32292 } {SUBMITTED } map[] 1 1}
I0319 20:05:24.344202 12 controller.go:252] Ending processing key: "spark/spark-pi"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment