Skip to content

Instantly share code, notes, and snippets.

@erkkel
erkkel / gist:c04a0b5ca60ad755cf62e9ad18e5b7ed
Created April 30, 2018 18:42
[Error] Deploying Spark to Google Kubernetes Engine
spark-kubernetes-driver Apr 29, 2018, 3:49:34 AM at org.apache.spark.deploy.rest.k8s.ResourceStagingServer.main(ResourceStagingServer.scala)
spark-kubernetes-driver Apr 29, 2018, 3:49:34 AM at org.apache.spark.deploy.rest.k8s.ResourceStagingServer$.main(ResourceStagingServer.scala:99)
spark-kubernetes-driver Apr 29, 2018, 3:49:34 AM at org.apache.spark.deploy.rest.k8s.SparkConfPropertiesParser$.getSparkConfFromPropertiesFile(SparkConfPropertiesParser.scala:34)
spark-kubernetes-driver Apr 29, 2018, 3:49:34 AM Exception in thread "main" java.lang.IllegalArgumentException: Server properties file given at /opt/spark/work-dir/driver does not exist or is not a file.
spark-kubernetes-driver Apr 29, 2018, 3:49:33 AM + /sbin/tini -s -- /opt/spark/bin/spark-class org.apache.spark.deploy.rest.k8s.ResourceStagingServer driver
spark-kubernetes-driver Apr 29, 2018, 3:49:33 AM + '[' -z root:x:0:0:root:/root:/bin/ash ']'
spark-kubernetes-driver Apr 29, 2018, 3:49:33 AM + uidentry=root:x:0:0:root:/root:/bin/ash
spark-kubernet
# Taken from https://gist.github.com/xiaom/8264691. Massive kudos for coming up with 95% of the logic.
# This version has been tweaked to work with the most recent versions of mosh and protobuf as of Aug 29 2017
# Example usage: mosh --server=/home/cc/eecs151/fa17/class/eecs151-aba/local/bin/mosh-server eecs151-aba@cory.eecs.berkeley.edu
mkdir mosh
cd mosh
ROOT=`pwd`
echo "==================================="
@erkkel
erkkel / install_mosh_locally.sh
Created August 29, 2017 22:13 — forked from xiaom/install_mosh_locally.sh
install mosh locally
#!/bin/sh
# this script does absolutely ZERO error checking. however, it worked
# for me on a RHEL 6.3 machine on 2012-08-08. clearly, the version numbers
# and/or URLs should be made variables. cheers, zmil...@cs.wisc.edu
mkdir mosh
cd mosh