Skip to content

Instantly share code, notes, and snippets.

@rafaelfelix

rafaelfelix/spark-on-k8s-patch-SPARK-28921.sh

Created November 14, 2019 14:48
Show Gist options
  • Save rafaelfelix/0ad60dda50f7ea144215b89f0a277e68 to your computer and use it in GitHub Desktop.
Save rafaelfelix/0ad60dda50f7ea144215b89f0a277e68 to your computer and use it in GitHub Desktop.
Download ZIP
spark-on-k8s-patch-SPARK-28921.sh
Raw
spark-on-k8s-patch-SPARK-28921.sh
#!/bin/bash
# preventing issue https://issues.apache.org/jira/browse/SPARK-28921 from happening
rm -f ./spark/jars/kubernetes*.jar
curl -Lo ./spark/jars/kubernetes-model-4.4.2.jar https://repo1.maven.org/maven2/io/fabric8/kubernetes-model/4.4.2/kubernetes-model-4.4.2.jar
curl -Lo ./spark/jars/kubernetes-model-common-4.4.2.jar https://repo1.maven.org/maven2/io/fabric8/kubernetes-model-common/4.4.2/kubernetes-model-common-4.4.2.jar
curl -Lo ./spark/jars/kubernetes-client-4.4.2.jar https://repo1.maven.org/maven2/io/fabric8/kubernetes-client/4.4.2/kubernetes-client-4.4.2.jar
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment