Skip to content

Instantly share code, notes, and snippets.

@tnachen
Last active June 5, 2017 02:41
Show Gist options
  • Save tnachen/b1178ef3be41020b2415a24a21836cbf to your computer and use it in GitHub Desktop.
Save tnachen/b1178ef3be41020b2415a24a21836cbf to your computer and use it in GitHub Desktop.
./spark-submit --deploy-mode cluster --class MovieLensALS --master k8s://https://redis-1c1-apiloadb-1em6ne4lzm7n7-5246469.us-east-1.elb.amazonaws.com --conf spark.app.name=spark-movielens --conf spark.kubernetes.driver.docker.image=hyperpilot/spark-movielens:small --conf spark.kubernetes.executor.docker.image=hyperpilot/spark-movielens:small-executor --conf spark.kubernetes.initcontainer.docker.image=hyperpilot/spark-init --conf spark.kubernetes.docker.image.pullPolicy=Always local:///dataset/movielens-als-assembly-0.1.jar file:///dataset/movie-small/ file:///dataset/personalRatings.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment