Skip to content

Instantly share code, notes, and snippets.

@rxin
Last active December 21, 2015 01:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rxin/6225543 to your computer and use it in GitHub Desktop.
Save rxin/6225543 to your computer and use it in GitHub Desktop.
Update Spark/Shark on EC2 AMI
set -e
set -o pipefail
/root/spark/bin/stop-all.sh
rm -rf ~/.ivy2/local/org.spark*
rm -rf ~/.ivy2/cache/org.spark*
cd /root/spark
git checkout master
git pull origin master
sbt/sbt clean package publish-local
cd /root/shark
git checkout master
git pull origin master
sbt/sbt clean package
/root/spark-ec2/copy-dir /root/spark
/root/spark-ec2/copy-dir /root/shark
/root/spark/bin/start-all.sh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment