Skip to content

Instantly share code, notes, and snippets.

@delip

delip/spark-setup-local.sh

Last active August 29, 2015 14:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save delip/1145fff857894445f6bc to your computer and use it in GitHub Desktop.
Save delip/1145fff857894445f6bc to your computer and use it in GitHub Desktop.
Download ZIP
Spark setup (local)
Raw
spark-setup-local.sh
#/bin/sh
# select the correct version of spark and hadoop
# (depends on your situation but go with the latest if possible).
# spark.apache.org/downloads.html
tar -xvzf spark-1.3.0-bin-hadoop2.4.tgz
ln -s spark-1.3.0-bin-hadoop2.4 spark
export SPARK_HOME=`pwd`/spark
export PATH=$SPARK_HOME/bin:$PATH
# At this point you might want add the above to export statements to
# your .bashrc or .zshrc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment