Skip to content

Instantly share code, notes, and snippets.

@denysxftr

denysxftr/spark.sh

Created March 27, 2017 11:38
Show Gist options
  • Save denysxftr/45cd12e7dfe78f578a005285d33b6068 to your computer and use it in GitHub Desktop.
Save denysxftr/45cd12e7dfe78f578a005285d33b6068 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark.sh
sudo su
add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer
mkdir /usr/local/share/spark
curl http://d3kbcqa49mib13.cloudfront.net/spark-2.1.0-bin-hadoop2.7.tgz | tar xvz -C /usr/local/share/spark
cd /usr/local/share/spark/spark-2.1.0-bin-hadoop2.7/
./bin/run-example SparkPi 10 # output should contain Pi
# add this to your .bashrc
export SPARK_HOME=/usr/local/share/spark/spark-2.1.0-bin-hadoop2.7
export PYTHONPATH=$SPARK_HOME/python:$SPARK_HOME/python/build:$PYTHONPATH
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment