Skip to content

Instantly share code, notes, and snippets.

@danielscarvalho

danielscarvalho/apache.sh

Last active September 22, 2017 19:28
Show Gist options
  • Save danielscarvalho/ab368f55fe769a52273112047b25b4e8 to your computer and use it in GitHub Desktop.
Save danielscarvalho/ab368f55fe769a52273112047b25b4e8 to your computer and use it in GitHub Desktop.
Download ZIP
Apaceh Spark BigData
Raw
apache.sh
#source
export JAVA_HOME=/opt/jdk1.8.0_144
export SPARK_HOME=/opt/spark-2.2.0-bin-hadoop2.7
export SPARK_DIR=/opt/spark-2.2.0-bin-hadoop2.7
export PYSPARK_PYTHON=python3
export PYSPARK_DRIVER_PYTHON=ipython3
export PYSPARK_DRIVER_PYTHON_OPTS="notebook"
export PATH=$PATH:$SPARK_HOME/bin
pyspark
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment