Skip to content

Instantly share code, notes, and snippets.

@tobegit3hub

tobegit3hub/configure_spark_on_yarn.md

Created October 5, 2015 14:17
Show Gist options
  • Save tobegit3hub/bba8cd3119c5d2b2d573 to your computer and use it in GitHub Desktop.
Save tobegit3hub/bba8cd3119c5d2b2d573 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
configure_spark_on_yarn.md 
export SPARK_MASTER_IP=192.168.0.8

export SCALA_HOME=/usr/lib/scala-2.10.5
export JAVA_HOME=/usr/lib/jvm/java-7-oracle/
export HADOOP_HOME=/usr/lib/hadoop
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop

SPARK_LOCAL_DIRS=/usr/lib/spark-1.5.0
SPARK_DRIVER_MEMORY=1G
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment