Create a gist now

Instantly share code, notes, and snippets.

What would you like to do?
Spark local lzo config one-paster
sudo su -
echo "export SPARK_LIBRARY_PATH=$SPARK_LIBRARY_PATH:/usr/lib/hadoop/lib/native/" >> /usr/lib/spark/bin/spark-class
echo "export CLASSPATH=$CLASSPATH:/usr/lib/hadoop/share/hadoop/common/lib/hadoop-lzo-0.4.20-SNAPSHOT.jar" >> /usr/lib/spark/bin/compute-classpath.sh
echo "export SPARK_LIBRARY_PATH=$SPARK_LIBRARY_PATH:/usr/lib/hadoop/lib/native/" >> /usr/lib/spark/bin/compute-classpath.sh
echo "export SPARK_CLASSPATH=$SPARK_CLASSPATH:/usr/lib/hadoop/share/hadoop/common/lib/" >> /usr/lib/spark/bin/compute-classpath.sh
echo "echo \"$CLASSPATH\"" >> /usr/lib/spark/bin/compute-classpath.sh
echo "SPARK_LIBRARY_PATH=$SPARK_LIBRARY_PATH:/usr/lib/hadoop/lib/native/" >> /etc/spark/conf/spark-env.sh
echo "SPARK_CLASSPATH=$SPARK_CLASSPATH:/usr/lib/hadoop/share/hadoop/common/lib/" >> /etc/spark/conf/spark-env.sh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment