Last active
October 9, 2018 07:58
-
-
Save Shellbye/222f259d6bfba3d1a0369eb4f496ab24 to your computer and use it in GitHub Desktop.
Install spark 2.1.0 on ubuntu
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sudo wget http://d3kbcqa49mib13.cloudfront.net/spark-2.1.0-bin-hadoop2.7.tgz | |
sudo tar -zxvf spark-2.1.0-bin-hadoop2.7.tgz | |
cd spark-2.1.0-bin-hadoop2.7 | |
sudo cp conf/log4j.properties.template conf/log4j.properties | |
sudo sed -i -e 's/INFO/WARN/g' conf/log4j.properties | |
sudo cp conf/spark-env.sh.template conf/spark-env.sh | |
sudo cp conf/slaves.template conf/slaves | |
sudo ./bin/spark-submit examples/src/main/python/pi.py 10 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment