Skip to content

Instantly share code, notes, and snippets.

@oneamitj
Forked from domderen/install.sh
Last active December 19, 2015 02:50
Show Gist options
  • Save oneamitj/0b7e565fcb1a7270ebc4 to your computer and use it in GitHub Desktop.
Save oneamitj/0b7e565fcb1a7270ebc4 to your computer and use it in GitHub Desktop.
Installation of apache spark on ubuntu machine.
#!/bin/sh
# installation of Oracle Java JDK.
sudo apt-get -y update
sudo apt-get -y install python-software-properties
sudo add-apt-repository -y ppa:webupd8team/java
sudo apt-get -y update
sudo apt-get -y install oracle-java7-installer
# Installation of commonly used python scipy tools
sudo apt-get -y install python-numpy python-scipy python-matplotlib ipython ipython-notebook python-pandas python-sympy python-nose
# Installation of scala
wget http://www.scala-lang.org/files/archive/scala-2.11.7.deb
sudo dpkg -i scala-2.11.7.deb
sudo apt-get -y update
sudo apt-get -y install scala
# Installation of sbt
echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 642AC823
sudo apt-get -y update
sudo apt-get -y install sbt
# Downloading spark
wget http://www.us.apache.org/dist/spark/spark-1.5.2/spark-1.5.2.tgz
tar -zxf spark-1.5.2.tgz
cd spark-1.5.2.tgz
# Building spark
./sbt/sbt assembly
# Clean-up
rm scala-2.11.7.deb
rm spark-1.5.2.tgz
rm install-spark.sh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment