Skip to content

Instantly share code, notes, and snippets.

@pltrdy
Forked from domderen/install.sh
Last active July 8, 2016 09:26
Show Gist options
  • Save pltrdy/b092ae8ccd060e6982a2 to your computer and use it in GitHub Desktop.
Save pltrdy/b092ae8ccd060e6982a2 to your computer and use it in GitHub Desktop.
Installation of apache spark on ubuntu machine.
#!/bin/sh
# stop execution on error
set -e
# installation of Oracle Java JDK.
sudo apt-get -y update
sudo apt-get -y install python-software-properties
sudo add-apt-repository -y ppa:webupd8team/java
sudo apt-get -y update
sudo apt-get -y install oracle-java7-installer
# Installation of commonly used python scipy tools
sudo apt-get -y install python-numpy python-scipy python-matplotlib ipython ipython-notebook python-pandas python-sympy python-nose
# Installation of scala
wget http://www.scala-lang.org/files/archive/scala-2.11.1.deb
sudo dpkg -i scala-2.11.1.deb
sudo apt-get -y update
sudo apt-get -y install scala
# Installation of sbt
wget http://scalasbt.artifactoryonline.com/scalasbt/sbt-native-packages/org/scala-sbt/sbt//0.12.3/sbt.deb
sudo dpkg -i sbt.deb
sudo apt-get -y update
sudo apt-get -y install sbt
# Downloading spark
wget http://apache.websitebeheerjd.nl/spark/spark-1.6.0/spark-1.6.0.tgz
tar -zxf spark-1.6.0.tgz
cd spark-1.6.0
# Building spark
./sbt/sbt assembly
# Clean-up
rm scala-2.11.1.deb
rm sbt.deb
rm spark-1.0.0.tgz
rm install.sh
@Leacan
Copy link

Leacan commented Mar 2, 2016

Line 34(sbt): I get as response: NOTE: The sbt/sbt script has been relocated to build/sbt.
Please update references to point to the new location.
Invoking 'build/sbt assembly' now ...
Attempting to fetch sbt

Our attempt to download sbt locally to build/sbt-launch-0.13.7.jar failed. Please install sbt manually from http://www.scala-sbt.org/

I have downloaded the jar, transfered it into the sbt file and renamed it. Again, Error. I realy dont get the soloution

@shubhabrataroy
Copy link

echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 2EE0EA64E40A89B84B2DF73499E82A75642AC823
sudo apt-get update
sudo apt-get install sbt

worked for me

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment