Skip to content

Instantly share code, notes, and snippets.

@osipov
Last active August 29, 2015 14:04
Show Gist options
  • Save osipov/10f87d8665cbde495f8d to your computer and use it in GitHub Desktop.
Save osipov/10f87d8665cbde495f8d to your computer and use it in GitHub Desktop.
Makefile to download and build Spark 1.0.1 against Hadoop 2.4.0 on Ubuntu 14.04
all: prereq build
prereq:
apt-get -y install git
apt-get -y install curl
apt-get -y install openjdk-7-jdk
apt-get -y install maven
git clone https://github.com/apache/spark.git
cd spark; git checkout tags/v1.0.1
build:
export SPARK_HADOOP_VERSION=2.4.0
cd spark; ./sbt/sbt -Dhadoop.version=2.4.0 assembly
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment