Skip to content

Instantly share code, notes, and snippets.

@squarerock
Last active June 25, 2019 21:08
Show Gist options
  • Save squarerock/12093574436b66cc0301aab6e1faf88b to your computer and use it in GitHub Desktop.
Save squarerock/12093574436b66cc0301aab6e1faf88b to your computer and use it in GitHub Desktop.
Spark 2.1.0 Hadoop 2.7
class ApacheSpark < Formula
desc "Engine for large-scale data processing"
homepage "https://spark.apache.org/"
url "https://archive.apache.org/dist/spark/spark-2.1.0/spark-2.1.0-bin-hadoop2.7.tgz"
version "2.1.0"
sha256 "0834c775f38473f67cb122e0ec21074f800ced50c1ff1b9e37e222a0069dc5c7"
head "https://github.com/apache/spark.git"
bottle :unneeded
def install
# Rename beeline to distinguish it from hive's beeline
mv "bin/beeline", "bin/spark-beeline"
rm_f Dir["bin/*.cmd"]
libexec.install Dir["*"]
bin.write_exec_script Dir["#{libexec}/bin/*"]
end
test do
system "#{bin}/spark-shell <<<'sc.parallelize(1 to 1000).count()'"
end
end
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment