Skip to content

Instantly share code, notes, and snippets.

@ahoy-jon

ahoy-jon/build.sbt

Created June 28, 2016 14:22
Show Gist options
  • Save ahoy-jon/cab211a1d09a5c642f3047484ca17b60 to your computer and use it in GitHub Desktop.
Save ahoy-jon/cab211a1d09a5c642f3047484ca17b60 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
build.sbt
scalaVersion := "2.11.8"
name := "datacrunch"
val sparkV = "1.6.1"
libraryDependencies ++= Seq(
"com.chuusai" %% "shapeless" % "2.3.1"
)
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-core" % sparkV,
"org.apache.spark" %% "spark-streaming" % sparkV,
"org.apache.spark" %% "spark-mllib" % sparkV,
"org.apache.spark" %% "spark-hive" % sparkV,
"com.databricks" %% "spark-csv" % "1.2.0",
"com.databricks" %% "spark-avro" % "2.0.1"
)%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment