Skip to content

Instantly share code, notes, and snippets.

@kaysush
Last active May 11, 2018 09:23
Show Gist options
  • Save kaysush/68caabe1ae9d6e8fbf9c138ba4889f8e to your computer and use it in GitHub Desktop.
Save kaysush/68caabe1ae9d6e8fbf9c138ba4889f8e to your computer and use it in GitHub Desktop.
build.sbt for Spark ML pipelines
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-core" % sparkVersion % "provided",
"org.apache.spark" %% "spark-sql" % sparkVersion % "provided",
"org.apache.spark" %% "spark-mllib" % sparkVersion % "provided"
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment