Skip to content

Instantly share code, notes, and snippets.

@koushikmln

koushikmln/KafkaMaprBuild.sbt

Created May 25, 2018 05:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save koushikmln/d0155e081f1e672dad567d9e3ca8a662 to your computer and use it in GitHub Desktop.
Save koushikmln/d0155e081f1e672dad567d9e3ca8a662 to your computer and use it in GitHub Desktop.
Download ZIP
Dependencies for Streaming Pipelines Demo on MapR Cluster
Raw
KafkaMaprBuild.sbt
name := "KafkaWorkshopMapr"
version := "0.1"
scalaVersion := "2.11.11"
libraryDependencies += "org.apache.spark" % "spark-core_2.11" % "2.2.1"
libraryDependencies += "org.apache.spark" % "spark-sql_2.11" % "2.2.1"
libraryDependencies += "org.apache.spark" % "spark-streaming_2.11" % "2.2.1"
libraryDependencies += "org.apache.spark" %% "spark-streaming-kafka-0-10" % "2.2.1"
libraryDependencies += "org.apache.hbase" % "hbase-client" % "1.1.8"
libraryDependencies += "org.apache.hbase" % "hbase-common" % "1.1.8"
libraryDependencies += "org.apache.kafka" %% "kafka" % "1.1.0"
libraryDependencies += "org.apache.kafka" % "kafka-clients" % "1.1.0"
libraryDependencies += "org.apache.hadoop" % "hadoop-common" % "2.7.0"
libraryDependencies += "com.typesafe" % "config" % "1.3.2"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment