Skip to content

Instantly share code, notes, and snippets.

@pramodvspk
Created June 1, 2017 13:08
Show Gist options
  • Save pramodvspk/aafd6e363c499606a16b9d0bd18cb5cf to your computer and use it in GitHub Desktop.
Save pramodvspk/aafd6e363c499606a16b9d0bd18cb5cf to your computer and use it in GitHub Desktop.
Spark Batch Job using Type Safe Config
object BatchJob {
def main(args: Array[String]): Unit = {
SparkUtils.setupLogging()
val sparkProps = config.Settings.SparkProps
val executionMode = args(0) match {
case dev => sparkProps.devExecutionMode
case cluster => sparkProps.clusterExecutionMode
}
val conf = new SparkConf().setMaster(executionMode).setAppName("WordCount")
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment