Skip to content

Instantly share code, notes, and snippets.

@hadoopsters

hadoopsters/streamingLogLevel.scala

Last active September 18, 2018 12:21
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save hadoopsters/5da24ea7f7fe6bfd09479cc9c2852188 to your computer and use it in GitHub Desktop.
Save hadoopsters/5da24ea7f7fe6bfd09479cc9c2852188 to your computer and use it in GitHub Desktop.
Download ZIP
How to Change Log Level for Spark Streaming
Raw
streamingLogLevel.scala
val conf = new SparkConf().setAppName(appName) // run on cluster
val ssc = new StreamingContext(conf, Seconds(5))
val sc = ssc.sparkContext
sc.setLogLevel("ERROR")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment