Skip to content

Instantly share code, notes, and snippets.

@juanpampliega
Created May 24, 2015 04:40
Show Gist options
  • Save juanpampliega/f7eab1eb46a52254f9d9 to your computer and use it in GitHub Desktop.
Save juanpampliega/f7eab1eb46a52254f9d9 to your computer and use it in GitHub Desktop.
log4j.properties for lowering spark-shell logging to WARN level. This should be placed in $SPARK_HOME/conf directory.
# Set everything to be logged to the console
log4j.rootCategory=WARN, console
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n
# Settings to quiet third party logs that are too verbose
log4j.logger.org.eclipse.jetty=WARN
log4j.logger.org.apache.spark.repl.SparkIMain$exprTyper=WARN
log4j.logger.org.apache.spark.repl.SparkILoop$SparkILoopInterpreter=WARN
log4j.logger.org.apache.hadoop.io.compress.snappy.LoadSnappy=ERROR
log4j.logger.org.apache.hadoop.util.NativeCodeLoader=ERROR
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment