Skip to content

Instantly share code, notes, and snippets.

@SergeyAxenov
Last active October 21, 2021 14:51
Show Gist options
  • Save SergeyAxenov/9d1a89572239d2a0b33d2d7a57f6ec49 to your computer and use it in GitHub Desktop.
Save SergeyAxenov/9d1a89572239d2a0b33d2d7a57f6ec49 to your computer and use it in GitHub Desktop.
Logging from an Apache Zeppelin spark paragraph into a separate log file
# Set everything to be logged to the console
log4j.rootCategory=INFO, console
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n
# Settings to quiet third party logs that are too verbose
log4j.logger.org.eclipse.jetty=WARN
log4j.logger.org.eclipse.jetty.util.component.AbstractLifeCycle=ERROR
log4j.logger.org.apache.spark.repl.SparkIMain$exprTyper=INFO
log4j.logger.org.apache.spark.repl.SparkILoop$SparkILoopInterpreter=INFO
log4j.logger.org.apache.spark=WARN
# ====================================================================
# MyZeppelinLogger configuration
# ====================================================================
myLogDir=/home/someuser/apps/zeppelin/logs
# Log only to a separate file
#log4j.logger.MyZeppelinLogger=DEBUG, myzeppelinappender
# Log to a separate file and console
log4j.logger.MyZeppelinLogger=DEBUG, myzeppelinappender, console
log4j.additivity.MyZeppelinLogger=false
# Dedicated file appender for MyZeppelinLogger
log4j.appender.myzeppelinappender=org.apache.log4j.RollingFileAppender
log4j.appender.myzeppelinappender.file=${myLogDir}/myzeppelin.log
log4j.appender.myzeppelinappender.rollingPolicy.FileNamePattern=${myLogDir}/myzeppelin.%i.log
log4j.appender.myzeppelinappender.layout=org.apache.log4j.PatternLayout
log4j.appender.myzeppelinappender.layout.conversionPattern=[%p] %d{yyyy-MM-dd HH:mm:ss.SSS} [%t] %c{10} - %m %n
log4j.appender.myzeppelinappender.MaxFileSize=100MB
log4j.appender.myzeppelinappender.MaxBackupIndex=10
// ================================================================
// Gist
// Zeppelin Version 0.6.2
// Logging from zeppelin into a separate log file
// ================================================================
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
val logger: Logger = LoggerFactory.getLogger("MyZeppelinLogger");
logger.info("Test my logger");
@DupontC
Copy link

DupontC commented Jul 28, 2020

👍 Thanks !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment