Skip to content

Instantly share code, notes, and snippets.

@HeartSaVioR

HeartSaVioR/zeppelin-log-scheduler-already-terminated.log

Created December 27, 2015 02:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save HeartSaVioR/26190a71df6815aa62b8 to your computer and use it in GitHub Desktop.
Save HeartSaVioR/26190a71df6815aa62b8 to your computer and use it in GitHub Desktop.
Download ZIP
Zeppelin error log - Scheduler already terminated
Raw
zeppelin-log-scheduler-already-terminated.log
INFO [2015-12-24 13:23:00,008] ({pool-1-thread-87} SchedulerFactory.java[jobStarted]:132) - Job paragraph_1450154939904_730596045 started by scheduler remoteinterpreter_2122769647
INFO [2015-12-24 13:23:00,008] ({pool-1-thread-87} Paragraph.java[jobRun]:191) - run paragraph 20151215-134859_1220614770 using null org.apache.zeppelin.interpreter.LazyOpenInterpreter@89c5e02
ERROR [2015-12-24 13:23:00,009] ({pool-1-thread-87} Job.java[run]:183) - Job failed
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:238)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212)
at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:320)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
at org.apache.thrift.protocol.TBinaryProtocol.writeI32(TBinaryProtocol.java:178)
at org.apache.thrift.protocol.TBinaryProtocol.writeMessageBegin(TBinaryProtocol.java:106)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.send_interpret(RemoteInterpreterService.java:214)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:204)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:220)
... 11 more
Caused by: java.net.SocketException: 파이프가 깨어짐
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 17 more
ERROR [2015-12-24 13:23:00,009] ({pool-1-thread-87} RemoteScheduler.java[getStatus]:268) - Can't get status information
org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
at org.apache.thrift.protocol.TBinaryProtocol.writeI32(TBinaryProtocol.java:178)
at org.apache.thrift.protocol.TBinaryProtocol.writeMessageBegin(TBinaryProtocol.java:106)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.send_getStatus(RemoteInterpreterService.java:349)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getStatus(RemoteInterpreterService.java:341)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:255)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:333)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: 파이프가 깨어짐
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 14 more
ERROR [2015-12-24 13:23:00,009] ({pool-1-thread-87} NotebookServer.java[afterStatusChange]:754) - Error
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:238)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212)
at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:320)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 17 more
INFO [2015-12-24 13:23:00,009] ({pool-1-thread-87} NotebookServer.java[afterStatusChange]:759) - Job 20151215-134859_1220614770 is finished
INFO [2015-12-24 13:23:00,010] ({pool-1-thread-87} SchedulerFactory.java[jobFinished]:138) - Job paragraph_1450154939904_730596045 finished by scheduler remoteinterpreter_2122769647
INFO [2015-12-24 13:23:21,944] ({qtp772517708-16399} InterpreterRestApi.java[restartSetting]:143) - Restart interpreterSetting 2AS9GKVMV
Exception in thread "Thread-16239" org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.close(RemoteInterpreter.java:180)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.close(LazyOpenInterpreter.java:78)
at org.apache.zeppelin.interpreter.InterpreterGroup$1.run(InterpreterGroup.java:81)
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
at org.apache.thrift.protocol.TBinaryProtocol.writeI32(TBinaryProtocol.java:178)
at org.apache.thrift.protocol.TBinaryProtocol.writeMessageBegin(TBinaryProtocol.java:106)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.send_close(RemoteInterpreterService.java:192)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.close(RemoteInterpreterService.java:184)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.close(RemoteInterpreter.java:178)
... 2 more
Caused by: java.net.SocketException: 파이프가 깨어짐
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 8 more
ERROR [2015-12-24 13:24:00,001] ({DefaultQuartzScheduler_Worker-6} JobRunShell.java[run]:211) - Job note.2B83NUA15 threw an unhandled Exception:
java.lang.RuntimeException: Scheduler already terminated
at org.apache.zeppelin.scheduler.RemoteScheduler.submit(RemoteScheduler.java:140)
at org.apache.zeppelin.notebook.Note.runAll(Note.java:326)
at org.apache.zeppelin.notebook.Notebook$CronJob.execute(Notebook.java:391)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
ERROR [2015-12-24 13:24:00,002] ({DefaultQuartzScheduler_Worker-6} QuartzScheduler.java[schedulerError]:2425) - Job (note.2B83NUA15 threw an exception.
org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.RuntimeException: Scheduler already terminated]
at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
Caused by: java.lang.RuntimeException: Scheduler already terminated
at org.apache.zeppelin.scheduler.RemoteScheduler.submit(RemoteScheduler.java:140)
at org.apache.zeppelin.notebook.Note.runAll(Note.java:326)
at org.apache.zeppelin.notebook.Notebook$CronJob.execute(Notebook.java:391)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
... 1 more
ERROR [2015-12-24 13:25:00,001] ({DefaultQuartzScheduler_Worker-7} JobRunShell.java[run]:211) - Job note.2B83NUA15 threw an unhandled Exception:
java.lang.RuntimeException: Scheduler already terminated
at org.apache.zeppelin.scheduler.RemoteScheduler.submit(RemoteScheduler.java:140)
at org.apache.zeppelin.notebook.Note.runAll(Note.java:326)
at org.apache.zeppelin.notebook.Notebook$CronJob.execute(Notebook.java:391)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
ERROR [2015-12-24 13:25:00,001] ({DefaultQuartzScheduler_Worker-7} QuartzScheduler.java[schedulerError]:2425) - Job (note.2B83NUA15 threw an exception.
org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.RuntimeException: Scheduler already terminated]
at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
Caused by: java.lang.RuntimeException: Scheduler already terminated
at org.apache.zeppelin.scheduler.RemoteScheduler.submit(RemoteScheduler.java:140)
at org.apache.zeppelin.notebook.Note.runAll(Note.java:326)
at org.apache.zeppelin.notebook.Notebook$CronJob.execute(Notebook.java:391)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
... 1 more
<path>/bin/interpreter.sh: line 160: 42640 죽었음 ${SPARK_SUBMIT} --class ${ZEPPELIN_SERVER} --driver-class-path "${ZEPPELIN_CLASSPATH_OVERRIDES}:${CLASSPATH}" --driver-java-options "${JAVA_INTP_OPTS}" ${SPARK_SUBMIT_OPTIONS} ${SPARK_APP_JAR} ${PORT}
INFO [2015-12-24 13:25:48,959] ({qtp772517708-16418} InterpreterRestApi.java[restartSetting]:143) - Restart interpreterSetting 2AS9GKVMV
ERROR [2015-12-24 13:26:07,745] ({Thread-13964} RemoteInterpreterEventPoller.java[run]:72) - Can't get RemoteInterpreterEvent
org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_getEvent(RemoteInterpreterService.java:377)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getEvent(RemoteInterpreterService.java:365)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller.run(RemoteInterpreterEventPoller.java:70)
INFO [2015-12-24 13:26:07,747] ({Exec Default Executor} RemoteInterpreterProcess.java[onProcessComplete]:205) - Interpreter process exited 0
INFO [2015-12-24 13:26:14,937] ({qtp772517708-16417} InterpreterRestApi.java[restartSetting]:143) - Restart interpreterSetting 2AS9GKVMV
INFO [2015-12-24 13:26:14,939] ({qtp772517708-16417} RemoteInterpreter.java[setInterpreterGroup]:358) - setInterpreterGroup = 2AS9GKVMV class=org.apache.zeppelin.spark.SparkInterpreter, path=/daum/program/incubator-zeppelin/interpreter/spark
INFO [2015-12-24 13:26:14,939] ({qtp772517708-16417} RemoteInterpreter.java[setInterpreterGroup]:358) - setInterpreterGroup = 2AS9GKVMV class=org.apache.zeppelin.spark.PySparkInterpreter, path=/daum/program/incubator-zeppelin/interpreter/spark
INFO [2015-12-24 13:26:14,939] ({qtp772517708-16417} RemoteInterpreter.java[setInterpreterGroup]:358) - setInterpreterGroup = 2AS9GKVMV class=org.apache.zeppelin.spark.SparkSqlInterpreter, path=/daum/program/incubator-zeppelin/interpreter/spark
INFO [2015-12-24 13:26:14,940] ({qtp772517708-16417} RemoteInterpreter.java[setInterpreterGroup]:358) - setInterpreterGroup = 2AS9GKVMV class=org.apache.zeppelin.spark.DepInterpreter, path=/daum/program/incubator-zeppelin/interpreter/spark
INFO [2015-12-24 13:26:38,723] ({pool-1-thread-88} SchedulerFactory.java[jobStarted]:132) - Job paragraph_1450931186271_-1952122462 started by scheduler remoteinterpreter_2119094813
INFO [2015-12-24 13:26:38,723] ({pool-1-thread-88} Paragraph.java[jobRun]:191) - run paragraph 20151224-132626_265264138 using spark org.apache.zeppelin.interpreter.LazyOpenInterpreter@7826f36b
INFO [2015-12-24 13:26:38,723] ({pool-1-thread-88} RemoteInterpreterProcess.java[reference]:108) - Run interpreter process [/daum/program/incubator-zeppelin/bin/interpreter.sh, -d, /daum/program/incubator-zeppelin/interpreter/spark, -p, 47627]
INFO [2015-12-24 13:26:39,725] ({pool-1-thread-88} RemoteInterpreter.java[init]:146) - Create remote interpreter org.apache.zeppelin.spark.SparkInterpreter
INFO [2015-12-24 13:26:39,741] ({pool-1-thread-88} RemoteInterpreter.java[init]:146) - Create remote interpreter org.apache.zeppelin.spark.PySparkInterpreter
INFO [2015-12-24 13:26:39,744] ({pool-1-thread-88} RemoteInterpreter.java[init]:146) - Create remote interpreter org.apache.zeppelin.spark.SparkSqlInterpreter
INFO [2015-12-24 13:26:39,745] ({pool-1-thread-88} RemoteInterpreter.java[init]:146) - Create remote interpreter org.apache.zeppelin.spark.DepInterpreter
INFO [2015-12-24 13:26:50,819] ({pool-1-thread-88} NotebookServer.java[afterStatusChange]:759) - Job 20151224-132626_265264138 is finished
INFO [2015-12-24 13:26:50,820] ({pool-1-thread-88} SchedulerFactory.java[jobFinished]:138) - Job paragraph_1450931186271_-1952122462 finished by scheduler remoteinterpreter_2119094813
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment