Created
October 9, 2021 09:14
-
-
Save geosmart/33374f3ef37d40a63110bca7fd8250ca to your computer and use it in GitHub Desktop.
flinkx on k8s error log
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2021-10-09 09:06:10.974 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver - Recovered 0 pods from previous attempts, current attempt id is 1. | |
| 2021-10-09 09:06:10.975 [flink-akka.actor.default-dispatcher-4] INFO o.a.f.runtime.resourcemanager.active.ActiveResourceManager - Recovered 0 workers from previous attempt. | |
| 2021-10-09 09:06:10.977 [flink-akka.actor.default-dispatcher-4] INFO o.a.f.runtime.resourcemanager.active.ActiveResourceManager - ResourceManager akka.tcp://flink@flinkx-demo.dboard:6123/user/rpc/resourcemanager_0 was granted leadership with fencing token 00000000000000000000000000000000 | |
| 2021-10-09 09:06:10.981 [flink-akka.actor.default-dispatcher-4] INFO o.a.f.runtime.resourcemanager.slotmanager.SlotManagerImpl - Starting the SlotManager. | |
| 2021-10-09 09:06:11.181 [flink-akka.actor.default-dispatcher-5] INFO com.dtstack.flinkx.util.DataSyncFactoryUtil - load flinkx plugin hdfsreader:com.dtstack.flinkx.connector.hdfs.source.HdfsSourceFactory from /opt/flinkx/flinkx-dist | |
| 2021-10-09 09:06:11.263 [flink-akka.actor.default-dispatcher-5] INFO com.dtstack.flinkx.util.DataSyncFactoryUtil - load plugin by jars: ["file:/opt/flinkx/flinkx-dist/connector/hdfs/flinkx-connector-hdfs-v1.12.jar"] | |
| 2021-10-09 09:06:11.266 [flink-akka.actor.default-dispatcher-5] INFO com.dtstack.flinkx.classloader.ClassLoaderManager - jarUrl:file:/opt/flinkx/flinkx-dist/connector/hdfs/flinkx-connector-hdfs-v1.12.jar create ClassLoad successful... | |
| 2021-10-09 09:06:11.573 [flink-akka.actor.default-dispatcher-5] INFO com.dtstack.flinkx.util.DataSyncFactoryUtil - load flinkx plugin mysqlwriter:com.dtstack.flinkx.connector.mysql.sink.MysqlSinkFactory from /opt/flinkx/flinkx-dist | |
| 2021-10-09 09:06:11.575 [flink-akka.actor.default-dispatcher-5] INFO com.dtstack.flinkx.util.DataSyncFactoryUtil - load plugin by jars: ["file:/opt/flinkx/flinkx-dist/connector/mysql/flinkx-connector-mysql-v1.12.jar"] | |
| 2021-10-09 09:06:11.576 [flink-akka.actor.default-dispatcher-5] INFO com.dtstack.flinkx.classloader.ClassLoaderManager - jarUrl:file:/opt/flinkx/flinkx-dist/connector/mysql/flinkx-connector-mysql-v1.12.jar create ClassLoad successful... | |
| 2021-10-09 09:06:11.590 [flink-akka.actor.default-dispatcher-5] INFO com.dtstack.flinkx.connector.jdbc.util.JdbcUtil - before reset table info, schema: , table: mock_data | |
| 2021-10-09 09:06:11.871 [flink-akka.actor.default-dispatcher-5] INFO o.a.f.c.deployment.application.executors.EmbeddedExecutor - Job dfe0e01a4c1c3dc24120549959067137 is submitted. | |
| 2021-10-09 09:06:11.871 [flink-akka.actor.default-dispatcher-5] INFO o.a.f.c.deployment.application.executors.EmbeddedExecutor - Submitting Job with JobId=dfe0e01a4c1c3dc24120549959067137. | |
| 2021-10-09 09:06:14.404 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Received JobGraph submission dfe0e01a4c1c3dc24120549959067137 (DboardX-hdfs_parquet_mysql). | |
| 2021-10-09 09:06:14.405 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Submitting job dfe0e01a4c1c3dc24120549959067137 (DboardX-hdfs_parquet_mysql). | |
| 2021-10-09 09:06:14.429 [cluster-io-thread-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 . | |
| 2021-10-09 09:06:14.460 [cluster-io-thread-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Initializing job DboardX-hdfs_parquet_mysql (dfe0e01a4c1c3dc24120549959067137). | |
| 2021-10-09 09:06:14.475 [cluster-io-thread-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Using restart back off time strategy NoRestartBackoffTimeStrategy for DboardX-hdfs_parquet_mysql (dfe0e01a4c1c3dc24120549959067137). | |
| 2021-10-09 09:06:14.486 [cluster-io-thread-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - start to buildGraph for job DboardX-hdfs_parquet_mysql (dfe0e01a4c1c3dc24120549959067137). | |
| 2021-10-09 09:06:14.559 [cluster-io-thread-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - trying to download shipFile from blobServer for job DboardX-hdfs_parquet_mysql (dfe0e01a4c1c3dc24120549959067137). | |
| 2021-10-09 09:06:14.560 [cluster-io-thread-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Running initialization on master for job DboardX-hdfs_parquet_mysql (dfe0e01a4c1c3dc24120549959067137). | |
| 2021-10-09 09:06:14.658 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job dfe0e01a4c1c3dc24120549959067137 reached terminal state FAILED. | |
| 2021-10-09 09:06:14.781 [flink-akka.actor.default-dispatcher-5] WARN o.a.f.c.d.application.ApplicationDispatcherBootstrap - Application failed unexpectedly: | |
| java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. | |
| at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) | |
| at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) | |
| at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) | |
| at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) | |
| at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) | |
| at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) | |
| at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) | |
| at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) | |
| at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) | |
| at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) | |
| at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
| at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
| at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
| at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
| Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. | |
| ... 11 common frames omitted | |
| Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Failed to execute job 'DboardX-hdfs_parquet_mysql'. | |
| at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:366) | |
| at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:219) | |
| at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) | |
| at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) | |
| ... 10 common frames omitted | |
| Caused by: org.apache.flink.util.FlinkException: Failed to execute job 'DboardX-hdfs_parquet_mysql'. | |
| at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1918) | |
| at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:135) | |
| at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76) | |
| at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1782) | |
| at com.dtstack.flinkx.Main.exeSyncJob(Main.java:204) | |
| at com.dtstack.flinkx.Main.main(Main.java:100) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:498) | |
| at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:349) | |
| ... 13 common frames omitted | |
| Caused by: java.lang.RuntimeException: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager. | |
| at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:316) | |
| at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedFunction$2(FunctionUtils.java:75) | |
| at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) | |
| at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) | |
| at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456) | |
| at java.lang.Thread.run(Thread.java:748) | |
| Caused by: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager. | |
| at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:488) | |
| at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) | |
| ... 1 common frames omitted [156/2930] | |
| Caused by: org.apache.flink.runtime.client.JobExecutionException: Cannot initialize task 'Source: hdfssourcefactory -> Sink: mysqlsinkfactory': Loading the input/output formats failed: | |
| at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:293) | |
| at org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:322) | |
| at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:276) | |
| at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:249) | |
| at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:133) | |
| at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:111) | |
| at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:342) | |
| at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:327) | |
| at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:95) | |
| at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:39) | |
| at org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:163) | |
| at org.apache.flink.runtime.dispatcher.DefaultJobManagerRunnerFactory.createJobManagerRunner(DefaultJobManagerRunnerFactory.java:86) | |
| at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:472) | |
| ... 4 common frames omitted | |
| Caused by: java.lang.Exception: Loading the input/output formats failed: | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initInputOutputformatContainer(InputOutputFormatVertex.java:172) | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initializeOnMaster(InputOutputFormatVertex.java:57) | |
| at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:289) | |
| ... 16 common frames omitted | |
| Caused by: java.lang.RuntimeException: Deserializing the input/output formats failed: Could not read the user code wrapper: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatContainer.<init>(InputOutputFormatContainer.java:69) | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initInputOutputformatContainer(InputOutputFormatVertex.java:168) | |
| ... 18 common frames omitted | |
| Caused by: org.apache.flink.runtime.operators.util.CorruptConfigurationException: Could not read the user code wrapper: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| at org.apache.flink.runtime.operators.util.TaskConfig.getStubWrapper(TaskConfig.java:307) | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatContainer.<init>(InputOutputFormatContainer.java:66) | |
| ... 19 common frames omitted | |
| Caused by: java.lang.ClassNotFoundException: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| at java.net.URLClassLoader.findClass(URLClassLoader.java:382) | |
| at java.lang.ClassLoader.loadClass(ClassLoader.java:418) | |
| at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) | |
| at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) | |
| at java.lang.ClassLoader.loadClass(ClassLoader.java:351) | |
| at java.lang.Class.forName0(Native Method) | |
| at java.lang.Class.forName(Class.java:348) | |
| at org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:76) | |
| at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1986) | |
| at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1850) | |
| at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2160) | |
| at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2405) | |
| at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329) | |
| at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503) | |
| at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461) | |
| at java.util.HashMap.readObject(HashMap.java:1412) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:498) | |
| at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1184) | |
| at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2296) | |
| at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2405) | |
| at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329) | |
| at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2405) | |
| at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329) | |
| at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503) | |
| at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461) | |
| at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:615) | |
| at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:600) | |
| at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:587) | |
| at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:541) | |
| at org.apache.flink.runtime.operators.util.TaskConfig.getStubWrapper(TaskConfig.java:304) | |
| ... 20 common frames omitted | |
| 2021-10-09 09:06:14.785 [flink-akka.actor.default-dispatcher-5] ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Fatal error occurred in the cluster entrypoint. | |
| org.apache.flink.util.FlinkException: Application failed unexpectedly. | |
| at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAndShutdownClusterAsync$0(ApplicationDispatcherBootstrap.java:170) | |
| at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) | |
| at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) | |
| at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) | |
| at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) | |
| at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) [78/2930] | |
| at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) | |
| at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) | |
| at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) | |
| at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) | |
| at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) | |
| at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
| at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
| at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
| at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
| Caused by: java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. | |
| at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) | |
| at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) | |
| at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) | |
| at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) | |
| ... 13 common frames omitted | |
| Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. | |
| ... 11 common frames omitted | |
| Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Failed to execute job 'DboardX-hdfs_parquet_mysql'. | |
| at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:366) | |
| at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:219) | |
| at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) | |
| at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) | |
| ... 10 common frames omitted | |
| Caused by: org.apache.flink.util.FlinkException: Failed to execute job 'DboardX-hdfs_parquet_mysql'. | |
| at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1918) | |
| at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:135) | |
| at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76) | |
| at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1782) | |
| at com.dtstack.flinkx.Main.exeSyncJob(Main.java:204) | |
| at com.dtstack.flinkx.Main.main(Main.java:100) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:498) | |
| at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:349) | |
| ... 13 common frames omitted | |
| Caused by: java.lang.RuntimeException: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager. | |
| at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:316) | |
| at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedFunction$2(FunctionUtils.java:75) | |
| at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) | |
| at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) | |
| at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456) | |
| at java.lang.Thread.run(Thread.java:748) | |
| Caused by: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager. | |
| at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:488) | |
| at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) | |
| ... 1 common frames omitted | |
| Caused by: org.apache.flink.runtime.client.JobExecutionException: Cannot initialize task 'Source: hdfssourcefactory -> Sink: mysqlsinkfactory': Loading the input/output formats failed: | |
| at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:293) | |
| at org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:322) | |
| at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:276) | |
| at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:249) | |
| at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:133) | |
| at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:111) | |
| at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:342) | |
| at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:327) | |
| at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:95) | |
| at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:39) | |
| at org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:163) | |
| at org.apache.flink.runtime.dispatcher.DefaultJobManagerRunnerFactory.createJobManagerRunner(DefaultJobManagerRunnerFactory.java:86) | |
| at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:472) | |
| ... 4 common frames omitted | |
| Caused by: java.lang.Exception: Loading the input/output formats failed: | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initInputOutputformatContainer(InputOutputFormatVertex.java:172) | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initializeOnMaster(InputOutputFormatVertex.java:57) | |
| at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:289) | |
| ... 16 common frames omitted | |
| Caused by: java.lang.RuntimeException: Deserializing the input/output formats failed: Could not read the user code wrapper: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatContainer.<init>(InputOutputFormatContainer.java:69) | |
| at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initInputOutputformatContainer(InputOutputFormatVertex.java:168) | |
| ... 18 common frames omitted | |
| Caused by: org.apache.flink.runtime.operators.util.CorruptConfigurationException: Could not read the user code wrapper: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| 1063 Caused by: org.apache.flink.runtime.client.JobExecutionException: Cannot initialize task 'Source: hdfssourcefactory -> Sink: mysqlsinkfactory': Loading the input/output formats failed: | |
| 1064 at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:293) | |
| 1065 at org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:322) | |
| 1066 at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:276) | |
| 1067 at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:249) | |
| 1068 at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:133) | |
| 1069 at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:111) | |
| 1070 at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:342) | |
| 1071 at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:327) | |
| 1072 at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:95) | |
| 1073 at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:39) | |
| 1074 at org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:163) | |
| 1075 at org.apache.flink.runtime.dispatcher.DefaultJobManagerRunnerFactory.createJobManagerRunner(DefaultJobManagerRunnerFactory.java:86) | |
| 1076 at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:472) | |
| 1077 ... 4 common frames omitted | |
| 1078 Caused by: java.lang.Exception: Loading the input/output formats failed: | |
| 1079 at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initInputOutputformatContainer(InputOutputFormatVertex.java:172) | |
| 1080 at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initializeOnMaster(InputOutputFormatVertex.java:57) | |
| 1081 at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:289) | |
| 1082 ... 16 common frames omitted | |
| 1083 Caused by: java.lang.RuntimeException: Deserializing the input/output formats failed: Could not read the user code wrapper: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| 1084 at org.apache.flink.runtime.jobgraph.InputOutputFormatContainer.<init>(InputOutputFormatContainer.java:69) | |
| 1085 at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initInputOutputformatContainer(InputOutputFormatVertex.java:168) | |
| 1086 ... 18 common frames omitted | |
| 1087 Caused by: org.apache.flink.runtime.operators.util.CorruptConfigurationException: Could not read the user code wrapper: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| 1088 at org.apache.flink.runtime.operators.util.TaskConfig.getStubWrapper(TaskConfig.java:307) | |
| 1089 at org.apache.flink.runtime.jobgraph.InputOutputFormatContainer.<init>(InputOutputFormatContainer.java:66) | |
| 1090 ... 19 common frames omitted | |
| 1091 Caused by: java.lang.ClassNotFoundException: com.dtstack.flinkx.connector.jdbc.sink.JdbcOutputFormat | |
| 1092 at java.net.URLClassLoader.findClass(URLClassLoader.java:382) | |
| 1093 at java.lang.ClassLoader.loadClass(ClassLoader.java:418) | |
| 1094 at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) | |
| 1095 at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) | |
| 1096 at java.lang.ClassLoader.loadClass(ClassLoader.java:351) | |
| 1097 at java.lang.Class.forName0(Native Method) | |
| 1098 at java.lang.Class.forName(Class.java:348) | |
| 1099 at org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:76) | |
| 1100 at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1986) | |
| 1101 at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1850) | |
| 1102 at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2160) | |
| 1103 at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| 1104 at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2405) | |
| 1105 at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329) | |
| 1106 at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| 1107 at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| 1108 at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503) | |
| 1109 at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461) | |
| 1110 at java.util.HashMap.readObject(HashMap.java:1412) | |
| 1111 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| 1112 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) | |
| 1113 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| 1114 at java.lang.reflect.Method.invoke(Method.java:498) | |
| 1115 at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1184) | |
| 1116 at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2296) | |
| 1117 at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| 1118 at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| 1119 at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2405) | |
| 1120 at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329) | |
| 1121 at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| 1122 at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| 1123 at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2405) | |
| 1124 at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2329) | |
| 1125 at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2187) | |
| 1126 at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1667) | |
| 1127 at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503) | |
| 1128 at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461) | |
| 1129 at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:615) | |
| 1130 at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:600) | |
| 1131 at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:587) | |
| 1132 at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:541) | |
| 1133 at org.apache.flink.runtime.operators.util.TaskConfig.getStubWrapper(TaskConfig.java:304) | |
| 1134 ... 20 common frames omitted | |
| 1135 2021-10-09 09:09:21.172 [KubernetesApplicationClusterEntrypoint shutdown hook] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Shutting KubernetesApplicationClusterEntrypoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally.. | |
| 1136 2021-10-09 09:09:21.172 [BlobServer shutdown hook] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:6124 | |
| 1137 2021-10-09 09:09:21.172 [KubernetesApplicationClusterEntrypoint shutdown hook] INFO o.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Shutting down rest endpoint. | |
| 1138 2021-10-09 09:09:21.183 [Thread-11] INFO o.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Removing cache directory /tmp/flink-web-23aac393-482b-435c-98e0-e6c5928e07e9/flink-web-ui | |
| 1139 2021-10-09 09:09:21.184 [Thread-11] INFO o.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - http://flinkx-demo.dboard:8081 lost leadership | |
| 1140 2021-10-09 09:09:21.184 [Thread-11] INFO o.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Shut down complete. | |
| 1141 2021-10-09 09:09:21.184 [Thread-11] INFO o.a.f.r.e.component.DispatcherResourceManagerComponent - Closing components. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
参数：
-mode kubernetes-application
-jobType sync
-flinkConfDir /opt/flink/conf
-flinkLibDir /opt/flink/lib
-flinkxDistDir /opt/flinkx/flinkx-dist
-remoteFlinkxDistDir /opt/flinkx/flinkx-dist
-pluginLoadMode classpath
-jobName DboardX-hdfs_parquet_mysql
-job /mnt/servyou/flinkx/flinkx-local-test/target/test-classes/config/hdfs_parquet_mysql.json
-confProp {"kubernetes.cluster-id":"flinkx-demo","kubernetes.config.file":"/home/geosmart/.kube/config","kubernetes.container.image":"flink:0.2","kubernetes.namespace":"xxx","kubernetes.service-account":"xxx","kubernetes.jobmanager.cpu":"1","kubernetes.taskmanager.cpu":"1","taskmanager.numberOfTaskSlots":"1","jobmanager.memory.flink.size":"1gb","taskmanager.memory.process.size":"1gb","state.backend":"filesystem","flink.checkpoint.timeout":"50000","flink.checkpoint.interval":"60000","HADOOP_CONF_DIR":"","security.module.factory.classes":";","security.context.factory.classes":";","state.backend.fs.checkpointdir":"s3://dboard/FLINK/checkpoints/backend","state.checkpoints.dir":"s3://xxx/FLINK/checkpoints/metadata"}