-
-
Save kylemeow/740c470d9b5a1ab3552376193920adce to your computer and use it in GitHub Desktop.
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2020-10-11 21:20:11.286 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- | |
2020-10-11 21:20:11.290 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesJobClusterEntrypoint (Version: 1.11.0, Scala: 2.11, Rev:1838a71, Date:2020-07-28T09:59:56+02:00) | |
2020-10-11 21:20:11.290 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink | |
2020-10-11 21:20:11.498 [main] WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable | |
2020-10-11 21:20:11.599 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: flink | |
2020-10-11 21:20:11.599 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM | |
2020-10-11 21:20:11.599 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 3193 MiBytes | |
2020-10-11 21:20:11.599 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/local/jdk/ | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 2.4.1 | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options: | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Duser.timezone=GMT+08 | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx3462817376 | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms3462817376 | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456 | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -verbose:gc | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:+PrintGCDetails | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:+PrintGCTimeStamps | |
2020-10-11 21:20:11.601 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/jobmanager.log | |
2020-10-11 21:20:11.602 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties | |
2020-10-11 21:20:11.602 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments: (none) | |
2020-10-11 21:20:11.602 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink-1.11.0/lib/flink-csv-1.11.0.jar:/opt/flink-1.11.0/lib/flink-json-1.11.0.jar:/opt/flink-1.11.0/lib/flink-shaded-hadoop-2-uber-2.4.1-9.0.jar:/opt/flink-1.11.0/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink-1.11.0/lib/flink-statebackend-rocksdb_2.11-1.11.0.jar:/opt/flink-1.11.0/lib/flink-table-blink_2.11-1.11.0.jar:/opt/flink-1.11.0/lib/flink-table_2.11-1.11.0.jar:/opt/flink-1.11.0/lib/flink-toolbox-1.0.0.jar:/opt/flink-1.11.0/lib/log4j-1.2-api-2.12.1.jar:/opt/flink-1.11.0/lib/log4j-api-2.12.1.jar:/opt/flink-1.11.0/lib/log4j-core-2.12.1.jar:/opt/flink-1.11.0/lib/log4j-slf4j-impl-2.12.1.jar:/opt/flink-1.11.0/lib/metrics-core-3.0.2.jar:/opt/flink-1.11.0/lib/flink-dist_2.11-1.11.0.jar::/opt/hadoop/conf::/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar | |
2020-10-11 21:20:11.602 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- | |
2020-10-11 21:20:11.603 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT] | |
2020-10-11 21:20:11.668 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.jobgraph-path, /var/flink-data/flink-files/job.graph | |
2020-10-11 21:20:11.668 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts, -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps | |
2020-10-11 21:20:11.668 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, myjob-201076.default | |
2020-10-11 21:20:11.669 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container-start-command-template, %java% -Duser.timezone=GMT+08 %classpath% %jvmmem% %jvmopts% %logging% %class% %args% | |
2020-10-11 21:20:11.669 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, myjob-201076 | |
2020-10-11 21:20:11.669 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.registration.timeout, 20 min | |
2020-10-11 21:20:11.669 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-port, 8081 | |
2020-10-11 21:20:11.669 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 50 | |
2020-10-11 21:20:11.670 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.namespace, default | |
2020-10-11 21:20:11.670 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.classpaths, file:/data/workspace/user/runtime/myjob/201076/shipFiles/flink-connector-kafka.jar;file:/data/workspace/user/runtime/myjob/201076/shipFiles/flink-connector-jdbc.jar | |
2020-10-11 21:20:11.670 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.heap.size, 4096m | |
2020-10-11 21:20:11.670 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesJobClusterEntrypoint | |
2020-10-11 21:20:11.671 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.rocksdb.localdir, /data/rocksdb | |
2020-10-11 21:20:11.671 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.web.submit.enable, false | |
2020-10-11 21:20:11.671 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 | |
2020-10-11 21:20:11.671 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: slot.request.timeout, 5000000 | |
2020-10-11 21:20:11.671 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image.pull-policy, IfNotPresent | |
2020-10-11 21:20:11.671 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy.fixed-delay.delay, 10s | |
2020-10-11 21:20:11.672 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: fs.hdfs.hadoopconf, /opt/cluster-admin/hadoop | |
2020-10-11 21:20:11.672 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: resourcemanager.taskmanager-timeout, 5000000 | |
2020-10-11 21:20:11.672 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend, rocksdb | |
2020-10-11 21:20:11.672 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.service-account, flink | |
2020-10-11 21:20:11.673 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124 | |
2020-10-11 21:20:11.673 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.num-retained, 2 | |
2020-10-11 21:20:11.673 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.savepoints.dir, hdfs:///state/user/id/myjob/flink-savepoints | |
2020-10-11 21:20:11.673 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.classpath.ship-jars, /var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar | |
2020-10-11 21:20:11.673 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.maximum-failed-containers, 65535 | |
2020-10-11 21:20:11.674 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false | |
2020-10-11 21:20:11.674 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: cluster.registration.max-timeout, 30000000 | |
2020-10-11 21:20:11.674 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, flink-k8s:v1.11.0 | |
2020-10-11 21:20:11.674 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.remote.file.dependencies, /user/hadoop/.flink/myjob-201076/1602422394680/job.graph | |
2020-10-11 21:20:11.674 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.application-attempts, 20 | |
2020-10-11 21:20:11.674 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 | |
2020-10-11 21:20:11.674 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: akka.ask.timeout, 60s | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: heartbeat.timeout, 300000 | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.fs.checkpointdir, hdfs:///state/user/id/myjob/flink-checkpoints | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: flink.partition-discovery.interval-millis, 30000 | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: web.timeout, 1000000 | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-per-job | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: slot.idle.timeout, 5000000 | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122 | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: cluster.services.shutdown-timeout, 3000000 | |
2020-10-11 21:20:11.675 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.enable.init.container, true | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.remote.jar.ship-to-system, /user/hadoop/.flink/myjob-201076/1602422394680/systemShipFiles/flink-connector-kafka.jar;/user/hadoop/.flink/myjob-201076/1602422394680/systemShipFiles/flink-connector-jdbc.jar | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.ship-directories, /usr/local/services/tstream_cluster_admin_V2-1.0/lib/ext;/data/workspace/user/runtime/myjob/201076/shipFiles | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, false | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, DETACHED | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy, fixed-delay | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts.taskmanager, -XX:ErrorFile=/tmp/taskmanager.err | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.heap.size, 4096m | |
2020-10-11 21:20:11.676 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: cluster.registration.refused-registration-delay, 3000000 | |
2020-10-11 21:20:11.677 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.dir, hdfs:///state/user/id/myjob/flink-checkpoints | |
2020-10-11 21:20:11.694 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesJobClusterEntrypoint. | |
2020-10-11 21:20:11.778 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem. | |
2020-10-11 21:20:11.798 [main] DEBUG org.apache.flink.core.fs.FileSystem [] - Loading extension file systems via services | |
2020-10-11 21:20:11.799 [main] DEBUG org.apache.flink.core.fs.FileSystem [] - Added file system maprfs:org.apache.flink.runtime.fs.maprfs.MapRFsFactory | |
2020-10-11 21:20:11.807 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context. | |
2020-10-11 21:20:11.873 [main] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Searching Hadoop configuration files in Flink config: /opt/cluster-admin/hadoop | |
2020-10-11 21:20:11.873 [main] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Searching Hadoop configuration files in HADOOP_CONF_DIR: /opt/hadoop/conf | |
2020-10-11 21:20:11.874 [main] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Adding /opt/hadoop/conf/core-site.xml to hadoop configuration | |
2020-10-11 21:20:11.874 [main] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Adding /opt/hadoop/conf/hdfs-site.xml to hadoop configuration | |
2020-10-11 21:20:11.898 [main] INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user set to flink (auth:SIMPLE) | |
2020-10-11 21:20:11.902 [main] INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-8506111776354236130.conf. | |
2020-10-11 21:20:11.908 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services. | |
2020-10-11 21:20:11.974 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address myjob-201076.default:6123, bind address 0.0.0.0:6123. | |
2020-10-11 21:20:12.110 [main] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Using akka configuration | |
Config(SimpleConfigObject({"akka":{"actor":{"default-dispatcher":{"executor":"fork-join-executor","fork-join-executor":{"parallelism-factor":2,"parallelism-max":64,"parallelism-min":8},"throughput":15},"guardian-supervisor-strategy":"org.apache.flink.runtime.akka.EscalatingSupervisorStrategy","provider":"akka.remote.RemoteActorRefProvider","supervisor-dispatcher":{"executor":"thread-pool-executor","thread-pool-executor":{"core-pool-size-max":1,"core-pool-size-min":1},"type":"Dispatcher"},"warn-about-java-serializer-usage":"off"},"daemonic":"off","jvm-exit-on-fatal-error":"on","log-config-on-start":"off","log-dead-letters":"off","log-dead-letters-during-shutdown":"off","loggers":["akka.event.slf4j.Slf4jLogger"],"logging-filter":"akka.event.slf4j.Slf4jLoggingFilter","loglevel":"DEBUG","remote":{"log-remote-lifecycle-events":"off","netty":{"tcp":{"bind-hostname":"0.0.0.0","bind-port":6123,"client-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"connection-timeout":"20000ms","hostname":"myjob-201076.default","maximum-frame-size":"10485760b","port":6123,"server-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"tcp-nodelay":"on","transport-class":"akka.remote.transport.netty.NettyTransport"}},"retry-gate-closed-for":"50 ms","startup-timeout":"600000ms","transport-failure-detector":{"acceptable-heartbeat-pause":"6000000ms","heartbeat-interval":"1000000ms","threshold":300}},"serialize-messages":"off","stdout-loglevel":"OFF"}})) | |
2020-10-11 21:20:12.612 [flink-akka.actor.default-dispatcher-2] INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started | |
2020-10-11 21:20:12.627 [flink-akka.actor.default-dispatcher-2] INFO akka.remote.Remoting [] - Starting remoting | |
2020-10-11 21:20:12.686 [flink-akka.remote.default-remote-dispatcher-6] DEBUG org.apache.flink.shaded.akka.org.jboss.netty.channel.socket.nio.SelectorUtil [] - Using select timeout of 500 | |
2020-10-11 21:20:12.686 [flink-akka.remote.default-remote-dispatcher-6] DEBUG org.apache.flink.shaded.akka.org.jboss.netty.channel.socket.nio.SelectorUtil [] - Epoll-bug workaround enabled = false | |
2020-10-11 21:20:12.884 [flink-akka.actor.default-dispatcher-2] INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@myjob-201076.default:6123] | |
2020-10-11 21:20:12.969 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@myjob-201076.default:6123 | |
2020-10-11 21:20:13.170 [main] INFO org.apache.flink.configuration.Configuration [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address' | |
2020-10-11 21:20:13.176 [main] INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/blobStore-bb1ee7a1-1c45-4931-b1bd-5ed68fca3a9b | |
2020-10-11 21:20:13.179 [main] DEBUG org.apache.flink.util.NetUtils [] - Trying to open socket on port 6124 | |
2020-10-11 21:20:13.179 [main] INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000 | |
2020-10-11 21:20:13.190 [main] DEBUG org.apache.flink.runtime.metrics.ReporterSetup [] - Found reporter factory org.apache.flink.metrics.datadog.DatadogHttpReporterFactory at /opt/flink-1.11.0/plugins/metrics-datadog/flink-metrics-datadog-1.11.0.jar | |
2020-10-11 21:20:13.191 [main] DEBUG org.apache.flink.runtime.metrics.ReporterSetup [] - Found reporter factory org.apache.flink.metrics.statsd.StatsDReporterFactory at /opt/flink-1.11.0/plugins/metrics-statsd/flink-metrics-statsd-1.11.0.jar | |
2020-10-11 21:20:13.192 [main] DEBUG org.apache.flink.runtime.metrics.ReporterSetup [] - Found reporter factory org.apache.flink.metrics.prometheus.PrometheusReporterFactory at /opt/flink-1.11.0/plugins/metrics-prometheus/flink-metrics-prometheus-1.11.0.jar | |
2020-10-11 21:20:13.192 [main] DEBUG org.apache.flink.runtime.metrics.ReporterSetup [] - Found reporter factory org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporterFactory at /opt/flink-1.11.0/plugins/metrics-prometheus/flink-metrics-prometheus-1.11.0.jar | |
2020-10-11 21:20:13.193 [main] DEBUG org.apache.flink.runtime.metrics.ReporterSetup [] - Found reporter factory org.apache.flink.metrics.slf4j.Slf4jReporterFactory at /opt/flink-1.11.0/plugins/metrics-slf4j/flink-metrics-slf4j-1.11.0.jar | |
2020-10-11 21:20:13.194 [main] DEBUG org.apache.flink.runtime.metrics.ReporterSetup [] - Found reporter factory org.apache.flink.metrics.graphite.GraphiteReporterFactory at /opt/flink-1.11.0/plugins/metrics-graphite/flink-metrics-graphite-1.11.0.jar | |
2020-10-11 21:20:13.195 [main] DEBUG org.apache.flink.runtime.metrics.ReporterSetup [] - Found reporter factory org.apache.flink.metrics.jmx.JMXReporterFactory at /opt/flink-1.11.0/plugins/metrics-jmx/flink-metrics-jmx-1.11.0.jar | |
2020-10-11 21:20:13.530 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address myjob-201076.default:0, bind address 0.0.0.0:0. | |
2020-10-11 21:20:13.532 [main] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Using akka configuration | |
Config(SimpleConfigObject({"akka":{"actor":{"default-dispatcher":{"executor":"thread-pool-executor","thread-pool-executor":{"core-pool-size-max":1,"core-pool-size-min":1},"thread-priority":1,"throughput":15,"type":"akka.dispatch.PriorityThreadsDispatcher"},"guardian-supervisor-strategy":"org.apache.flink.runtime.akka.EscalatingSupervisorStrategy","provider":"akka.remote.RemoteActorRefProvider","supervisor-dispatcher":{"executor":"thread-pool-executor","thread-pool-executor":{"core-pool-size-max":1,"core-pool-size-min":1},"type":"Dispatcher"},"warn-about-java-serializer-usage":"off"},"daemonic":"off","jvm-exit-on-fatal-error":"on","log-config-on-start":"off","log-dead-letters":"off","log-dead-letters-during-shutdown":"off","loggers":["akka.event.slf4j.Slf4jLogger"],"logging-filter":"akka.event.slf4j.Slf4jLoggingFilter","loglevel":"DEBUG","remote":{"log-remote-lifecycle-events":"off","netty":{"tcp":{"bind-hostname":"0.0.0.0","bind-port":0,"client-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"connection-timeout":"20000ms","hostname":"myjob-201076.default","maximum-frame-size":"10485760b","port":0,"server-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"tcp-nodelay":"on","transport-class":"akka.remote.transport.netty.NettyTransport"}},"retry-gate-closed-for":"50 ms","startup-timeout":"600000ms","transport-failure-detector":{"acceptable-heartbeat-pause":"6000000ms","heartbeat-interval":"1000000ms","threshold":300}},"serialize-messages":"off","stdout-loglevel":"OFF"}})) | |
2020-10-11 21:20:13.574 [flink-metrics-2] INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started | |
2020-10-11 21:20:13.577 [flink-metrics-2] INFO akka.remote.Remoting [] - Starting remoting | |
2020-10-11 21:20:13.583 [flink-metrics-2] INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@myjob-201076.default:37001] | |
2020-10-11 21:20:13.592 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@myjob-201076.default:37001 | |
2020-10-11 21:20:13.600 [flink-metrics-akka.actor.supervisor-dispatcher-10] DEBUG org.apache.flink.runtime.rpc.akka.SupervisorActor [] - Starting AkkaRpcActor with name MetricQueryService. | |
2020-10-11 21:20:13.667 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService . | |
2020-10-11 21:20:13.766 [main] WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'jobmanager.web.submit.enable' instead of proper key 'web.submit.enable' | |
2020-10-11 21:20:13.767 [main] INFO org.apache.flink.configuration.Configuration [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address' | |
2020-10-11 21:20:13.768 [main] INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a/flink-web-upload does not exist. | |
2020-10-11 21:20:13.769 [main] INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a/flink-web-upload for file uploads. | |
2020-10-11 21:20:13.781 [main] DEBUG org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory [] - Starting Dispatcher REST endpoint. | |
2020-10-11 21:20:13.782 [main] INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint. | |
2020-10-11 21:20:13.999 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.logging.InternalLoggerFactory [] - Using SLF4J as the default logging framework | |
2020-10-11 21:20:14.001 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.InternalThreadLocalMap [] - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 | |
2020-10-11 21:20:14.001 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.InternalThreadLocalMap [] - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 | |
2020-10-11 21:20:14.100 [main] INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/flink/log/jobmanager.log | |
2020-10-11 21:20:14.100 [main] INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/flink/log/jobmanager.out | |
2020-10-11 21:20:14.180 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - -Dio.netty.noUnsafe: false | |
2020-10-11 21:20:14.180 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - Java version: 8 | |
2020-10-11 21:20:14.181 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - sun.misc.Unsafe.theUnsafe: available | |
2020-10-11 21:20:14.181 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - sun.misc.Unsafe.copyMemory: available | |
2020-10-11 21:20:14.182 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - java.nio.Buffer.address: available | |
2020-10-11 21:20:14.182 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - direct buffer constructor: available | |
2020-10-11 21:20:14.183 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - java.nio.Bits.unaligned: available, true | |
2020-10-11 21:20:14.183 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 | |
2020-10-11 21:20:14.183 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 [] - java.nio.DirectByteBuffer.<init>(long, int): available | |
2020-10-11 21:20:14.183 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent [] - sun.misc.Unsafe: available | |
2020-10-11 21:20:14.183 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent [] - -Dio.netty.tmpdir: /tmp (java.io.tmpdir) | |
2020-10-11 21:20:14.183 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent [] - -Dio.netty.bitMode: 64 (sun.arch.data.model) | |
2020-10-11 21:20:14.184 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent [] - -Dio.netty.maxDirectMemory: 3349020672 bytes | |
2020-10-11 21:20:14.184 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent [] - -Dio.netty.uninitializedArrayAllocationThreshold: -1 | |
2020-10-11 21:20:14.185 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.CleanerJava6 [] - java.nio.ByteBuffer.cleaner(): available | |
2020-10-11 21:20:14.185 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent [] - -Dio.netty.noPreferDirect: false | |
2020-10-11 21:20:14.188 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.ShutdownHandler@2de50ee4 under DELETE@/v1/cluster. | |
2020-10-11 21:20:14.188 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.ShutdownHandler@2de50ee4 under DELETE@/cluster. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.DashboardConfigHandler@53b8afea under GET@/v1/config. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.DashboardConfigHandler@53b8afea under GET@/config. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.dataset.ClusterDataSetListHandler@6c302a1d under GET@/v1/datasets. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.dataset.ClusterDataSetListHandler@6c302a1d under GET@/datasets. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.dataset.ClusterDataSetDeleteHandlers$ClusterDataSetDeleteStatusHandler@33a3c44a under GET@/v1/datasets/delete/:triggerid. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.dataset.ClusterDataSetDeleteHandlers$ClusterDataSetDeleteStatusHandler@33a3c44a under GET@/datasets/delete/:triggerid. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.dataset.ClusterDataSetDeleteHandlers$ClusterDataSetDeleteTriggerHandler@5fcfca62 under DELETE@/v1/datasets/:datasetid. | |
2020-10-11 21:20:14.189 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.dataset.ClusterDataSetDeleteHandlers$ClusterDataSetDeleteTriggerHandler@5fcfca62 under DELETE@/datasets/:datasetid. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.ClusterConfigHandler@499ef98e under GET@/v1/jobmanager/config. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.ClusterConfigHandler@499ef98e under GET@/jobmanager/config. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerLogFileHandler@24934262 under GET@/v1/jobmanager/log. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerLogFileHandler@24934262 under GET@/jobmanager/log. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerLogListHandler@93f432e under GET@/v1/jobmanager/logs. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerLogListHandler@93f432e under GET@/jobmanager/logs. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerCustomLogHandler@288214b1 under GET@/v1/jobmanager/logs/:filename. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerCustomLogHandler@288214b1 under GET@/jobmanager/logs/:filename. | |
2020-10-11 21:20:14.190 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobManagerMetricsHandler@16eedaa6 under GET@/v1/jobmanager/metrics. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobManagerMetricsHandler@16eedaa6 under GET@/jobmanager/metrics. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerLogFileHandler@28501a4b under GET@/v1/jobmanager/stdout. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.JobManagerLogFileHandler@28501a4b under GET@/jobmanager/stdout. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobIdsHandler@5b051a5c under GET@/v1/jobs. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobIdsHandler@5b051a5c under GET@/jobs. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.AggregatingJobsMetricsHandler@639aba11 under GET@/v1/jobs/metrics. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.AggregatingJobsMetricsHandler@639aba11 under GET@/jobs/metrics. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobsOverviewHandler@341672e under GET@/v1/jobs/overview. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobsOverviewHandler@341672e under GET@/jobs/overview. | |
2020-10-11 21:20:14.191 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobDetailsHandler@2bebb74f under GET@/v1/jobs/:jobid. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobDetailsHandler@2bebb74f under GET@/jobs/:jobid. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobCancellationHandler@58cf8f94 under PATCH@/v1/jobs/:jobid. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobCancellationHandler@58cf8f94 under PATCH@/jobs/:jobid. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobAccumulatorsHandler@6e33fcae under GET@/v1/jobs/:jobid/accumulators. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobAccumulatorsHandler@6e33fcae under GET@/jobs/:jobid/accumulators. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler@66c38e51 under GET@/v1/jobs/:jobid/checkpoints. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler@66c38e51 under GET@/jobs/:jobid/checkpoints. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointConfigHandler@10641c09 under GET@/v1/jobs/:jobid/checkpoints/config. | |
2020-10-11 21:20:14.192 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointConfigHandler@10641c09 under GET@/jobs/:jobid/checkpoints/config. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointStatisticDetailsHandler@34f392be under GET@/v1/jobs/:jobid/checkpoints/details/:checkpointid. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointStatisticDetailsHandler@34f392be under GET@/jobs/:jobid/checkpoints/details/:checkpointid. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.TaskCheckpointStatisticDetailsHandler@4554de02 under GET@/v1/jobs/:jobid/checkpoints/details/:checkpointid/subtasks/:vertexid. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.checkpoints.TaskCheckpointStatisticDetailsHandler@4554de02 under GET@/jobs/:jobid/checkpoints/details/:checkpointid/subtasks/:vertexid. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobConfigHandler@3f9f71ff under GET@/v1/jobs/:jobid/config. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobConfigHandler@3f9f71ff under GET@/jobs/:jobid/config. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.coordination.ClientCoordinationHandler@fabb651 under POST@/v1/jobs/:jobid/coordinators/:operatorid. | |
2020-10-11 21:20:14.193 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.coordination.ClientCoordinationHandler@fabb651 under POST@/jobs/:jobid/coordinators/:operatorid. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobExceptionsHandler@27e5b378 under GET@/v1/jobs/:jobid/exceptions. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobExceptionsHandler@27e5b378 under GET@/jobs/:jobid/exceptions. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler@4422dd48 under GET@/v1/jobs/:jobid/execution-result. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler@4422dd48 under GET@/jobs/:jobid/execution-result. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobMetricsHandler@764cba under GET@/v1/jobs/:jobid/metrics. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobMetricsHandler@764cba under GET@/jobs/:jobid/metrics. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobPlanHandler@523d6bdb under GET@/v1/jobs/:jobid/plan. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobPlanHandler@523d6bdb under GET@/jobs/:jobid/plan. | |
2020-10-11 21:20:14.194 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.rescaling.RescalingHandlers$RescalingTriggerHandler@58496c97 under PATCH@/v1/jobs/:jobid/rescaling. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.rescaling.RescalingHandlers$RescalingTriggerHandler@58496c97 under PATCH@/jobs/:jobid/rescaling. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.rescaling.RescalingHandlers$RescalingStatusHandler@ad3324b under GET@/v1/jobs/:jobid/rescaling/:triggerid. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.rescaling.RescalingHandlers$RescalingStatusHandler@ad3324b under GET@/jobs/:jobid/rescaling/:triggerid. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointHandlers$SavepointTriggerHandler@3872bc37 under POST@/v1/jobs/:jobid/savepoints. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointHandlers$SavepointTriggerHandler@3872bc37 under POST@/jobs/:jobid/savepoints. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointHandlers$SavepointStatusHandler@1a87b51 under GET@/v1/jobs/:jobid/savepoints/:triggerid. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointHandlers$SavepointStatusHandler@1a87b51 under GET@/jobs/:jobid/savepoints/:triggerid. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointHandlers$StopWithSavepointHandler@12968227 under POST@/v1/jobs/:jobid/stop. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointHandlers$StopWithSavepointHandler@12968227 under POST@/jobs/:jobid/stop. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexDetailsHandler@144ab54 under GET@/v1/jobs/:jobid/vertices/:vertexid. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexDetailsHandler@144ab54 under GET@/jobs/:jobid/vertices/:vertexid. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexAccumulatorsHandler@2cfa2c4f under GET@/v1/jobs/:jobid/vertices/:vertexid/accumulators. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexAccumulatorsHandler@2cfa2c4f under GET@/jobs/:jobid/vertices/:vertexid/accumulators. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexBackPressureHandler@6ecab872 under GET@/v1/jobs/:jobid/vertices/:vertexid/backpressure. | |
2020-10-11 21:20:14.195 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexBackPressureHandler@6ecab872 under GET@/jobs/:jobid/vertices/:vertexid/backpressure. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobVertexMetricsHandler@48eb9836 under GET@/v1/jobs/:jobid/vertices/:vertexid/metrics. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobVertexMetricsHandler@48eb9836 under GET@/jobs/:jobid/vertices/:vertexid/metrics. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtasksAllAccumulatorsHandler@6c518474 under GET@/v1/jobs/:jobid/vertices/:vertexid/subtasks/accumulators. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtasksAllAccumulatorsHandler@6c518474 under GET@/jobs/:jobid/vertices/:vertexid/subtasks/accumulators. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.AggregatingSubtasksMetricsHandler@11b455e5 under GET@/v1/jobs/:jobid/vertices/:vertexid/subtasks/metrics. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.AggregatingSubtasksMetricsHandler@11b455e5 under GET@/jobs/:jobid/vertices/:vertexid/subtasks/metrics. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtaskCurrentAttemptDetailsHandler@2a066689 under GET@/v1/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtaskCurrentAttemptDetailsHandler@2a066689 under GET@/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtaskExecutionAttemptDetailsHandler@3e3861d7 under GET@/v1/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex/attempts/:attempt. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtaskExecutionAttemptDetailsHandler@3e3861d7 under GET@/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex/attempts/:attempt. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtaskExecutionAttemptAccumulatorsHandler@5e2a3040 under GET@/v1/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex/attempts/:attempt/accumulators. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtaskExecutionAttemptAccumulatorsHandler@5e2a3040 under GET@/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex/attempts/:attempt/accumulators. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.SubtaskMetricsHandler@6d025d1d under GET@/v1/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex/metrics. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.SubtaskMetricsHandler@6d025d1d under GET@/jobs/:jobid/vertices/:vertexid/subtasks/:subtaskindex/metrics. | |
2020-10-11 21:20:14.196 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtasksTimesHandler@74294c1a under GET@/v1/jobs/:jobid/vertices/:vertexid/subtasktimes. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.SubtasksTimesHandler@74294c1a under GET@/jobs/:jobid/vertices/:vertexid/subtasktimes. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexTaskManagersHandler@9e2ad91 under GET@/v1/jobs/:jobid/vertices/:vertexid/taskmanagers. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobVertexTaskManagersHandler@9e2ad91 under GET@/jobs/:jobid/vertices/:vertexid/taskmanagers. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobVertexWatermarksHandler@64524dd under GET@/v1/jobs/:jobid/vertices/:vertexid/watermarks. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.JobVertexWatermarksHandler@64524dd under GET@/jobs/:jobid/vertices/:vertexid/watermarks. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobCancellationHandler@79d06bbd under GET@/v1/jobs/:jobid/yarn-cancel. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobCancellationHandler@79d06bbd under GET@/jobs/:jobid/yarn-cancel. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobCancellationHandler@47a7a101 under GET@/v1/jobs/:jobid/yarn-stop. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.JobCancellationHandler@47a7a101 under GET@/jobs/:jobid/yarn-stop. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.ClusterOverviewHandler@5bb51241 under GET@/v1/overview. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.cluster.ClusterOverviewHandler@5bb51241 under GET@/overview. | |
2020-10-11 21:20:14.197 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointDisposalHandlers$SavepointDisposalTriggerHandler@7479b626 under POST@/v1/savepoint-disposal. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointDisposalHandlers$SavepointDisposalTriggerHandler@7479b626 under POST@/savepoint-disposal. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointDisposalHandlers$SavepointDisposalStatusHandler@e8ea697 under GET@/v1/savepoint-disposal/:triggerid. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.savepoints.SavepointDisposalHandlers$SavepointDisposalStatusHandler@e8ea697 under GET@/savepoint-disposal/:triggerid. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagersHandler@74dbb1ee under GET@/v1/taskmanagers. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagersHandler@74dbb1ee under GET@/taskmanagers. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.AggregatingTaskManagersMetricsHandler@70f822e under GET@/v1/taskmanagers/metrics. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.AggregatingTaskManagersMetricsHandler@70f822e under GET@/taskmanagers/metrics. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerDetailsHandler@3efedc6f under GET@/v1/taskmanagers/:taskmanagerid. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerDetailsHandler@3efedc6f under GET@/taskmanagers/:taskmanagerid. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerLogFileHandler@45bf6f39 under GET@/v1/taskmanagers/:taskmanagerid/log. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerLogFileHandler@45bf6f39 under GET@/taskmanagers/:taskmanagerid/log. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerLogListHandler@6c42f2a1 under GET@/v1/taskmanagers/:taskmanagerid/logs. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerLogListHandler@6c42f2a1 under GET@/taskmanagers/:taskmanagerid/logs. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerCustomLogHandler@17a703f5 under GET@/v1/taskmanagers/:taskmanagerid/logs/:filename. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerCustomLogHandler@17a703f5 under GET@/taskmanagers/:taskmanagerid/logs/:filename. | |
2020-10-11 21:20:14.198 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.TaskManagerMetricsHandler@5ff2b8ca under GET@/v1/taskmanagers/:taskmanagerid/metrics. | |
2020-10-11 21:20:14.199 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.job.metrics.TaskManagerMetricsHandler@5ff2b8ca under GET@/taskmanagers/:taskmanagerid/metrics. | |
2020-10-11 21:20:14.199 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler@618ad2aa under GET@/v1/taskmanagers/:taskmanagerid/stdout. | |
2020-10-11 21:20:14.199 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler@618ad2aa under GET@/taskmanagers/:taskmanagerid/stdout. | |
2020-10-11 21:20:14.199 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerThreadDumpHandler@1aa6e3c0 under GET@/v1/taskmanagers/:taskmanagerid/thread-dump. | |
2020-10-11 21:20:14.199 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerThreadDumpHandler@1aa6e3c0 under GET@/taskmanagers/:taskmanagerid/thread-dump. | |
2020-10-11 21:20:14.199 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.legacy.files.StaticFileServerHandler@3531f3ca under GET@/v1/:*. | |
2020-10-11 21:20:14.199 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Register handler org.apache.flink.runtime.rest.handler.legacy.files.StaticFileServerHandler@3531f3ca under GET@/:*. | |
2020-10-11 21:20:14.202 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.MultithreadEventLoopGroup [] - -Dio.netty.eventLoopThreads: 2 | |
2020-10-11 21:20:14.275 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop [] - -Dio.netty.noKeySetOptimization: false | |
2020-10-11 21:20:14.276 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop [] - -Dio.netty.selectorAutoRebuildThreshold: 512 | |
2020-10-11 21:20:14.280 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent [] - org.jctools-core.MpscChunkedArrayQueue: available | |
2020-10-11 21:20:14.292 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelId [] - -Dio.netty.processId: 1 (auto-detected) | |
2020-10-11 21:20:14.294 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil [] - -Djava.net.preferIPv4Stack: false | |
2020-10-11 21:20:14.294 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil [] - -Djava.net.preferIPv6Addresses: false | |
2020-10-11 21:20:14.295 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil [] - Loopback interface: lo (lo, 127.0.0.1) | |
2020-10-11 21:20:14.295 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil [] - /proc/sys/net/core/somaxconn: 128 | |
2020-10-11 21:20:14.296 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelId [] - -Dio.netty.machineId: 20:90:6f:ff:fe:87:72:f3 (auto-detected) | |
2020-10-11 21:20:14.304 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector [] - -Dorg.apache.flink.shaded.netty4.io.netty.leakDetection.level: simple | |
2020-10-11 21:20:14.304 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector [] - -Dorg.apache.flink.shaded.netty4.io.netty.leakDetection.targetRecords: 4 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.numHeapArenas: 2 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.numDirectArenas: 2 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.pageSize: 8192 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.maxOrder: 11 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.chunkSize: 16777216 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.tinyCacheSize: 512 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.smallCacheSize: 256 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.normalCacheSize: 64 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.cacheTrimInterval: 8192 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.useCacheForAllThreads: true | |
2020-10-11 21:20:14.370 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator [] - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 | |
2020-10-11 21:20:14.376 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil [] - -Dio.netty.allocator.type: pooled | |
2020-10-11 21:20:14.376 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil [] - -Dio.netty.threadLocalDirectBufferSize: 0 | |
2020-10-11 21:20:14.376 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil [] - -Dio.netty.maxThreadLocalCharBufferSize: 16384 | |
2020-10-11 21:20:14.383 [main] DEBUG org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Binding rest endpoint to null:8081. | |
2020-10-11 21:20:14.384 [main] INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at myjob-201076.default:8081 | |
2020-10-11 21:20:14.384 [main] INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://myjob-201076.default:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000 | |
2020-10-11 21:20:14.385 [main] INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://myjob-201076.default:8081. | |
2020-10-11 21:20:14.392 [main] INFO org.apache.flink.runtime.util.config.memory.MemoryBackwardsCompatibilityUtils [] - 'taskmanager.memory.process.size' is not specified, use the configured deprecated task manager heap value (4.000gb (4294967296 bytes)) for it. | |
2020-10-11 21:20:14.408 [main] DEBUG org.apache.flink.kubernetes.kubeclient.KubeClientFactory [] - Trying to load default kubernetes config. | |
2020-10-11 21:20:14.771 [flink-akka.actor.supervisor-dispatcher-12] DEBUG org.apache.flink.runtime.rpc.akka.SupervisorActor [] - Starting FencedAkkaRpcActor with name resourcemanager_0. | |
2020-10-11 21:20:14.772 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.kubernetes.KubernetesResourceManager at akka://flink/user/rpc/resourcemanager_0 . | |
2020-10-11 21:20:14.780 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.jobgraph-path, /var/flink-data/flink-files/job.graph | |
2020-10-11 21:20:14.780 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts, -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps | |
2020-10-11 21:20:14.780 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, myjob-201076.default | |
2020-10-11 21:20:14.780 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container-start-command-template, %java% -Duser.timezone=GMT+08 %classpath% %jvmmem% %jvmopts% %logging% %class% %args% | |
2020-10-11 21:20:14.780 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, myjob-201076 | |
2020-10-11 21:20:14.780 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.registration.timeout, 20 min | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-port, 8081 | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 50 | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.namespace, default | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.classpaths, file:/data/workspace/user/runtime/myjob/201076/shipFiles/flink-connector-kafka.jar;file:/data/workspace/user/runtime/myjob/201076/shipFiles/flink-connector-jdbc.jar | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.heap.size, 4096m | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesJobClusterEntrypoint | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.rocksdb.localdir, /data/rocksdb | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.web.submit.enable, false | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: slot.request.timeout, 5000000 | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image.pull-policy, IfNotPresent | |
2020-10-11 21:20:14.781 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy.fixed-delay.delay, 10s | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: fs.hdfs.hadoopconf, /opt/cluster-admin/hadoop | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: resourcemanager.taskmanager-timeout, 5000000 | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend, rocksdb | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.service-account, flink | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124 | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.num-retained, 2 | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.savepoints.dir, hdfs:///state/user/id/myjob/flink-savepoints | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.classpath.ship-jars, /var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.maximum-failed-containers, 65535 | |
2020-10-11 21:20:14.782 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: cluster.registration.max-timeout, 30000000 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.remote.file.dependencies, /user/hadoop/.flink/myjob-201076/1602422394680/job.graph | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.application-attempts, 20 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: akka.ask.timeout, 60s | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: heartbeat.timeout, 300000 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.fs.checkpointdir, hdfs:///state/user/id/myjob/flink-checkpoints | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: flink.partition-discovery.interval-millis, 30000 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: web.timeout, 1000000 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-per-job | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: slot.idle.timeout, 5000000 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: cluster.services.shutdown-timeout, 3000000 | |
2020-10-11 21:20:14.783 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.enable.init.container, true | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.remote.jar.ship-to-system, /user/hadoop/.flink/myjob-201076/1602422394680/systemShipFiles/flink-connector-kafka.jar;/user/hadoop/.flink/myjob-201076/1602422394680/systemShipFiles/flink-connector-jdbc.jar | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.ship-directories, /usr/local/services/tstream_cluster_admin_V2-1.0/lib/ext;/data/workspace/user/runtime/myjob/201076/shipFiles | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, false | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, DETACHED | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy, fixed-delay | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts.taskmanager, -XX:ErrorFile=/tmp/taskmanager.err | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.heap.size, 4096m | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: cluster.registration.refused-registration-delay, 3000000 | |
2020-10-11 21:20:14.784 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.dir, hdfs:///state/user/id/myjob/flink-checkpoints | |
2020-10-11 21:20:14.786 [main] DEBUG org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory [] - Starting Dispatcher. | |
2020-10-11 21:20:14.883 [main] DEBUG org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - Create new DispatcherLeaderProcess with leader session id 00000000-0000-0000-0000-000000000000. | |
2020-10-11 21:20:14.886 [main] INFO org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcess [] - Start JobDispatcherLeaderProcess. | |
2020-10-11 21:20:14.890 [flink-akka.actor.supervisor-dispatcher-12] DEBUG org.apache.flink.runtime.rpc.akka.SupervisorActor [] - Starting FencedAkkaRpcActor with name dispatcher_1. | |
2020-10-11 21:20:14.891 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.MiniDispatcher at akka://flink/user/rpc/dispatcher_1 . | |
2020-10-11 21:20:14.899 [main] DEBUG org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory [] - Starting ResourceManager. | |
2020-10-11 21:20:14.967 [main] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Try to connect to remote RPC endpoint with address akka.tcp://flink@myjob-201076.default:6123/user/rpc/resourcemanager_*. Returning a org.apache.flink.runtime.resourcemanager.ResourceManagerGateway gateway. | |
2020-10-11 21:20:14.977 [main] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Try to connect to remote RPC endpoint with address akka.tcp://flink@myjob-201076.default:6123/user/rpc/dispatcher_*. Returning a org.apache.flink.runtime.dispatcher.DispatcherGateway gateway. | |
2020-10-11 21:20:14.984 [flink-akka.actor.supervisor-dispatcher-12] DEBUG org.apache.flink.runtime.rpc.akka.SupervisorActor [] - Starting FencedAkkaRpcActor with name jobmanager_2. | |
2020-10-11 21:20:14.985 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 . | |
2020-10-11 21:20:15.072 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce). | |
2020-10-11 21:20:15.171 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=15, backoffTimeMS=10000) for user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce). | |
2020-10-11 21:20:15.269 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce). | |
2020-10-11 21:20:15.269 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. | |
2020-10-11 21:20:15.269 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster [] - Adding 1 vertices from job graph user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce). | |
2020-10-11 21:20:15.269 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Attaching 1 topologically sorted vertices to existing job graph with 0 vertices and 0 intermediate results. | |
2020-10-11 21:20:15.278 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Connecting ExecutionJobVertex cbc357ccb763df2852fee8c4fc7d55f2 (Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName])) to 0 predecessors. | |
2020-10-11 21:20:15.285 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 50 pipelined regions in 1 ms | |
2020-10-11 21:20:15.286 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully created execution graph from job graph user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce). | |
2020-10-11 21:20:15.387 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using application-defined state backend: RocksDBStateBackend{checkpointStreamBackend=File State Backend (checkpoints: 'hdfs:/state/user/id/myjob/flink-checkpoints', savepoints: 'hdfs:/state/user/id/myjob/flink-savepoints', asynchronous: TRUE, fileStateThreshold: 20480), localRocksDbDirectories=[/data/rocksdb], enableIncrementalCheckpointing=FALSE, numberOfTransferThreads=1, writeBatchSize=2097152} | |
2020-10-11 21:20:15.387 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Configuring application-defined state backend with job/cluster config | |
2020-10-11 21:20:15.390 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.contrib.streaming.state.RocksDBStateBackend [] - Using predefined options: DEFAULT. | |
2020-10-11 21:20:15.390 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.contrib.streaming.state.RocksDBStateBackend [] - Using application-defined options factory: DefaultConfigurableOptionsFactory{configuredOptions={}}. | |
2020-10-11 21:20:15.467 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Searching Hadoop configuration files in Flink config: /opt/cluster-admin/hadoop | |
2020-10-11 21:20:15.467 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Searching Hadoop configuration files in HADOOP_CONF_DIR: /opt/hadoop/conf | |
2020-10-11 21:20:15.467 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Adding /opt/hadoop/conf/core-site.xml to hadoop configuration | |
2020-10-11 21:20:15.467 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.util.HadoopUtils [] - Adding /opt/hadoop/conf/hdfs-site.xml to hadoop configuration | |
2020-10-11 21:20:15.577 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.fs.hdfs.HadoopFsFactory [] - Instantiating for file system scheme hdfs Hadoop File System org.apache.hadoop.hdfs.DistributedFileSystem | |
2020-10-11 21:20:15.577 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.fs.hdfs.HadoopFsFactory [] - URI hdfs:///state/user/id/myjob/flink-checkpoints does not specify file system authority, trying to load default authority (fs.defaultFS) | |
2020-10-11 21:20:15.577 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.fs.hdfs.HadoopFsFactory [] - Hadoop's 'fs.defaultFS' is set to hdfs://HDFS12 | |
2020-10-11 21:20:16.578 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Status of the shared state registry of job 493cd86e389ccc8f2887e1222903b5ce after restore: SharedStateRegistry{registeredStates={}}. | |
2020-10-11 21:20:16.579 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Resetting the master hooks. | |
2020-10-11 21:20:16.580 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@b46a740 for user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce). | |
2020-10-11 21:20:16.583 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl [] - JobManager runner for job user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce) was granted leadership with session id 00000000-0000-0000-0000-000000000000 at akka.tcp://flink@myjob-201076.default:6123/user/rpc/jobmanager_2. | |
2020-10-11 21:20:16.588 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce) under job master id 00000000000000000000000000000000. | |
2020-10-11 21:20:16.593 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.EagerSchedulingStrategy] | |
2020-10-11 21:20:16.594 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job user myjob 04fc975d-8815-4a04-939b-b890b34117c9 (493cd86e389ccc8f2887e1222903b5ce) switched from state CREATED to RUNNING. | |
2020-10-11 21:20:16.677 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (1/50) (a6f0f49122912054a60ef899b5ea256b) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.677 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (2/50) (2a4586dc1b501d9281d1419d910c387d) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.677 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (3/50) (daeff75f1c37c07ccfe23b6e79d08013) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.677 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (4/50) (d605079a72da49c61c81bfcf0f19ecfb) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (5/50) (e0e01ee378e013d890bc0be0a8553980) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (6/50) (fdab2989d18bed2a2a5badebabc93ddb) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (7/50) (ca62c63d2f7a43d433e60b5d893397ea) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (8/50) (a62565adb0eef665d6cbc313ff5b9a1f) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (9/50) (3462407251eeddf244c66fd7bf70b5ba) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (10/50) (bf67472c019f65720cf18f29bca8d43a) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (11/50) (721b70e99537c249c5c4904284e65410) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (12/50) (45a50bcdf374a22292f04f55d7749c96) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (13/50) (9991f3f051386201058281187c657d3e) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.678 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (14/50) (a611d483700f2297f9d5d281c108cc0e) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (15/50) (9e30d73552ef4dd801fdc0d5479af74b) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (16/50) (5e0365dc720461ca78c96dde50de7e74) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (17/50) (bc99e24dd4db14a0e968f47ac91f8672) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (18/50) (059d788eb02326072e75015d1e5ffd0c) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (19/50) (18e56f30d2ac71beb0d0b40ede5dffa0) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (20/50) (396699f7c98a176cefda0c35e80d790f) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (21/50) (96d4d2bbb69fcbade8dd671968392af9) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (22/50) (20689c933c8aa66dc004d163238e962a) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (23/50) (a1b9552e10180279f1443126ac9b7653) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (24/50) (9ebe9882f7924253484f8c24f97ac4fc) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.679 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (25/50) (d011baab9c548e456bb8ee4b765a77b9) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (26/50) (9eb27c0e4093dfb82d27b47dbee26d9b) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (27/50) (0d205bbe6b5cedc557733f98dc183fe9) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (28/50) (3ccc2c1f04abcf0ce78753b575e2ea10) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (29/50) (38fbcdcf547b64c48e98a7ab420c7cd7) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (30/50) (0d7434c35ef7e314df9468d5fdcf50d6) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (31/50) (fddc1bb03ee10aa0771db71cfddf6c28) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (32/50) (250c09ac4adde765e1185d3062b80f5f) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (33/50) (efa68e14fc4d28c998f0490fff009db8) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (34/50) (059dd6b1033a66eda6c188d52b5b548f) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (35/50) (e8fa041594d1e946737ccfab01238614) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (36/50) (1785e04b8531c26b2560c71c9bc84b3f) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (37/50) (ff3ddbafec10552f5ce0b09519cbe101) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.680 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (38/50) (dcb7741a0a9d96f274951b22a23f24bb) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (39/50) (55756a419985a3346d5bb17ce513e3f3) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (40/50) (a07f695f1550746aae9764458b17f344) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (41/50) (8bda050fa6c3d61479d2749331164096) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (42/50) (ffe6317fd1a9e40fe51822a9a7ba548f) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (43/50) (887d99c3a7afab27e874050bcaa5f749) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (44/50) (491378862c34bef055614bb4cbefec45) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (45/50) (db77d6e84a1dd8d5bad473a0f93df99e) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (46/50) (5a5555a1f349d4715a2e2e91e41bae81) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (47/50) (0f5fe46d0b699d1d810e83104b529cdc) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (48/50) (5bad0ba2c2f0e0c935eb68b0ee1ffa55) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (49/50) (cd14ac263bde9c0f09be64998f6edc7d) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.681 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: KafkaTableSource(Id, FromCharset) -> SourceConversion(table=[default_catalog.default_database.data_input, source: [KafkaTableSource(Id, FromCharset)]], fields=[Id, FromCharset]) -> Calc(select=[(Id + 10000) AS EXPR$0, FromCharset]) -> Sink: Sink(table=[default_catalog.default_database.DIM], fields=[Id, UserName]) (50/50) (680359814679d385b450ea454dfd8445) switched from CREATED to SCHEDULED. | |
2020-10-11 21:20:16.686 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{d815b24dd9100e528ae7848339c76cb0} for execution cbc357ccb763df2852fee8c4fc7d55f2_0 | |
2020-10-11 21:20:16.687 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{d815b24dd9100e528ae7848339c76cb0}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.771 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{fd665ad590886603ce880ac3ce7510ca}] | |
2020-10-11 21:20:16.771 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{8eee7dfe11773f9fb0176696012d9cd8}] in slot [SlotRequestId{fd665ad590886603ce880ac3ce7510ca}]. | |
2020-10-11 21:20:16.775 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{d815b24dd9100e528ae7848339c76cb0}] in multi task slot [SlotRequestId{8eee7dfe11773f9fb0176696012d9cd8}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.778 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{d5f2f85fe78c01f8f14fad6a9d35fed0} for execution cbc357ccb763df2852fee8c4fc7d55f2_1 | |
2020-10-11 21:20:16.778 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{d5f2f85fe78c01f8f14fad6a9d35fed0}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.778 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{c97691b874f35d447257929e318c0a0b}] | |
2020-10-11 21:20:16.778 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{9d4be88169ddf7eb40d075b83963a238}] in slot [SlotRequestId{c97691b874f35d447257929e318c0a0b}]. | |
2020-10-11 21:20:16.778 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{d5f2f85fe78c01f8f14fad6a9d35fed0}] in multi task slot [SlotRequestId{9d4be88169ddf7eb40d075b83963a238}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.778 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{a4e7f3deef0494a1dec090ee0d572193} for execution cbc357ccb763df2852fee8c4fc7d55f2_2 | |
2020-10-11 21:20:16.778 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{a4e7f3deef0494a1dec090ee0d572193}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{d0c03fbf5a0005b73a130bed9a7b6e57}] | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{0c0e473ba8dc81aef8bff6d99a9b7371}] in slot [SlotRequestId{d0c03fbf5a0005b73a130bed9a7b6e57}]. | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{a4e7f3deef0494a1dec090ee0d572193}] in multi task slot [SlotRequestId{0c0e473ba8dc81aef8bff6d99a9b7371}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{fa839143b8b52d0d5e4a7193cce5f075} for execution cbc357ccb763df2852fee8c4fc7d55f2_3 | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{fa839143b8b52d0d5e4a7193cce5f075}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{9010737ada9ded74b563833c6393d4d5}] | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{62999f5e0feed9f0286465f5e0bc9a4f}] in slot [SlotRequestId{9010737ada9ded74b563833c6393d4d5}]. | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{fa839143b8b52d0d5e4a7193cce5f075}] in multi task slot [SlotRequestId{62999f5e0feed9f0286465f5e0bc9a4f}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{7496ddab6465dc8fa53b4af005f152a7} for execution cbc357ccb763df2852fee8c4fc7d55f2_4 | |
2020-10-11 21:20:16.779 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{7496ddab6465dc8fa53b4af005f152a7}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{42579bfff6c859376991daa34e8e5c96}] | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{a85030c1c0f7edb342a4f557e73ef402}] in slot [SlotRequestId{42579bfff6c859376991daa34e8e5c96}]. | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{7496ddab6465dc8fa53b4af005f152a7}] in multi task slot [SlotRequestId{a85030c1c0f7edb342a4f557e73ef402}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{819cf93fe40a9f0e4db977ece52d116e} for execution cbc357ccb763df2852fee8c4fc7d55f2_5 | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{819cf93fe40a9f0e4db977ece52d116e}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{c116b61685280824029208d8080b4cb3}] | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{0725c9d759f25d75b506316beacdb6f0}] in slot [SlotRequestId{c116b61685280824029208d8080b4cb3}]. | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{819cf93fe40a9f0e4db977ece52d116e}] in multi task slot [SlotRequestId{0725c9d759f25d75b506316beacdb6f0}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{f9383de6285b5a3c361b475abac1dfbe} for execution cbc357ccb763df2852fee8c4fc7d55f2_6 | |
2020-10-11 21:20:16.780 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{f9383de6285b5a3c361b475abac1dfbe}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{af98b1a453326abf4403ea7b5b0579a8}] | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{99a297d043baa7e983731acbf65e51d9}] in slot [SlotRequestId{af98b1a453326abf4403ea7b5b0579a8}]. | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{f9383de6285b5a3c361b475abac1dfbe}] in multi task slot [SlotRequestId{99a297d043baa7e983731acbf65e51d9}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{113266291e6c781587fc2ab9126d8f17} for execution cbc357ccb763df2852fee8c4fc7d55f2_7 | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{113266291e6c781587fc2ab9126d8f17}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{32f69b57ceefe92c3d09119e18636bf0}] | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{4c30bf0b829a17f1d184e28a47f7e032}] in slot [SlotRequestId{32f69b57ceefe92c3d09119e18636bf0}]. | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{113266291e6c781587fc2ab9126d8f17}] in multi task slot [SlotRequestId{4c30bf0b829a17f1d184e28a47f7e032}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{85c3c0672289389b25f06b452cbfed9f} for execution cbc357ccb763df2852fee8c4fc7d55f2_8 | |
2020-10-11 21:20:16.781 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{85c3c0672289389b25f06b452cbfed9f}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{4a5f56981c2014a3f3733f93eb3e83e1}] | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{006e47c7b15b11df42dbb4bb3d8b2fbb}] in slot [SlotRequestId{4a5f56981c2014a3f3733f93eb3e83e1}]. | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{85c3c0672289389b25f06b452cbfed9f}] in multi task slot [SlotRequestId{006e47c7b15b11df42dbb4bb3d8b2fbb}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{fa67ba3a5f8616d0e8a491425e580981} for execution cbc357ccb763df2852fee8c4fc7d55f2_9 | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{fa67ba3a5f8616d0e8a491425e580981}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{4781f3ad7b7be0372f3f74fbbfc396ca}] | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{45c72b03940c9bed7f4f3d4388fa9363}] in slot [SlotRequestId{4781f3ad7b7be0372f3f74fbbfc396ca}]. | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{fa67ba3a5f8616d0e8a491425e580981}] in multi task slot [SlotRequestId{45c72b03940c9bed7f4f3d4388fa9363}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{5373502836b2dcf40e6de989ed78d586} for execution cbc357ccb763df2852fee8c4fc7d55f2_10 | |
2020-10-11 21:20:16.782 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{5373502836b2dcf40e6de989ed78d586}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{ba8bee2d659b3cc88ccdc40d71f7c14a}] | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{4d118bb309743dfb98bdd2e8c10bff5d}] in slot [SlotRequestId{ba8bee2d659b3cc88ccdc40d71f7c14a}]. | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{5373502836b2dcf40e6de989ed78d586}] in multi task slot [SlotRequestId{4d118bb309743dfb98bdd2e8c10bff5d}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{243c2d8e62c14400d915d554635b6af1} for execution cbc357ccb763df2852fee8c4fc7d55f2_11 | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{243c2d8e62c14400d915d554635b6af1}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{782adfa97ec4b446f50e5124506f6af4}] | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{99886826d8c29488e54d74941cb72a83}] in slot [SlotRequestId{782adfa97ec4b446f50e5124506f6af4}]. | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{243c2d8e62c14400d915d554635b6af1}] in multi task slot [SlotRequestId{99886826d8c29488e54d74941cb72a83}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{2a2588ca0a9e3a630739d0467a9064a0} for execution cbc357ccb763df2852fee8c4fc7d55f2_12 | |
2020-10-11 21:20:16.783 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{2a2588ca0a9e3a630739d0467a9064a0}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{d6ab729804eae028ed302d8bbe64b721}] | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{008f4fbb0fb032f39c4a04e23454b0eb}] in slot [SlotRequestId{d6ab729804eae028ed302d8bbe64b721}]. | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{2a2588ca0a9e3a630739d0467a9064a0}] in multi task slot [SlotRequestId{008f4fbb0fb032f39c4a04e23454b0eb}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{169a07a87fa12dfc073658bee7c90f60} for execution cbc357ccb763df2852fee8c4fc7d55f2_13 | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{169a07a87fa12dfc073658bee7c90f60}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{49e5a182d894d72c657ef88c45d5df15}] | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{ff63e8c21af5b0f313b06ff3f9e273c8}] in slot [SlotRequestId{49e5a182d894d72c657ef88c45d5df15}]. | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{169a07a87fa12dfc073658bee7c90f60}] in multi task slot [SlotRequestId{ff63e8c21af5b0f313b06ff3f9e273c8}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{d91838105fd5f558037b265df3c46b90} for execution cbc357ccb763df2852fee8c4fc7d55f2_14 | |
2020-10-11 21:20:16.784 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{d91838105fd5f558037b265df3c46b90}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{a0688e732ba3ee513f4872b68eab3156}] | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{4a8852b0135aff547b26a773e41cb283}] in slot [SlotRequestId{a0688e732ba3ee513f4872b68eab3156}]. | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{d91838105fd5f558037b265df3c46b90}] in multi task slot [SlotRequestId{4a8852b0135aff547b26a773e41cb283}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{f34168ed58c3342d399b5ad6fd1b3bfa} for execution cbc357ccb763df2852fee8c4fc7d55f2_15 | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{f34168ed58c3342d399b5ad6fd1b3bfa}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{17867e97f91a69124e1b6f6f8897b249}] | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{ca83b0879b9f5ff4e4dca0e630d2991a}] in slot [SlotRequestId{17867e97f91a69124e1b6f6f8897b249}]. | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{f34168ed58c3342d399b5ad6fd1b3bfa}] in multi task slot [SlotRequestId{ca83b0879b9f5ff4e4dca0e630d2991a}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{b390ef60bc28571718ac98f77c819def} for execution cbc357ccb763df2852fee8c4fc7d55f2_16 | |
2020-10-11 21:20:16.785 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{b390ef60bc28571718ac98f77c819def}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.786 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{9bbbc63b0e73f4e42fb5d0bc33b69a0e}] | |
2020-10-11 21:20:16.786 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{54d46785327c9cfd07dac2308ee03fb9}] in slot [SlotRequestId{9bbbc63b0e73f4e42fb5d0bc33b69a0e}]. | |
2020-10-11 21:20:16.786 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{b390ef60bc28571718ac98f77c819def}] in multi task slot [SlotRequestId{54d46785327c9cfd07dac2308ee03fb9}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.786 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{1c44242686038292fed42df3870be6a2} for execution cbc357ccb763df2852fee8c4fc7d55f2_17 | |
2020-10-11 21:20:16.866 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{1c44242686038292fed42df3870be6a2}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.866 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{f7b1b0e6dd0a0bf2b1c7794ca5132b9d}] | |
2020-10-11 21:20:16.866 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{3ad9de0cb7455b6587d6686dd0d75797}] in slot [SlotRequestId{f7b1b0e6dd0a0bf2b1c7794ca5132b9d}]. | |
2020-10-11 21:20:16.866 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{1c44242686038292fed42df3870be6a2}] in multi task slot [SlotRequestId{3ad9de0cb7455b6587d6686dd0d75797}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{a349a547bd011138db79b8fb3d57c1c6} for execution cbc357ccb763df2852fee8c4fc7d55f2_18 | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{a349a547bd011138db79b8fb3d57c1c6}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{9a10b1d1d7a39b18438c60cb718fa121}] | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{f351c6d29a57a4a37f0574f01bdb0112}] in slot [SlotRequestId{9a10b1d1d7a39b18438c60cb718fa121}]. | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{a349a547bd011138db79b8fb3d57c1c6}] in multi task slot [SlotRequestId{f351c6d29a57a4a37f0574f01bdb0112}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{5208a8023b837d3ca9bafcf44d69cd6a} for execution cbc357ccb763df2852fee8c4fc7d55f2_19 | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{5208a8023b837d3ca9bafcf44d69cd6a}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{71b3689180f0871ef568366498432995}] | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{6a07444b741203b33cd60c9473ca870e}] in slot [SlotRequestId{71b3689180f0871ef568366498432995}]. | |
2020-10-11 21:20:16.867 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{5208a8023b837d3ca9bafcf44d69cd6a}] in multi task slot [SlotRequestId{6a07444b741203b33cd60c9473ca870e}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{58b766f5cafbd1267facc89914db2f14} for execution cbc357ccb763df2852fee8c4fc7d55f2_20 | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{58b766f5cafbd1267facc89914db2f14}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{2cd645fcd28eed3608623d9956a6339e}] | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{ecc07052886ad14d8b27f54b63c9fb8b}] in slot [SlotRequestId{2cd645fcd28eed3608623d9956a6339e}]. | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{58b766f5cafbd1267facc89914db2f14}] in multi task slot [SlotRequestId{ecc07052886ad14d8b27f54b63c9fb8b}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{3509f891048ffbd098f120b6f2d9de1d} for execution cbc357ccb763df2852fee8c4fc7d55f2_21 | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{3509f891048ffbd098f120b6f2d9de1d}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{bad5dd6174913ab8f4e0514041ff81a8}] | |
2020-10-11 21:20:16.868 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{d091141eb1f68b61a0e93de4a1c6f186}] in slot [SlotRequestId{bad5dd6174913ab8f4e0514041ff81a8}]. | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{3509f891048ffbd098f120b6f2d9de1d}] in multi task slot [SlotRequestId{d091141eb1f68b61a0e93de4a1c6f186}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{af8119bbf44da3a2407318c29ac19f4d} for execution cbc357ccb763df2852fee8c4fc7d55f2_22 | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{af8119bbf44da3a2407318c29ac19f4d}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{25302de5a291781df18c38dd4bbbc343}] | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{27bf9c64c85353d72f081c1efa02d011}] in slot [SlotRequestId{25302de5a291781df18c38dd4bbbc343}]. | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{af8119bbf44da3a2407318c29ac19f4d}] in multi task slot [SlotRequestId{27bf9c64c85353d72f081c1efa02d011}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{51cab8c7f6a5550a2bed05a059f2edb7} for execution cbc357ccb763df2852fee8c4fc7d55f2_23 | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{51cab8c7f6a5550a2bed05a059f2edb7}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{d40b7040386f633a6326bc276eecafc0}] | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{a29b95cb6ad4f28591c82cf016337ab6}] in slot [SlotRequestId{d40b7040386f633a6326bc276eecafc0}]. | |
2020-10-11 21:20:16.869 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{51cab8c7f6a5550a2bed05a059f2edb7}] in multi task slot [SlotRequestId{a29b95cb6ad4f28591c82cf016337ab6}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{83bc4c947de3283fc67df6b023484cd7} for execution cbc357ccb763df2852fee8c4fc7d55f2_24 | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{83bc4c947de3283fc67df6b023484cd7}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{d0bf3499752434beaa7020d51d5bde08}] | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{b5433d8e1c2df67136f1831117ae4b09}] in slot [SlotRequestId{d0bf3499752434beaa7020d51d5bde08}]. | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{83bc4c947de3283fc67df6b023484cd7}] in multi task slot [SlotRequestId{b5433d8e1c2df67136f1831117ae4b09}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{2fb14401460f3a37043fa1192961bfe9} for execution cbc357ccb763df2852fee8c4fc7d55f2_25 | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{2fb14401460f3a37043fa1192961bfe9}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{1602dcbda8e02ced987dfea8c7a8d5bc}] | |
2020-10-11 21:20:16.870 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{9d9ff2745defd24937442fcbbe90978c}] in slot [SlotRequestId{1602dcbda8e02ced987dfea8c7a8d5bc}]. | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{2fb14401460f3a37043fa1192961bfe9}] in multi task slot [SlotRequestId{9d9ff2745defd24937442fcbbe90978c}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{f2c619973c5194e6c9c62958f431628d} for execution cbc357ccb763df2852fee8c4fc7d55f2_26 | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{f2c619973c5194e6c9c62958f431628d}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{05b6be88742b439e721295c037111593}] | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{f81791f36655101f215b3206763443c8}] in slot [SlotRequestId{05b6be88742b439e721295c037111593}]. | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{f2c619973c5194e6c9c62958f431628d}] in multi task slot [SlotRequestId{f81791f36655101f215b3206763443c8}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{45c2d778e2e262b845f7770d3f035e99} for execution cbc357ccb763df2852fee8c4fc7d55f2_27 | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{45c2d778e2e262b845f7770d3f035e99}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{87fb7a8e0b4397740a121318c6040af0}] | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{52d30da2a71df8691bf5f78f12b615a8}] in slot [SlotRequestId{87fb7a8e0b4397740a121318c6040af0}]. | |
2020-10-11 21:20:16.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{45c2d778e2e262b845f7770d3f035e99}] in multi task slot [SlotRequestId{52d30da2a71df8691bf5f78f12b615a8}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{58ce1785fef889510cf7fefdd7e6bb3d} for execution cbc357ccb763df2852fee8c4fc7d55f2_28 | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{58ce1785fef889510cf7fefdd7e6bb3d}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{8ab553094ab17859b8466f62b7c436c3}] | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{0748c4e18c99483917b7dca80926cc19}] in slot [SlotRequestId{8ab553094ab17859b8466f62b7c436c3}]. | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{58ce1785fef889510cf7fefdd7e6bb3d}] in multi task slot [SlotRequestId{0748c4e18c99483917b7dca80926cc19}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{3a73cbd0ba4e078476472f6df923c15e} for execution cbc357ccb763df2852fee8c4fc7d55f2_29 | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{3a73cbd0ba4e078476472f6df923c15e}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{c3ef8f075b4229401682d40c1c51fba2}] | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{84336ec61f7fd2b9731155d6256f32e0}] in slot [SlotRequestId{c3ef8f075b4229401682d40c1c51fba2}]. | |
2020-10-11 21:20:16.872 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{3a73cbd0ba4e078476472f6df923c15e}] in multi task slot [SlotRequestId{84336ec61f7fd2b9731155d6256f32e0}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{4a695b4448f2b29208cdeaa0ae8ff12c} for execution cbc357ccb763df2852fee8c4fc7d55f2_30 | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{4a695b4448f2b29208cdeaa0ae8ff12c}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{f91635d5538fb51cb123b2866df3d128}] | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{df84a047e65329ea9076afe6233aafbc}] in slot [SlotRequestId{f91635d5538fb51cb123b2866df3d128}]. | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{4a695b4448f2b29208cdeaa0ae8ff12c}] in multi task slot [SlotRequestId{df84a047e65329ea9076afe6233aafbc}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{6e02de9065832ea45bd5bbaf4c4ec505} for execution cbc357ccb763df2852fee8c4fc7d55f2_31 | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{6e02de9065832ea45bd5bbaf4c4ec505}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{28eaaea6372d731b9b20f9dbbe22d88d}] | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{cc743aadfab4aa9eb584924183a304bd}] in slot [SlotRequestId{28eaaea6372d731b9b20f9dbbe22d88d}]. | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{6e02de9065832ea45bd5bbaf4c4ec505}] in multi task slot [SlotRequestId{cc743aadfab4aa9eb584924183a304bd}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.873 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{4fc389583cb33e8b2ddfb1878829bd8f} for execution cbc357ccb763df2852fee8c4fc7d55f2_32 | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{4fc389583cb33e8b2ddfb1878829bd8f}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{e2b2108906be1628e7ac167629b20e87}] | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{05cc4e3897eb87b38b7aaf72a51b43e3}] in slot [SlotRequestId{e2b2108906be1628e7ac167629b20e87}]. | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{4fc389583cb33e8b2ddfb1878829bd8f}] in multi task slot [SlotRequestId{05cc4e3897eb87b38b7aaf72a51b43e3}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{81158b9e74afc6b7e05e0c47a3617311} for execution cbc357ccb763df2852fee8c4fc7d55f2_33 | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{81158b9e74afc6b7e05e0c47a3617311}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{b2a22e8a43e163a0e5e3a829f4f19660}] | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{843b3d10e0cdb091a4c94ff5a7772ffa}] in slot [SlotRequestId{b2a22e8a43e163a0e5e3a829f4f19660}]. | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{81158b9e74afc6b7e05e0c47a3617311}] in multi task slot [SlotRequestId{843b3d10e0cdb091a4c94ff5a7772ffa}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{4543f76e006e1f758bac28bd35eca812} for execution cbc357ccb763df2852fee8c4fc7d55f2_34 | |
2020-10-11 21:20:16.874 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{4543f76e006e1f758bac28bd35eca812}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{c644ac266f4ced5404c31a832996da59}] | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{e40c2a6c87b8aee70a8ea344602786b5}] in slot [SlotRequestId{c644ac266f4ced5404c31a832996da59}]. | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{4543f76e006e1f758bac28bd35eca812}] in multi task slot [SlotRequestId{e40c2a6c87b8aee70a8ea344602786b5}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{538b76c921cb926d6784563686c99934} for execution cbc357ccb763df2852fee8c4fc7d55f2_35 | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{538b76c921cb926d6784563686c99934}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{fba5a5f511c46abf105c8b549e957d3e}] | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{a9680206ca7cd7a27e0d031c6c1af00a}] in slot [SlotRequestId{fba5a5f511c46abf105c8b549e957d3e}]. | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{538b76c921cb926d6784563686c99934}] in multi task slot [SlotRequestId{a9680206ca7cd7a27e0d031c6c1af00a}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{fbbcddd3faa91f5cebe382901c910653} for execution cbc357ccb763df2852fee8c4fc7d55f2_36 | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{fbbcddd3faa91f5cebe382901c910653}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.875 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{37edba92e1438d8903dfab81b714594a}] | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{666fa3bf994e6b2e6f9b9513da668ece}] in slot [SlotRequestId{37edba92e1438d8903dfab81b714594a}]. | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{fbbcddd3faa91f5cebe382901c910653}] in multi task slot [SlotRequestId{666fa3bf994e6b2e6f9b9513da668ece}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{d9bee5420c34e40e5b06e87aff21b0d9} for execution cbc357ccb763df2852fee8c4fc7d55f2_37 | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{d9bee5420c34e40e5b06e87aff21b0d9}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{b5bd7fcf75c46d3ca0308605de85083d}] | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{7759ff8f223d80f1bc96f65f8e286e91}] in slot [SlotRequestId{b5bd7fcf75c46d3ca0308605de85083d}]. | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{d9bee5420c34e40e5b06e87aff21b0d9}] in multi task slot [SlotRequestId{7759ff8f223d80f1bc96f65f8e286e91}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{007a98ff1793c39f09382c11643e4b65} for execution cbc357ccb763df2852fee8c4fc7d55f2_38 | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{007a98ff1793c39f09382c11643e4b65}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{9582b017cbe2e646eb1d594a4ddbb0bc}] | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{36872dae959eda05caa7dde11c414abb}] in slot [SlotRequestId{9582b017cbe2e646eb1d594a4ddbb0bc}]. | |
2020-10-11 21:20:16.876 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{007a98ff1793c39f09382c11643e4b65}] in multi task slot [SlotRequestId{36872dae959eda05caa7dde11c414abb}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{20a8471dab5b28f3d0b091989697169d} for execution cbc357ccb763df2852fee8c4fc7d55f2_39 | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{20a8471dab5b28f3d0b091989697169d}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{424d9c23ea6e882f71daeea72e3814e9}] | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{616bcf092274f7353691e070dbca6ae7}] in slot [SlotRequestId{424d9c23ea6e882f71daeea72e3814e9}]. | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{20a8471dab5b28f3d0b091989697169d}] in multi task slot [SlotRequestId{616bcf092274f7353691e070dbca6ae7}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{5bc8fb04d1040073793c3a986e33a74f} for execution cbc357ccb763df2852fee8c4fc7d55f2_40 | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{5bc8fb04d1040073793c3a986e33a74f}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{a8a7ace26209ef1bd0931c37e9401e44}] | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{5f9641df978a0e3ad9e4c36e23cf9080}] in slot [SlotRequestId{a8a7ace26209ef1bd0931c37e9401e44}]. | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{5bc8fb04d1040073793c3a986e33a74f}] in multi task slot [SlotRequestId{5f9641df978a0e3ad9e4c36e23cf9080}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{eb9ad0d86bf545092ab29519c3c891cf} for execution cbc357ccb763df2852fee8c4fc7d55f2_41 | |
2020-10-11 21:20:16.877 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{eb9ad0d86bf545092ab29519c3c891cf}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{0ad201a2e67fa48372c15ce4d43762c1}] | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{3b1976bc15c8ba37a39f09854714319a}] in slot [SlotRequestId{0ad201a2e67fa48372c15ce4d43762c1}]. | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{eb9ad0d86bf545092ab29519c3c891cf}] in multi task slot [SlotRequestId{3b1976bc15c8ba37a39f09854714319a}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{92c4ad22f435bc5f2911693ebb77f68d} for execution cbc357ccb763df2852fee8c4fc7d55f2_42 | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{92c4ad22f435bc5f2911693ebb77f68d}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{bae57683e7b9e3308315aaad49c65f29}] | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{2d9f7197fdba83738e50a5c104c67d13}] in slot [SlotRequestId{bae57683e7b9e3308315aaad49c65f29}]. | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{92c4ad22f435bc5f2911693ebb77f68d}] in multi task slot [SlotRequestId{2d9f7197fdba83738e50a5c104c67d13}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{809024cae881be54674c3109680b2bf5} for execution cbc357ccb763df2852fee8c4fc7d55f2_43 | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{809024cae881be54674c3109680b2bf5}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{c7cb9f1f278bda7987de07345ca762b6}] | |
2020-10-11 21:20:16.878 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{8b87c34f04289a56b8d900d39439e3eb}] in slot [SlotRequestId{c7cb9f1f278bda7987de07345ca762b6}]. | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{809024cae881be54674c3109680b2bf5}] in multi task slot [SlotRequestId{8b87c34f04289a56b8d900d39439e3eb}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{4f8ea13719ab23bfecf1a6652b1f018c} for execution cbc357ccb763df2852fee8c4fc7d55f2_44 | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{4f8ea13719ab23bfecf1a6652b1f018c}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{da328171c0f84cbe90cb5e8d344e67ea}] | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{b7048744c3ec61a64fb3bca49f5623e0}] in slot [SlotRequestId{da328171c0f84cbe90cb5e8d344e67ea}]. | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{4f8ea13719ab23bfecf1a6652b1f018c}] in multi task slot [SlotRequestId{b7048744c3ec61a64fb3bca49f5623e0}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{7a390cbb630eb86780e5b376e2435849} for execution cbc357ccb763df2852fee8c4fc7d55f2_45 | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{7a390cbb630eb86780e5b376e2435849}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{0ab31d0fb89aa5242e86b048b95c56b1}] | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{5462b152744aa402fa2be219dc970f4e}] in slot [SlotRequestId{0ab31d0fb89aa5242e86b048b95c56b1}]. | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{7a390cbb630eb86780e5b376e2435849}] in multi task slot [SlotRequestId{5462b152744aa402fa2be219dc970f4e}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.879 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{c137934574cbcc439ad6312aa9f20c30} for execution cbc357ccb763df2852fee8c4fc7d55f2_46 | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{c137934574cbcc439ad6312aa9f20c30}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{5ea50a86e38ce092a237aabfd3856bb7}] | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{b6d0b7f3befd909ffafd652733848e46}] in slot [SlotRequestId{5ea50a86e38ce092a237aabfd3856bb7}]. | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{c137934574cbcc439ad6312aa9f20c30}] in multi task slot [SlotRequestId{b6d0b7f3befd909ffafd652733848e46}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{d149434a9387bfeec4051ff906c06b35} for execution cbc357ccb763df2852fee8c4fc7d55f2_47 | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{d149434a9387bfeec4051ff906c06b35}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{1dc7bf10fdd5e5eced16249f32c5c10c}] | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{f648e6b53e96db432d292b1696b194ed}] in slot [SlotRequestId{1dc7bf10fdd5e5eced16249f32c5c10c}]. | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{d149434a9387bfeec4051ff906c06b35}] in multi task slot [SlotRequestId{f648e6b53e96db432d292b1696b194ed}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{0af99af40a20a86e78c346f81889b550} for execution cbc357ccb763df2852fee8c4fc7d55f2_48 | |
2020-10-11 21:20:16.880 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{0af99af40a20a86e78c346f81889b550}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{2c44407e0a59298f34a420b2838e33f6}] | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{2c02e4d888649b80ae47ff1ae9d40b17}] in slot [SlotRequestId{2c44407e0a59298f34a420b2838e33f6}]. | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{0af99af40a20a86e78c346f81889b550}] in multi task slot [SlotRequestId{2c02e4d888649b80ae47ff1ae9d40b17}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.scheduler.DefaultExecutionSlotAllocator [] - Allocate slot with id SlotRequestId{c0b44d85030766275cc2652613c861dd} for execution cbc357ccb763df2852fee8c4fc7d55f2_49 | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SchedulerImpl [] - Received slot request [SlotRequestId{c0b44d85030766275cc2652613c861dd}] for task: cbc357ccb763df2852fee8c4fc7d55f2 | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{a2d0556147a9b80e897e47f44e3f2415}] | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create multi task slot [SlotRequestId{573a3c4cfbc0c732fdbd211142a6e123}] in slot [SlotRequestId{a2d0556147a9b80e897e47f44e3f2415}]. | |
2020-10-11 21:20:16.881 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager [] - Create single task slot [SlotRequestId{c0b44d85030766275cc2652613c861dd}] in multi task slot [SlotRequestId{573a3c4cfbc0c732fdbd211142a6e123}] for group cbc357ccb763df2852fee8c4fc7d55f2. | |
2020-10-11 21:20:16.883 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmaster.JobMaster [] - Trigger heartbeat request. | |
2020-10-11 21:20:16.884 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager akka.tcp://flink@myjob-201076.default:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000) | |
2020-10-11 21:20:16.967 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Try to connect to remote RPC endpoint with address akka.tcp://flink@myjob-201076.default:6123/user/rpc/resourcemanager_*. Returning a org.apache.flink.runtime.resourcemanager.ResourceManagerGateway gateway. | |
2020-10-11 21:20:17.067 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Recovered 0 pods from previous attempts, current attempt id is 1. | |
2020-10-11 21:20:17.082 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - ResourceManager akka.tcp://flink@myjob-201076.default:6123/user/rpc/resourcemanager_0 was granted leadership with fencing token 00000000000000000000000000000000 | |
2020-10-11 21:20:17.083 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] - Starting the SlotManager. | |
2020-10-11 21:20:17.085 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.kubernetes.KubernetesResourceManager [] - Trigger heartbeat request. | |
2020-10-11 21:20:17.086 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.kubernetes.KubernetesResourceManager [] - Trigger heartbeat request. | |
2020-10-11 21:20:17.088 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration | |
2020-10-11 21:20:17.088 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.jobmaster.JobMaster [] - Registration at ResourceManager attempt 1 (timeout=100ms) | |
2020-10-11 21:20:17.090 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.resourcemanager.JobLeaderIdService [] - Add job 493cd86e389ccc8f2887e1222903b5ce to job leader id monitoring. | |
2020-10-11 21:20:17.091 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.resourcemanager.JobLeaderIdService [] - Found a new job leader 00000000-0000-0000-0000-000000000000@UNKNOWN. | |
2020-10-11 21:20:17.091 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Registering job manager 00000000000000000000000000000000@akka.tcp://flink@myjob-201076.default:6123/user/rpc/jobmanager_2 for job 493cd86e389ccc8f2887e1222903b5ce. | |
2020-10-11 21:20:17.091 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Try to connect to remote RPC endpoint with address akka.tcp://flink@myjob-201076.default:6123/user/rpc/jobmanager_2. Returning a org.apache.flink.runtime.jobmaster.JobMasterGateway gateway. | |
2020-10-11 21:20:17.167 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Registered job manager 00000000000000000000000000000000@akka.tcp://flink@myjob-201076.default:6123/user/rpc/jobmanager_2 for job 493cd86e389ccc8f2887e1222903b5ce. | |
2020-10-11 21:20:17.178 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000. | |
2020-10-11 21:20:17.178 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{fd665ad590886603ce880ac3ce7510ca}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.179 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id f895cd0f7c4acb1a6f7e60f650272637. | |
2020-10-11 21:20:17.179 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{c97691b874f35d447257929e318c0a0b}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.179 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{d0c03fbf5a0005b73a130bed9a7b6e57}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.180 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{9010737ada9ded74b563833c6393d4d5}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.180 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{42579bfff6c859376991daa34e8e5c96}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.180 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{c116b61685280824029208d8080b4cb3}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.180 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{af98b1a453326abf4403ea7b5b0579a8}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.180 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{32f69b57ceefe92c3d09119e18636bf0}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.180 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{4a5f56981c2014a3f3733f93eb3e83e1}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.181 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{4781f3ad7b7be0372f3f74fbbfc396ca}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.181 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{ba8bee2d659b3cc88ccdc40d71f7c14a}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.181 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{782adfa97ec4b446f50e5124506f6af4}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.181 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{d6ab729804eae028ed302d8bbe64b721}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.181 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{49e5a182d894d72c657ef88c45d5df15}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.182 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{a0688e732ba3ee513f4872b68eab3156}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.181 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.182 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{17867e97f91a69124e1b6f6f8897b249}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.182 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{9bbbc63b0e73f4e42fb5d0bc33b69a0e}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.183 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{f7b1b0e6dd0a0bf2b1c7794ca5132b9d}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.183 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{9a10b1d1d7a39b18438c60cb718fa121}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.183 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{71b3689180f0871ef568366498432995}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.183 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{2cd645fcd28eed3608623d9956a6339e}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.183 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{bad5dd6174913ab8f4e0514041ff81a8}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.183 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{25302de5a291781df18c38dd4bbbc343}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.183 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{d40b7040386f633a6326bc276eecafc0}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.184 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{d0bf3499752434beaa7020d51d5bde08}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.184 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{1602dcbda8e02ced987dfea8c7a8d5bc}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.184 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{05b6be88742b439e721295c037111593}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.184 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{87fb7a8e0b4397740a121318c6040af0}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.184 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{8ab553094ab17859b8466f62b7c436c3}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.184 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{c3ef8f075b4229401682d40c1c51fba2}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.185 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{f91635d5538fb51cb123b2866df3d128}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.185 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{28eaaea6372d731b9b20f9dbbe22d88d}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.185 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{e2b2108906be1628e7ac167629b20e87}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.185 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{b2a22e8a43e163a0e5e3a829f4f19660}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.185 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{c644ac266f4ced5404c31a832996da59}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.185 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{fba5a5f511c46abf105c8b549e957d3e}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.186 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{37edba92e1438d8903dfab81b714594a}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.186 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{b5bd7fcf75c46d3ca0308605de85083d}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.186 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{9582b017cbe2e646eb1d594a4ddbb0bc}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.186 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{424d9c23ea6e882f71daeea72e3814e9}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.186 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{a8a7ace26209ef1bd0931c37e9401e44}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.186 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{0ad201a2e67fa48372c15ce4d43762c1}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.187 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{bae57683e7b9e3308315aaad49c65f29}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.187 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{c7cb9f1f278bda7987de07345ca762b6}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.187 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{da328171c0f84cbe90cb5e8d344e67ea}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.187 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{0ab31d0fb89aa5242e86b048b95c56b1}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.187 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{5ea50a86e38ce092a237aabfd3856bb7}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.187 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{1dc7bf10fdd5e5eced16249f32c5c10c}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.188 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{2c44407e0a59298f34a420b2838e33f6}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.188 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting new slot [SlotRequestId{a2d0556147a9b80e897e47f44e3f2415}] and profile ResourceProfile{UNKNOWN} from resource manager. | |
2020-10-11 21:20:17.188 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.188 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 1. | |
2020-10-11 21:20:17.300 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id ae2e7d79fe48042bab0d05d5670dc7bd. | |
2020-10-11 21:20:17.300 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.301 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.302 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 2. | |
2020-10-11 21:20:17.305 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 986deccbeeec643ae6095a95b542ce19. | |
2020-10-11 21:20:17.305 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.306 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.306 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 3. | |
2020-10-11 21:20:17.309 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id b2d1645789eaac6391a1221c79c1f994. | |
2020-10-11 21:20:17.309 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.310 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.310 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 4. | |
2020-10-11 21:20:17.369 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 48243e6460f314183408b2cc41941191. | |
2020-10-11 21:20:17.369 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.370 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.370 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 5. | |
2020-10-11 21:20:17.373 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 01bf57545e8ccd7ce16bc64e41b17303. | |
2020-10-11 21:20:17.373 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.374 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.374 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 6. | |
2020-10-11 21:20:17.378 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id a3ebed077912faf172b50194c9da9222. | |
2020-10-11 21:20:17.378 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.379 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.379 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 7. | |
2020-10-11 21:20:17.382 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 228a90807612e9ef70f7791d340a635c. | |
2020-10-11 21:20:17.383 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.383 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.383 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 8. | |
2020-10-11 21:20:17.386 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id b8050dc883d2a7173735b572b5f1df89. | |
2020-10-11 21:20:17.386 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.386 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.386 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 9. | |
2020-10-11 21:20:17.467 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 079c6e131ba43f872df5fbfa052b1763. | |
2020-10-11 21:20:17.467 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.468 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.468 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 10. | |
2020-10-11 21:20:17.471 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 71927822351b436f64cbdfeb76c58a35. | |
2020-10-11 21:20:17.472 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.472 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.473 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 11. | |
2020-10-11 21:20:17.476 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 9dc052e6c57f5de499fb5f9cbeb4b3d1. | |
2020-10-11 21:20:17.476 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.477 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.477 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 12. | |
2020-10-11 21:20:17.481 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id c6222e6e613015f4e7da12067ec505c6. | |
2020-10-11 21:20:17.481 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.482 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.482 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 13. | |
2020-10-11 21:20:17.485 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 80fa16fa735b0cf986d72880ae4abfd2. | |
2020-10-11 21:20:17.486 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.486 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.487 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 14. | |
2020-10-11 21:20:17.489 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-2, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-2, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.566 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 1faa566d54a74e32125b48d17f015b95. | |
2020-10-11 21:20:17.566 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.567 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.568 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 15. | |
2020-10-11 21:20:17.571 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 3e8a07ecd88d838f823d8364a7c97f87. | |
2020-10-11 21:20:17.571 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.572 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.572 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 16. | |
2020-10-11 21:20:17.573 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-1, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-1, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.576 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id d0fcc1c40c3e23cb129ae9dd065ead2c. | |
2020-10-11 21:20:17.576 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.577 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.577 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 17. | |
2020-10-11 21:20:17.580 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id e64079878673edc0e4b289cbe4fd1e85. | |
2020-10-11 21:20:17.580 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.581 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.581 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 18. | |
2020-10-11 21:20:17.584 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 14f3067b0ea244f6853fcfbf238386c9. | |
2020-10-11 21:20:17.584 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.585 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.585 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 19. | |
2020-10-11 21:20:17.669 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 0f82e633a0d4437c43e9967e4423aa55. | |
2020-10-11 21:20:17.669 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.669 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.669 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 20. | |
2020-10-11 21:20:17.673 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 60d5277e138a94fb73fc6691557001e0. | |
2020-10-11 21:20:17.673 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.673 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.673 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 21. | |
2020-10-11 21:20:17.677 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id e0a49f7f63336f071d0aaa04c5c3dcf2. | |
2020-10-11 21:20:17.677 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.678 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.678 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 22. | |
2020-10-11 21:20:17.681 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id a0bccd1bf4b93ab82a75d86ee9e6b796. | |
2020-10-11 21:20:17.681 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.681 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.682 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 23. | |
2020-10-11 21:20:17.684 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 19750e9be359c379e78fdf30f1a2b74e. | |
2020-10-11 21:20:17.684 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.685 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.685 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 24. | |
2020-10-11 21:20:17.688 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 4af70d8a9ec0ff1f2b3449fae4118347. | |
2020-10-11 21:20:17.688 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.688 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.688 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 25. | |
2020-10-11 21:20:17.699 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-3, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-3, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.767 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 9c2584e00a7fc33d65acef9439e1ebcd. | |
2020-10-11 21:20:17.767 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.767 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.768 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 26. | |
2020-10-11 21:20:17.770 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 15a6c560d8a7fbb636ae26d9a90c1500. | |
2020-10-11 21:20:17.770 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.771 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.771 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 27. | |
2020-10-11 21:20:17.774 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 71e89c45b3dd3692f372c8068a9118c7. | |
2020-10-11 21:20:17.774 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.774 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.774 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 28. | |
2020-10-11 21:20:17.774 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-4, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-4, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.777 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 8029801bc2c19915c6c07e34fb3e5405. | |
2020-10-11 21:20:17.777 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.777 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-2, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.777 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.778 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 29. | |
2020-10-11 21:20:17.780 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id d2ed27ec3c94920dca212d22f33bd30b. | |
2020-10-11 21:20:17.780 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.781 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.781 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 30. | |
2020-10-11 21:20:17.789 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-5, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-5, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.868 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-1, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.870 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 5000f09bde59dd6b99266f3940b0914d. | |
2020-10-11 21:20:17.870 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.871 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.871 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 31. | |
2020-10-11 21:20:17.872 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-2, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.872 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-6, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-6, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.874 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 4b96b4939634ad15a9586fc8bf3e8057. | |
2020-10-11 21:20:17.874 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.875 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.875 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 32. | |
2020-10-11 21:20:17.875 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-1, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.877 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 9742f9a4490c0afae3c1a596abc38a01. | |
2020-10-11 21:20:17.877 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.878 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.878 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 33. | |
2020-10-11 21:20:17.878 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-2, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.16, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:17.880 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id b31599241a4ac8661c1d319b60ec01e1. | |
2020-10-11 21:20:17.880 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.881 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.881 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 34. | |
2020-10-11 21:20:17.883 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id d8d2465b97de8e9795c5e603a0f63a01. | |
2020-10-11 21:20:17.883 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.883 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-1, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.5, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:17.884 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.884 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 35. | |
2020-10-11 21:20:17.885 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-3, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.886 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 49c09725f2bee48f9be039804ace2ed1. | |
2020-10-11 21:20:17.886 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.886 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-3, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.887 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.887 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 36. | |
2020-10-11 21:20:17.888 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-4, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.888 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 64e172d2677e3e2b9919aab99fa37e5e. | |
2020-10-11 21:20:17.889 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.889 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.889 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 37. | |
2020-10-11 21:20:17.889 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-7, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-7, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.893 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-8, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-8, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:17.966 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-4, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.967 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id ffd20b48e7f4687427fc5824318b1ec4. | |
2020-10-11 21:20:17.968 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.968 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.968 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 38. | |
2020-10-11 21:20:17.970 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-3, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.17, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:17.971 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 1682c4744832e7345f7dcff606e187e1. | |
2020-10-11 21:20:17.971 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.972 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.972 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 39. | |
2020-10-11 21:20:17.972 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-4, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.14, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:17.974 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-5, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.974 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 976aadddcae917cc845c5c753839444b. | |
2020-10-11 21:20:17.974 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.975 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-6, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.975 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.975 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 40. | |
2020-10-11 21:20:17.976 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-5, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.977 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 3146729725672d44274e50784aed1d83. | |
2020-10-11 21:20:17.977 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.978 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-6, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.978 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.978 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 41. | |
2020-10-11 21:20:17.979 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-5, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.15, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:17.980 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 0efbe35b7ecc59a3363b1827382c576a. | |
2020-10-11 21:20:17.980 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.981 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-6, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.6, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:17.981 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.981 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 42. | |
2020-10-11 21:20:17.982 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-8, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.983 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 3c297ef3a9ddb8814bee120592caaef3. | |
2020-10-11 21:20:17.983 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:17.984 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-7, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:17.984 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:17.984 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 43. | |
2020-10-11 21:20:17.985 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-8, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.066 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 837b9cdbdac8ceda822f7430ac851019. | |
2020-10-11 21:20:17.990 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-10, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-10, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.067 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:18.066 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-9, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-9, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.067 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:18.067 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 44. | |
2020-10-11 21:20:18.067 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-7, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.069 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-7, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.10, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.070 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 5d571e256aedb424a62fc1e941073713. | |
2020-10-11 21:20:18.070 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:18.070 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:18.070 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 45. | |
2020-10-11 21:20:18.072 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-8, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.073 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 8403c89d39fa38a222f6954dc90db0c6. | |
2020-10-11 21:20:18.073 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:18.073 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:18.073 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 46. | |
2020-10-11 21:20:18.075 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id e87eb02cd6609cfa794dc16d9dc2ee7b. | |
2020-10-11 21:20:18.076 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:18.076 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:18.076 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 47. | |
2020-10-11 21:20:18.078 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id a2bf528094c9af052cae107deb2d60d2. | |
2020-10-11 21:20:18.078 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:18.079 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:18.079 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 48. | |
2020-10-11 21:20:18.081 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-9, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.082 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id 87c048ecf7cb5fe6a9432265b36fcdf5. | |
2020-10-11 21:20:18.082 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:18.082 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-10, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.082 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:18.082 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 49. | |
2020-10-11 21:20:18.085 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Request slot with profile ResourceProfile{UNKNOWN} for job 493cd86e389ccc8f2887e1222903b5ce with allocation id e946b48e6c2a275d94702f81e2fc570f. | |
2020-10-11 21:20:18.085 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Starting new worker with worker resource spec, WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)} | |
2020-10-11 21:20:18.085 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: [] | |
2020-10-11 21:20:18.085 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Requesting new TaskManager pod with <4096,1.0>. Number pending requests 50. | |
2020-10-11 21:20:18.086 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-9, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.087 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-2 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.088 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-1 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.088 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-11, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-11, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.088 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-2 | |
2020-10-11 21:20:18.089 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 49 | |
2020-10-11 21:20:18.090 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-3 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.090 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-4 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.090 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-1 | |
2020-10-11 21:20:18.090 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 48 | |
2020-10-11 21:20:18.092 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-12, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-12, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-5 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-6 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-3 | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 47 | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-4 | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 46 | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-5 | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 45 | |
2020-10-11 21:20:18.167 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-6 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 44 | |
2020-10-11 21:20:18.168 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-10, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-8 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-8 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 43 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-7 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-7 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 42 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-10 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-9 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-9 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 41 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-10 | |
2020-10-11 21:20:18.168 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 40 | |
2020-10-11 21:20:18.169 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-9, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.8, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.170 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-10, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.15, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.178 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-11 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.178 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-12 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.178 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-12, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.178 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-12 | |
2020-10-11 21:20:18.178 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 39 | |
2020-10-11 21:20:18.180 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-11, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.180 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-11 | |
2020-10-11 21:20:18.180 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 38 | |
2020-10-11 21:20:18.185 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-13, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-13, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.185 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-12, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.188 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-11, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.188 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-14, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-14, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.200 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-14 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.200 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-13, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.200 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-13 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.200 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-13 | |
2020-10-11 21:20:18.200 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 37 | |
2020-10-11 21:20:18.201 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-14, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.202 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-14 | |
2020-10-11 21:20:18.202 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 36 | |
2020-10-11 21:20:18.207 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-13, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.209 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-15, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-15, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.266 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-14, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.267 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-12, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.268 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-11, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.4, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.269 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-13, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.8, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.270 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-14, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.5, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.270 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-16, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-16, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.275 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-15, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.275 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-15 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.275 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-15 | |
2020-10-11 21:20:18.275 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 35 | |
2020-10-11 21:20:18.280 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-15, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.280 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-17, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-17, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.288 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-16 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.288 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-16, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.288 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-16 | |
2020-10-11 21:20:18.288 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 34 | |
2020-10-11 21:20:18.293 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-17, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.293 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-17 | |
2020-10-11 21:20:18.293 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 33 | |
2020-10-11 21:20:18.293 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-17 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.293 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-18, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-18, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.296 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-16, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.298 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-19, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-19, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.300 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-17, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.304 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-18 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.367 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-18, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.368 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-18 | |
2020-10-11 21:20:18.368 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 32 | |
2020-10-11 21:20:18.367 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-20, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-20, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.368 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-15, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.10, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.369 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-18, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.371 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-16, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.14, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.372 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-17, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.6, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.373 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-18, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.16, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.376 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-19, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.376 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-19 | |
2020-10-11 21:20:18.377 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 31 | |
2020-10-11 21:20:18.377 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-19 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.380 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-20, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.380 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-20 | |
2020-10-11 21:20:18.380 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 30 | |
2020-10-11 21:20:18.380 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-20 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.381 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-21, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-21, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.385 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-19, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.386 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-20, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.387 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-22, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-22, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.397 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-21 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.397 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-22 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.397 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-21, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.397 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-21 | |
2020-10-11 21:20:18.397 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 29 | |
2020-10-11 21:20:18.398 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-22, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.398 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-22 | |
2020-10-11 21:20:18.398 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 28 | |
2020-10-11 21:20:18.403 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-24, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-24, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.403 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-21, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.407 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-23, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-23, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.408 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-22, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.408 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-19, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.17, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.466 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-24 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.467 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-24, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.467 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-24 | |
2020-10-11 21:20:18.467 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-25, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-25, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.467 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 27 | |
2020-10-11 21:20:18.468 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-24, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.468 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-20, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.10, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.469 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-21, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.5, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.470 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-22, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.6, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.471 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-24, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.474 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-23, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.474 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-23 | |
2020-10-11 21:20:18.474 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 26 | |
2020-10-11 21:20:18.475 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-23 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.481 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-25, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.481 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-26, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-26, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.481 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-25 | |
2020-10-11 21:20:18.481 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 25 | |
2020-10-11 21:20:18.482 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-23, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.482 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-25 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.487 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-27, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-27, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.488 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-25, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.493 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-26, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.493 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-26 | |
2020-10-11 21:20:18.494 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 24 | |
2020-10-11 21:20:18.494 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-26 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.499 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-27 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.500 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-27, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.500 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-27 | |
2020-10-11 21:20:18.500 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 23 | |
2020-10-11 21:20:18.502 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-26, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.501 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-28, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-28, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.502 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-29, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-29, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.506 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-27, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.511 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-23, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.16, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.517 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-28, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.567 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-30, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-30, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.568 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-28 | |
2020-10-11 21:20:18.568 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 22 | |
2020-10-11 21:20:18.568 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-28 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.568 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-29 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.569 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-25, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.14, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.569 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-29, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.569 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-29 | |
2020-10-11 21:20:18.569 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 21 | |
2020-10-11 21:20:18.570 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-28, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.571 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-29, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.571 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-31, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-31, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.572 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-26, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.4, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.573 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-27, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.15, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.574 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-28, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.8, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.574 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-29, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.17, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.579 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-30 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.580 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-30, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.580 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-30 | |
2020-10-11 21:20:18.580 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 20 | |
2020-10-11 21:20:18.586 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-31 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.586 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-31, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.586 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-32, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-32, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.588 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-31 | |
2020-10-11 21:20:18.588 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 19 | |
2020-10-11 21:20:18.589 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-30, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.599 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-33, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-33, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.601 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-31, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.602 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-32 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.667 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-32, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.667 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-32 | |
2020-10-11 21:20:18.667 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 18 | |
2020-10-11 21:20:18.668 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-33, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.668 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-33 | |
2020-10-11 21:20:18.668 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 17 | |
2020-10-11 21:20:18.731 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-33 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.733 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-32, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.735 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-30, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.17, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.736 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-33, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.736 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-35, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-35, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.743 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-34, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-34, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.746 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-35 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.747 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-35, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.747 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-35 | |
2020-10-11 21:20:18.747 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 16 | |
2020-10-11 21:20:18.832 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-31, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.4, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.834 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-36, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-36, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.838 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-34 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.838 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-34, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.838 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-34 | |
2020-10-11 21:20:18.838 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 15 | |
2020-10-11 21:20:18.839 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-33, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.14, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.842 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-35, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.849 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-34, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.850 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-37, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-37, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.851 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-36, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.851 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-36 | |
2020-10-11 21:20:18.851 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 14 | |
2020-10-11 21:20:18.930 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-36 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.931 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-37 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.931 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-32, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.932 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-36, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.933 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-37, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.933 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-37 | |
2020-10-11 21:20:18.933 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 13 | |
2020-10-11 21:20:18.934 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-38, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-38, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.935 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-39, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-39, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.945 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-35, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.10, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.946 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-37, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.948 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-38 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.949 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-34, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.8, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.950 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-38, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.951 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-38 | |
2020-10-11 21:20:18.951 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 12 | |
2020-10-11 21:20:18.952 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-39 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.953 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-39, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.953 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-39 | |
2020-10-11 21:20:18.953 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 11 | |
2020-10-11 21:20:18.955 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-40, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-40, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.955 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-38, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.959 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-39, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.959 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-41, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-41, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:18.964 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-36, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.16, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:18.966 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-40, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.966 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-40 | |
2020-10-11 21:20:18.966 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 10 | |
2020-10-11 21:20:18.966 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-40 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:18.971 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-41, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:18.972 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-41 | |
2020-10-11 21:20:18.972 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 9 | |
2020-10-11 21:20:18.972 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-41 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.030 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-42, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-42, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.030 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-37, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.15, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:19.031 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-40, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.034 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-43, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-43, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.037 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-41, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.038 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-39, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.6, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:19.042 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-42, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.044 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-42 | |
2020-10-11 21:20:19.044 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 8 | |
2020-10-11 21:20:19.049 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-38, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.5, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:19.050 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-43, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.050 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-43 | |
2020-10-11 21:20:19.050 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 7 | |
2020-10-11 21:20:19.050 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-43 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.067 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-42, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.067 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-43, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.067 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-44, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-44, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.068 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-40, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.17, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.069 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-42 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.069 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-41, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.15, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.135 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-45, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-45, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.136 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-44 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.138 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-44, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.138 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-44 | |
2020-10-11 21:20:19.138 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 6 | |
2020-10-11 21:20:19.143 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-43, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.14, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.143 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-46, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-46, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.167 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-44, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.230 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-45 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.237 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-42, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.237 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-47, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-47, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.237 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-45, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.237 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-45 | |
2020-10-11 21:20:19.237 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 5 | |
2020-10-11 21:20:19.240 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-46, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.240 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-46 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.240 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-46 | |
2020-10-11 21:20:19.240 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 4 | |
2020-10-11 21:20:19.244 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-45, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.244 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-48, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-48, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.249 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-46, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.250 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-47, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.250 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-47 | |
2020-10-11 21:20:19.250 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 3 | |
2020-10-11 21:20:19.251 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-47 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.331 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-48 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.333 [FlinkKubeClient-IO-thread-2] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-49, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-49, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.333 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-48, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.334 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-48 | |
2020-10-11 21:20:19.334 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 2 | |
2020-10-11 21:20:19.334 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-47, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.341 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-44, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.8, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.342 [FlinkKubeClient-IO-thread-1] DEBUG org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClient [] - Start to create pod with metadata ObjectMeta(HDFS12clusterName=null, creationTimestamp=null, deletionGracePeriodSeconds=null, deletionTimestamp=null, finalizers=[], generateName=null, generation=null, labels={app=myjob-201076, component=taskmanager, requestId=04fc975d-8815-4a04-939b-b890b34117c9,type=flink-native-kubernetes, jobSerialId=myjob}, managedFields=[], name=myjob-201076-taskmanager-1-50, namespace=null, ownerReferences=[OwnerReference(apiVersion=apps/v1, blockOwnerDeletion=true, controller=true, kind=Deployment, name=myjob-201076, uid=5178d5fe-fe2a-4344-b021-f591d0933651, additionalProperties={})], resourceVersion=null, selfLink=null, uid=null, additionalProperties={}), spec PodSpec(activeDeadlineSeconds=null, affinity=null, automountServiceAccountToken=null, containers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Xmx1664299798 -Xms1664299798 -XX:MaxDirectMemorySize=493921243 -XX:MaxMetaspaceSize=268435456 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ErrorFile=/tmp/taskmanager.err -Dlog.file=/opt/flink/log/taskmanager.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.taskmanager.KubernetesTaskExecutorRunner -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=359703515b -D taskmanager.memory.network.min=359703515b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=1438814063b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=1530082070b -D taskmanager.memory.task.off-heap.size=0b --configDir /opt/flink/conf -Dtaskmanager.memory.process.size='4 gb' -Dweb.tmpdir='/tmp/flink-web-3edcafa6-48c5-4ff7-a82e-b983bce0011a'], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=_FLINK_POD_NAME, value=myjob-201076-taskmanager-1-50, valueFrom=null, additionalProperties={}), EnvVar(name=INTERNAL_SHIP_JARS_CLASS_PATHS, value=/var/flink-data/flink-jars/flink-connector-kafka.jar:/var/flink-data/flink-jars/flink-connector-jdbc.jar, valueFrom=null, additionalProperties={}), EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-task-manager, ports=[ContainerPort(containerPort=6122, hostIP=null, hostPort=null, name=taskmanager-rpc, protocol=null, additionalProperties={})], readinessProbe=null, resources=ResourceRequirements(limits={memory=4096Mi, cpu=1.0}, requests={memory=4096Mi, cpu=1.0}, additionalProperties={}), securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], dnsConfig=null, dnsPolicy=null, enableServiceLinks=null, ephemeralContainers=[], hostAliases=[], hostIPC=null, hostNetwork=null, hostPID=null, hostname=null, imagePullSecrets=[], initContainers=[Container(args=[/bin/bash, -c, $JAVA_HOME/bin/java -Duser.timezone=GMT+08 -classpath $FLINK_CLASSPATH -Dlog.file=/opt/flink/log/initcontainer.log -Dlog4j.configurationFile=file:/opt/flink/conf/log4j.properties org.apache.flink.kubernetes.entrypoint.KubernetesInitContainerEntrypoint], command=[/opt/flink/bin/kubernetes-entry.sh], env=[EnvVar(name=HADOOP_CONF_DIR, value=/opt/hadoop/conf, valueFrom=null, additionalProperties={})], envFrom=[], image=flink-k8s:v1.11.0, imagePullPolicy=IfNotPresent, lifecycle=null, livenessProbe=null, name=flink-initializer, ports=[], readinessProbe=null, resources=null, securityContext=null, startupProbe=null, stdin=null, stdinOnce=null, terminationMessagePath=null, terminationMessagePolicy=null, tty=null, volumeDevices=[], volumeMounts=[VolumeMount(mountPath=/var/flink-data/flink-jars, mountPropagation=null, name=download-jars-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/var/flink-data/flink-files, mountPropagation=null, name=download-files-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/hadoop/conf, mountPropagation=null, name=hadoop-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={}), VolumeMount(mountPath=/opt/flink/conf, mountPropagation=null, name=flink-config-volume, readOnly=null, subPath=null, subPathExpr=null, additionalProperties={})], workingDir=null, additionalProperties={})], nodeName=null, nodeSelector={}, overhead=null, preemptionPolicy=null, priority=null, priorityClassName=null, readinessGates=[], restartPolicy=Never, runtimeClassName=null, schedulerName=null, securityContext=null, serviceAccount=null, serviceAccountName=null, shareProcessNamespace=null, subdomain=null, terminationGracePeriodSeconds=null, tolerations=[], topologySpreadConstraints=[], volumes=[Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-jars-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=null, csi=null, downwardAPI=null, emptyDir=EmptyDirVolumeSource(medium=null, sizeLimit=null, additionalProperties={}), fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=download-files-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=core-site.xml, mode=null, path=core-site.xml, additionalProperties={}), KeyToPath(key=hdfs-site.xml, mode=null, path=hdfs-site.xml, additionalProperties={})], name=hadoop-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=hadoop-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={}), Volume(awsElasticBlockStore=null, azureDisk=null, azureFile=null, cephfs=null, cinder=null, configMap=ConfigMapVolumeSource(defaultMode=null, items=[KeyToPath(key=log4j.properties, mode=null, path=log4j.properties, additionalProperties={}), KeyToPath(key=flink-conf.yaml, mode=null, path=flink-conf.yaml, additionalProperties={})], name=flink-config-myjob-201076, optional=null, additionalProperties={}), csi=null, downwardAPI=null, emptyDir=null, fc=null, flexVolume=null, flocker=null, gcePersistentDisk=null, gitRepo=null, glusterfs=null, hostPath=null, iscsi=null, name=flink-config-volume, nfs=null, persistentVolumeClaim=null, photonPersistentDisk=null, portworxVolume=null, projected=null, quobyte=null, rbd=null, scaleIO=null, secret=null, storageos=null, vsphereVolume=null, additionalProperties={})], additionalProperties={}) | |
2020-10-11 21:20:19.347 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-48, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.371 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-49 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.430 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-49, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.430 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-49 | |
2020-10-11 21:20:19.430 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 1 | |
2020-10-11 21:20:19.431 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-46, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.16, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.440 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-45, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.10, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.445 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-49, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.446 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-47, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.6, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.530 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - TaskManager myjob-201076-taskmanager-1-50 will be started with WorkerResourceSpec {cpuCores=1.0, taskHeapSize=1.425gb (1530082070 bytes), taskOffHeapSize=0 bytes, networkMemSize=343.040mb (359703515 bytes), managedMemSize=1.340gb (1438814063 bytes)}. | |
2020-10-11 21:20:19.531 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received ADDED event for pod myjob-201076-taskmanager-1-50, details: PodStatus(conditions=[], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.531 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received new TaskManager pod: myjob-201076-taskmanager-1-50 | |
2020-10-11 21:20:19.531 [flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.kubernetes.KubernetesResourceManager [] - Received 1 new TaskManager pods. Remaining pending pod requests: 0 | |
2020-10-11 21:20:19.568 [flink-rest-server-netty-worker-thread-1] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBuf [] - -Dorg.apache.flink.shaded.netty4.io.netty.buffer.checkAccessible: true | |
2020-10-11 21:20:19.568 [flink-rest-server-netty-worker-thread-1] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBuf [] - -Dorg.apache.flink.shaded.netty4.io.netty.buffer.checkBounds: true | |
2020-10-11 21:20:19.569 [flink-rest-server-netty-worker-thread-1] DEBUG org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetectorFactory [] - Loaded default ResourceLeakDetector: org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector@16fbe490 | |
2020-10-11 21:20:19.600 [flink-rest-server-netty-worker-thread-1] DEBUG org.apache.flink.shaded.netty4.io.netty.util.Recycler [] - -Dio.netty.recycler.maxCapacityPerThread: 4096 | |
2020-10-11 21:20:19.600 [flink-rest-server-netty-worker-thread-1] DEBUG org.apache.flink.shaded.netty4.io.netty.util.Recycler [] - -Dio.netty.recycler.maxSharedCapacityFactor: 2 | |
2020-10-11 21:20:19.600 [flink-rest-server-netty-worker-thread-1] DEBUG org.apache.flink.shaded.netty4.io.netty.util.Recycler [] - -Dio.netty.recycler.linkCapacity: 16 | |
2020-10-11 21:20:19.600 [flink-rest-server-netty-worker-thread-1] DEBUG org.apache.flink.shaded.netty4.io.netty.util.Recycler [] - -Dio.netty.recycler.ratio: 8 | |
2020-10-11 21:20:19.631 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-48, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.4, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.632 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-50, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[], ephemeralContainerStatuses=[], hostIP=null, initContainerStatuses=[], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=null, additionalProperties={}) | |
2020-10-11 21:20:19.643 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-49, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.5, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:19.688 [Flink-DispatcherRestEndpoint-thread-1] DEBUG org.apache.flink.runtime.rest.handler.legacy.metrics.MetricFetcherImpl [] - Start fetching metrics. | |
2020-10-11 21:20:19.692 [Flink-DispatcherRestEndpoint-thread-2] DEBUG org.apache.flink.runtime.rest.handler.legacy.metrics.MetricFetcherImpl [] - Retrieve metric query service gateway for akka.tcp://flink-metrics@myjob-201076.default:37001/user/rpc/MetricQueryService | |
2020-10-11 21:20:19.693 [Flink-DispatcherRestEndpoint-thread-2] DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Try to connect to remote RPC endpoint with address akka.tcp://flink-metrics@myjob-201076.default:37001/user/rpc/MetricQueryService. Returning a org.apache.flink.runtime.webmonitor.retriever.MetricQueryServiceGateway gateway. | |
2020-10-11 21:20:19.695 [Flink-DispatcherRestEndpoint-thread-2] DEBUG org.apache.flink.runtime.rest.handler.legacy.metrics.MetricFetcherImpl [] - Query metrics for akka.tcp://flink-metrics@myjob-201076.default:37001/user/rpc/MetricQueryService. | |
2020-10-11 21:20:19.843 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-50, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:19Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:19Z, additionalProperties={}) | |
2020-10-11 21:20:21.672 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-2, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.16, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:21.858 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-1, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.5, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:21.868 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-4, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.14, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:22.253 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-3, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.17, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:22.254 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-6, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.6, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:22.360 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-5, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.15, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:17Z, additionalProperties={}) | |
2020-10-11 21:20:22.454 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-7, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.10, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:22.557 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-8, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:17Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:22.759 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-9, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.8, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:22.871 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-11, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.4, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:25.447 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-18, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.16, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:25.677 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-16, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.14, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:25.775 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-14, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.5, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.054 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-17, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.6, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.063 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-19, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.17, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.262 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-12, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.12, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.270 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-10, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.15, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.271 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-15, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.10, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.659 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-13, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.8, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.750 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-26, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-manager, ready=false, restartCount=0, started=false, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], ephemeralContainerStatuses=[], hostIP=9.165.0.4, initContainerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-initializer, ready=false, restartCount=0, started=null, state=ContainerState(running=null, terminated=null, waiting=ContainerStateWaiting(message=null, reason=PodInitializing, additionalProperties={}), additionalProperties={}), additionalProperties={})], message=null, nominatedNodeName=null, phase=Pending, podIP=null, podIPs=[], qosClass=Burstable, reason=null, startTime=2020-10-11T13:20:18Z, additionalProperties={}) | |
2020-10-11 21:20:26.902 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.jobmaster.JobMaster [] - Trigger heartbeat request. | |
2020-10-11 21:20:27.102 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.kubernetes.KubernetesResourceManager [] - Trigger heartbeat request. | |
2020-10-11 21:20:27.102 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.kubernetes.KubernetesResourceManager [] - Trigger heartbeat request. | |
2020-10-11 21:20:27.102 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.jobmaster.JobMaster [] - Received heartbeat request from d669aabd5640cf855833b9fa3153b506. | |
2020-10-11 21:20:27.103 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.kubernetes.KubernetesResourceManager [] - Received heartbeat from 3e2c2ff16db684b9ad63907c955a6a55. | |
2020-10-11 21:20:29.172 [OkHttp https://9.166.224.1/...] DEBUG org.apache.flink.kubernetes.kubeclient.resources.KubernetesPodsWatcher [] - Received MODIFIED event for pod myjob-201076-taskmanager-1-23, details: PodStatus(conditions=[PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with incomplete status: [flink-initializer], reason=ContainersNotInitialized, status=False, type=Initialized, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=Ready, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=containers with unready status: [flink-task-manager], reason=ContainersNotReady, status=False, type=ContainersReady, additionalProperties={}), PodCondition(lastProbeTime=null, lastTransitionTime=2020-10-11T13:20:18Z, message=null, reason=null, status=True, type=PodScheduled, additionalProperties={})], containerStatuses=[ContainerStatus(containerID=null, image=flink-k8s:v1.11.0, imageID=, lastState=ContainerState(running=null, terminated=null, waiting=null, additionalProperties={}), name=flink-task-m |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment