Skip to content

Instantly share code, notes, and snippets.

@zavalit
Created October 30, 2018 11:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save zavalit/4dba49cdea45c6f56f947a7dcec1a666 to your computer and use it in GitHub Desktop.
Save zavalit/4dba49cdea45c6f56f947a7dcec1a666 to your computer and use it in GitHub Desktop.
Flink Job Manager Log
2018-10-30 11:07:17,379 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneJobClusterEntryPoint (Version: 1.0.0, Rev:23e2636, Date:14.09.2018 @ 21:56:46 CEST)
2018-10-30 11:07:17,379 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - OS current user: flink
2018-10-30 11:07:17,380 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Current Hadoop/Kerberos user: <no hadoop dependency found>
2018-10-30 11:07:17,380 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.161-b14
2018-10-30 11:07:17,380 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Maximum heap size: 981 MiBytes
2018-10-30 11:07:17,380 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JAVA_HOME: /etc/alternatives/jre
2018-10-30 11:07:17,382 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - No Hadoop Dependency available
2018-10-30 11:07:17,382 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM Options:
2018-10-30 11:07:17,383 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xms1024m
2018-10-30 11:07:17,383 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xmx1024m
2018-10-30 11:07:17,383 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog4j.configuration=file:/usr/local/flink/conf/log4j-console.properties
2018-10-30 11:07:17,383 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlogback.configurationFile=file:/usr/local/flink/conf/logback-console.xml
2018-10-30 11:07:17,384 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Program Arguments:
2018-10-30 11:07:17,384 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --configDir
2018-10-30 11:07:17,384 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - /usr/local/flink/conf
2018-10-30 11:07:17,384 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --configDir
2018-10-30 11:07:17,385 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - conf
2018-10-30 11:07:17,385 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --job-classname
2018-10-30 11:07:17,385 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - de.idealo.directbooking.hotelsearch.Bridge
2018-10-30 11:07:17,385 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Classpath: /usr/local/flink/lib/flink-hotel-searchbridge-assembly-1.0.0.jar:/usr/local/flink/lib/flink-metrics-prometheus-1.6.2.jar:/usr/local/flink/lib/flink-python_2.11-1.6.2.jar:/usr/local/flink/lib/log4j-1.2.17.jar:/usr/local/flink/lib/slf4j-log4j12-1.7.7.jar:/usr/local/flink/lib/flink-dist_2.11-1.6.2.jar:::
2018-10-30 11:07:17,385 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2018-10-30 11:07:17,388 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Registered UNIX signal handlers for [TERM, HUP, INT]
2018-10-30 11:07:17,418 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, flink-jobmanager
2018-10-30 11:07:17,418 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2018-10-30 11:07:17,419 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2018-10-30 11:07:17,419 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.size, 1024m
2018-10-30 11:07:17,419 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2018-10-30 11:07:17,420 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2018-10-30 11:07:17,421 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2018-10-30 11:07:17,422 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: blob.server.port, 6124
2018-10-30 11:07:17,422 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: user.name, flink
2018-10-30 11:07:17,422 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporters, prom
2018-10-30 11:07:17,423 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prom.class, org.apache.flink.metrics.prometheus.PrometheusReporter
2018-10-30 11:07:17,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneJobClusterEntryPoint.
2018-10-30 11:07:17,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install default filesystem.
2018-10-30 11:07:17,588 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2018-10-30 11:07:17,601 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install security context.
2018-10-30 11:07:17,612 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2018-10-30 11:07:17,635 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2018-10-30 11:07:17,636 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Initializing cluster services.
2018-10-30 11:07:17,659 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Trying to start actor system at flink-jobmanager:6123
2018-10-30 11:07:18,555 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2018-10-30 11:07:18,660 INFO akka.remote.Remoting - Starting remoting
2018-10-30 11:07:18,888 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://flink@flink-jobmanager:6123]
2018-10-30 11:07:18,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Actor system started at akka.tcp://flink@flink-jobmanager:6123
2018-10-30 11:07:18,924 WARN org.apache.flink.configuration.Configuration - Config uses deprecated configuration key 'jobmanager.rpc.address' instead of proper key 'rest.address'
2018-10-30 11:07:18,939 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-ca3a30c7-ecaa-436b-b240-1d5b6d5441c4
2018-10-30 11:07:18,945 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000
2018-10-30 11:07:18,991 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - Configuring prom with {class=org.apache.flink.metrics.prometheus.PrometheusReporter}.
2018-10-30 11:07:19,018 INFO org.apache.flink.metrics.prometheus.PrometheusReporter - Started PrometheusReporter HTTP server on port 9249.
2018-10-30 11:07:19,018 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - Reporting metrics for reporter prom of type org.apache.flink.metrics.prometheus.PrometheusReporter.
2018-10-30 11:07:19,028 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-18c3695a-47d0-47eb-a607-b9b944f78f25
2018-10-30 11:07:19,042 WARN org.apache.flink.configuration.Configuration - Config uses deprecated configuration key 'jobmanager.rpc.address' instead of proper key 'rest.address'
2018-10-30 11:07:19,044 WARN org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Upload directory /tmp/flink-web-52adad4b-5ea6-4f5d-96d4-68a11f58eaa7/flink-web-upload does not exist, or has been deleted externally. Previously uploaded files are no longer available.
2018-10-30 11:07:19,045 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Created directory /tmp/flink-web-52adad4b-5ea6-4f5d-96d4-68a11f58eaa7/flink-web-upload for file uploads.
2018-10-30 11:07:19,141 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Starting rest endpoint.
2018-10-30 11:07:19,519 WARN org.apache.flink.runtime.webmonitor.WebMonitorUtils - Log file environment variable 'log.file' is not set.
2018-10-30 11:07:19,519 WARN org.apache.flink.runtime.webmonitor.WebMonitorUtils - JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'Key: 'web.log.path' , default: null (deprecated keys: [jobmanager.web.log.path])'.
2018-10-30 11:07:19,959 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Rest endpoint listening at flink-jobmanager:8081
2018-10-30 11:07:19,959 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - http://flink-jobmanager:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2018-10-30 11:07:19,959 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Web frontend listening at http://flink-jobmanager:8081.
2018-10-30 11:07:19,961 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Cluster initialization failed.
java.lang.AbstractMethodError: org.apache.flink.runtime.entrypoint.ClusterEntrypoint.createResourceManager(Lorg/apache/flink/configuration/Configuration;Lorg/apache/flink/runtime/clusterframework/types/ResourceID;Lorg/apache/flink/runtime/rpc/RpcService;Lorg/apache/flink/runtime/highavailability/HighAvailabilityServices;Lorg/apache/flink/runtime/heartbeat/HeartbeatServices;Lorg/apache/flink/runtime/metrics/MetricRegistry;Lorg/apache/flink/runtime/rpc/FatalErrorHandler;Lorg/apache/flink/runtime/entrypoint/ClusterInformation;Ljava/lang/String;)Lorg/apache/flink/runtime/resourcemanager/ResourceManager;
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startClusterComponents(ClusterEntrypoint.java:338)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:232)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:190)
at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:189)
at org.apache.flink.container.entrypoint.StandaloneJobClusterEntryPoint.main(StandaloneJobClusterEntryPoint.java:176)
2018-10-30 11:07:19,967 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Shut down and terminate StandaloneJobClusterEntryPoint with return code 1 and application status FAILED.
2018-10-30 11:07:19,967 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Stopping StandaloneJobClusterEntryPoint.
2018-10-30 11:07:19,986 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Shutting down rest endpoint.
2018-10-30 11:07:20,011 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - Removing cache directory /tmp/flink-web-52adad4b-5ea6-4f5d-96d4-68a11f58eaa7/flink-web-ui
2018-10-30 11:07:20,032 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint - http://flink-jobmanager:8081 lost leadership
2018-10-30 11:07:20,034 INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:6124
2018-10-30 11:07:20,037 INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
2018-10-30 11:07:20,050 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
2018-10-30 11:07:20,057 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
2018-10-30 11:07:20,058 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
2018-10-30 11:07:20,079 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment