Skip to content

Instantly share code, notes, and snippets.

@Ethanlm
Created February 14, 2019 16:00
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Ethanlm/86a10e786ad9025ddaa27c113c536da8 to your computer and use it in GitHub Desktop.
Save Ethanlm/86a10e786ad9025ddaa27c113c536da8 to your computer and use it in GitHub Desktop.
TaskManager gets confused when the JobManager restarts (because the JM rpc port changed from 35213 to 34561)
2019-02-14 14:56:54,083 DEBUG org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService - Leader node changed while akka.ssl.tcp://flink@openstorm10blue-n1.b
lue.ygrid.yahoo.com:34561/user/jobmanager is the leader with session ID 2d2d1c35-0e4b-40d5-9eb6-121704ee93e3.
2019-02-14 14:56:54,155 DEBUG org.apache.flink.shaded.akka.org.jboss.netty.handler.ssl.SslHandler - [id: 0x1689f19c, /10.215.68.243:46796 => /10.215.68.98:34561] HANDSHAK
EN: TLS_RSA_WITH_AES_128_CBC_SHA
2019-02-14 14:56:54,239 DEBUG org.apache.flink.runtime.jobmanager.JobManager - RegisterTaskManager: RegisterTaskManager(30e68190922e702842ffd09933a619aa,30e
68190922e702842ffd09933a619aa @ openstorm10blue-n3.blue.ygrid.yahoo.com (dataPort=50102),cores=4, physMem=16557678592, heap=4139778048, managed=2600571648,3)
2019-02-14 14:56:54,239 INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - TaskManager 30e68190922e702842ffd09933a619aa has started.
2019-02-14 14:56:54,244 INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager at openstorm10blue-n3 (akka.ssl.tcp://flink@openstorm1
0blue-n3.blue.ygrid.yahoo.com:50101/user/taskmanager) as fd3dbe6cd2fcd12620395c4834a5faa0. Current number of registered hosts is 1. Current number of alive task slots is 3
.
2019-02-14 14:57:04,053 INFO org.apache.flink.runtime.jobmanager.JobManager - Attempting to recover all jobs.
2019-02-14 14:57:04,053 DEBUG org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore - Retrieving all stored job ids from ZooKeeper under flink/openstorm10-b
lue/jobgraphs.
2019-02-14 14:57:04,055 DEBUG org.apache.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x168a04c6e36005a, packet:: clientPath:null serv
erPath:null finished:false header:: 75,3 replyHeader:: 75,325,0 request:: '/flink/openstorm10-blue/jobgraphs,F response:: s{35,35,1548878046322,1548878046322,0,24,0,0,0
,0,316}
2019-02-14 14:57:04,057 DEBUG org.apache.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x168a04c6e36005a, packet:: clientPath:null serv
erPath:null finished:false header:: 76,12 replyHeader:: 76,325,0 request:: '/flink/openstorm10-blue/jobgraphs,F response:: v{},s{35,35,1548878046322,1548878046322,0,24,
0,0,0,0,316}
2019-02-14 14:57:04,058 INFO org.apache.flink.runtime.jobmanager.JobManager - There are no jobs to recover.
2019-02-14 14:57:17,394 DEBUG org.apache.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x168a04c6e36005a after 2ms
2019-02-14 14:57:30,730 DEBUG org.apache.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x168a04c6e36005a after 2ms
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment