-
-
Save Ethanlm/221284bcaa272270a799957dc05b94fd to your computer and use it in GitHub Desktop.
failed to submit flink job to yarn. resource manager log
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2020-01-10 02:27:15,203 [Netty IPC Socket Reader #1 for port 8032] INFO ipc.Server: Starting Netty IPC Socket Reader #1 for port 8032 | |
2020-01-10 02:27:15,475 [IPC Server handler 48 on 8032] INFO resourcemanager.ClientRMService: Allocated new applicationId: 1 | |
2020-01-10 02:27:25,827 [IPC Server handler 123 on 8032] INFO capacity.CapacityScheduler: Application 'application_1578608896385_0001' is submitted without priority hence considering default queue/cluster priority: 0 | |
2020-01-10 02:27:25,827 [IPC Server handler 123 on 8032] INFO capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1578608896385_0001 for the user: userA | |
2020-01-10 02:27:25,830 [IPC Server handler 123 on 8032] INFO resourcemanager.ClientRMService: Application with id 1 submitted by user userA | |
2020-01-10 02:27:25,999 [DelegationTokenRenewer #32] INFO security.DelegationTokenRenewer: Renewed delegation-token= [Kind: HDFS_DELEGATION_TOKEN, Service: n2.com:8020, Ident: (HDFS_DELEGATION_TOKEN token 33 for userA);exp=1578709645994; apps=[application_1578608896385_0001]] | |
2020-01-10 02:27:26,001 [DelegationTokenRenewer #32] WARN security.DelegationTokenRenewer: Unable to add the application to the delegation token renewer. | |
java.io.IOException: Failed to renew token: Kind: kms-dt, Service: n7.com:4443, Ident: (owner=userA, renewer=adminB, realUser=, issueDate=1578623245674, maxDate=1579228045674, sequenceNumber=33, masterKeyId=52) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer.handleAppSubmitEvent(DelegationTokenRenewer.java:481) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer.access$900(DelegationTokenRenewer.java:79) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer$DelegationTokenRenewerRunnable.handleDTRenewerAppSubmitEvent(DelegationTokenRenewer.java:924) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer$DelegationTokenRenewerRunnable.run(DelegationTokenRenewer.java:901) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) | |
at java.lang.Thread.run(Thread.java:748) | |
Caused by: java.io.IOException: keyProvider null cannot renew token [Kind: kms-dt, Service: n7.com:4443, Ident: (owner=userA, renewer=adminB, realUser=, issueDate=1578623245674, maxDate=1579228045674, sequenceNumber=33, masterKeyId=52)] | |
at org.apache.hadoop.crypto.key.kms.KMSClientProvider$KMSTokenRenewer.renew(KMSClientProvider.java:99) | |
at org.apache.hadoop.security.token.Token.renew(Token.java:458) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer$1.run(DelegationTokenRenewer.java:600) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer$1.run(DelegationTokenRenewer.java:597) | |
at java.security.AccessController.doPrivileged(Native Method) | |
at javax.security.auth.Subject.doAs(Subject.java:422) | |
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1997) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer.renewToken(DelegationTokenRenewer.java:596) | |
at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer.handleAppSubmitEvent(DelegationTokenRenewer.java:467) | |
... 6 more | |
2020-01-10 02:27:26,003 [AsyncDispatcher event handler] INFO rmapp.RMAppImpl: Updating application application_1578608896385_0001 with final state: FAILED | |
2020-01-10 02:27:26,008 [AsyncDispatcher event handler] INFO rmapp.RMAppImpl: application_1578608896385_0001 State change from NEW to FINAL_SAVING on event=APP_REJECTED | |
2020-01-10 02:27:26,009 [AsyncDispatcher event handler] INFO recovery.RMStateStore: Updating info for app: application_1578608896385_0001 | |
2020-01-10 02:27:26,021 [AsyncDispatcher event handler] INFO rmapp.RMAppImpl: application_1578608896385_0001 State change from FINAL_SAVING to FAILED on event=APP_UPDATE_SAVED | |
2020-01-10 02:27:26,022 [ResourceManager Event Processor] WARN capacity.CapacityScheduler: Couldn't find application application_1578608896385_0001 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment