- How to log into slaves
One can log into the slave nodes using Agent Forwarding by SSH. Suppose that I find in the YARN log
java.nio.channels.CancelledKeyException
14/09/25 23:12:58 ERROR SendingConnection: Exception while reading SendingConnection to ConnectionManagerId(ip-172-31-xx-xx.ec2.internal,49972)
java.io.IOException: Connection reset by peer
...
I would like to SSH to the slave ip-172-31-xx-xx.ec2.internal
to check the logs. To do so, firstly we have to add EMR identity to the agent