Skip to content

Instantly share code, notes, and snippets.

View ludflu's full-sized avatar
🎯
Focusing

Jim Snavely ludflu

🎯
Focusing
View GitHub Profile
@ludflu
ludflu / audio_lstm_keras.ipynb
Created September 22, 2017 17:04 — forked from naotokui/audio_lstm_keras.ipynb
Audio generation with LSTM in keras
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ludflu
ludflu / SparkProfileEMR.md
Last active March 26, 2016 00:37 — forked from jiayuzhou/SparkProfileEMR.md
Spark Memory Profile in Amazon EMR
  1. How to log into slaves

One can log into the slave nodes using Agent Forwarding by SSH. Suppose that I find in the YARN log

java.nio.channels.CancelledKeyException
14/09/25 23:12:58 ERROR SendingConnection: Exception while reading SendingConnection to ConnectionManagerId(ip-172-31-xx-xx.ec2.internal,49972)
java.io.IOException: Connection reset by peer
...

I would like to SSH to the slave ip-172-31-xx-xx.ec2.internal to check the logs. To do so, firstly we have to add EMR identity to the agent