RNN Neural Math Operations Circuit Flow

front.md

Neural RNN math operations flow for RNN, LSTM and GRU

Useful for calc gradients in backpropagation step.

Ref.:

http://cs231n.github.io/optimization-2/

https://wiseodd.github.io/techblog/2016/08/12/lstm-backprop/

http://arunmallya.github.io/writeups/nn/lstm/index.html#/7

http://cs231n.stanford.edu/vecDerivs.pdf

GRU.pdf

LSTM.pdf

RNN.pdf