cswhjiang

"""Short and sweet LSTM implementation in Tensorflow.

Motivation:
When Tensorflow was released, adding RNNs was a bit of a hack - it required
building separate graphs for every number of timesteps and was a bit obscure
to use. Since then TF devs added things like `dynamic_rnn`, `scan` and `map_fn`.
Currently the APIs are decent, but all the tutorials that I am aware of are not
making the best use of the new APIs.

Advantages of this implementation:

cswhjiang

import numpy
import theano
from theano import tensor as T
from theano.sandbox import rng_mrg


class EquiSGD(object):
    """Equilibrated SGD (eSGD).

    Parameters