Skip to content

Instantly share code, notes, and snippets.

@cswhjiang
cswhjiang / tf_lstm.py
Created October 5, 2016 02:35 — forked from siemanko/tf_lstm.py
Simple implementation of LSTM in Tensorflow in 50 lines (+ 130 lines of data generation and comments)
"""Short and sweet LSTM implementation in Tensorflow.
Motivation:
When Tensorflow was released, adding RNNs was a bit of a hack - it required
building separate graphs for every number of timesteps and was a bit obscure
to use. Since then TF devs added things like `dynamic_rnn`, `scan` and `map_fn`.
Currently the APIs are decent, but all the tutorials that I am aware of are not
making the best use of the new APIs.
Advantages of this implementation:
@cswhjiang
cswhjiang / equi.py
Last active August 29, 2015 02:49 — forked from ynd/equi.py
import numpy
import theano
from theano import tensor as T
from theano.sandbox import rng_mrg
class EquiSGD(object):
"""Equilibrated SGD (eSGD).
Parameters