SpinachR

https://blog.csdn.net/lala_01/article/details/52623957?utm_medium=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-3.nonecase&depth_1-utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-3.nonecase
https://zhuanlan.zhihu.com/p/40236865
https://blog.csdn.net/Tomxiaodai/article/details/89920218
Attention is all you need

SpinachR

# https://github.com/RuiShu/acgan-biased/blob/master/codebase/models/extra_layers.py
# weight normalization
@add_arg_scope
def wndense(x,
            num_outputs,
            scope=None,
            activation=None,
            reuse=None,
            scale=False,
            shift=True,