tokestermw

"""Example TensorFlow code for Self-Attention mechanism.

Refs:
    Attention Is All You Need
    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
    https://arxiv.org/abs/1706.03762

    Transformer: A Novel Neural Network Architecture for Language Understanding
    https://research.googleblog.com/2017/08/transformer-novel-neural-network.html