ChunML/transformer_32.py

Created April 30, 2019 03:28

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/ChunML/6c33df5d462f226f4f0a3a7ee004867b.js"></script>
Save ChunML/6c33df5d462f226f4f0a3a7ee004867b to your computer and use it in GitHub Desktop.

Download ZIP

Raw

transformer_32.py

look_left_only_mask = tf.linalg.band_part(tf.ones((seq_len, seq_len)), -1, 0)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment