Skip to content

Instantly share code, notes, and snippets.

@pythonlessons
Created September 4, 2023 15:04
Show Gist options
  • Save pythonlessons/bb05269266eccc485ea4d969126d138e to your computer and use it in GitHub Desktop.
Save pythonlessons/bb05269266eccc485ea4d969126d138e to your computer and use it in GitHub Desktop.
transformers_training
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) [(None, 502)] 0 []
input_2 (InputLayer) [(None, 502)] 0 []
encoder (Encoder) (None, 502, 128) 2738688 ['input_1[0][0]']
decoder (Decoder) (None, 502, 128) 4884864 ['input_2[0][0]',
'encoder[0][0]']
dense_16 (Dense) (None, 502, 1055) 136095 ['decoder[0][0]']
==================================================================================================
Total params: 7,759,647
Trainable params: 7,759,647
Non-trainable params: 0
__________________________________________________________________________________________________
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment