Skip to content

Instantly share code, notes, and snippets.

@radi-cho

radi-cho/gmlp_x_proj.py

Created September 10, 2022 20:07
Show Gist options
  • Save radi-cho/02c4372724fc154a51d6e792fae8bcb0 to your computer and use it in GitHub Desktop.
Save radi-cho/02c4372724fc154a51d6e792fae8bcb0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gmlp_x_proj.py
# x_spatial shape: [batch_size, num_patches, embedding_dim].
x_spatial = self.spatial_gating_unit(x_projected)
# x_projected shape: [batch_size, num_patches, embedding_dim].
x_projected = self.channel_projection2(x_spatial)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment