Skip to content

Instantly share code, notes, and snippets.

@titu1994
Last active May 10, 2022 22:24
Show Gist options
  • Save titu1994/c096d545a38aa95b40c07b575a5b6336 to your computer and use it in GitHub Desktop.
Save titu1994/c096d545a38aa95b40c07b575a5b6336 to your computer and use it in GitHub Desktop.
Mermaid diagram - Adapters
graph TD
A[Input] --> LN(Layer Norm)
LN --> FF1("Bottleneck FeedForward - (D -> H; D >> H)")
FF1 --> Activation[ReLU]
Activation --> FF2("Expansion FeedForward - (H -> D; D >> H)")
FF2 --> Output[Output]
A --> |Residual| Output
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment