Skip to content

Instantly share code, notes, and snippets.

@airMeng

airMeng/Sparsity pattern collection.md

Last active December 25, 2023 06:57
Show Gist options
  • Save airMeng/7b1a36cfdeee91b219de4357518d14e4 to your computer and use it in GitHub Desktop.
Save airMeng/7b1a36cfdeee91b219de4357518d14e4 to your computer and use it in GitHub Desktop.
Download ZIP
Sparsity pattern collection.md
Raw
Sparsity pattern collection.md

Currently introduced by different ways, we will enable the following patterns for NLP ToolKits.

The first will be so-called 4x1 pattern, which I have clarified enough in this gist.

The second is for AMX, so called x16 pattern, which is clarified here

The above sparse pattern is accessible based on the current INC pruning

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment