Skip to content

Instantly share code, notes, and snippets.

@maldevide

maldevide/llm_layer_compare.ipynb

Created May 8, 2024 21:02
Show Gist options
  • Save maldevide/b4f588c07ea046a7f7252f45a0fd7ee1 to your computer and use it in GitHub Desktop.
Save maldevide/b4f588c07ea046a7f7252f45a0fd7ee1 to your computer and use it in GitHub Desktop.
Download ZIP
A comparison of the delta tensors in the first two layers of llama3 finetunes.
Display the source blob
Display the rendered blob
Raw
llm_layer_compare.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment