Skip to content

Instantly share code, notes, and snippets.

@alexweberk

alexweberk/mlx_finetuning_gemma.ipynb

Last active April 13, 2024 12:48
Show Gist options
  • Star 25 You must be signed in to star a gist
  • Fork 5 You must be signed in to fork a gist
  • Save alexweberk/635431b5c5773efd6d1755801020429f to your computer and use it in GitHub Desktop.
Save alexweberk/635431b5c5773efd6d1755801020429f to your computer and use it in GitHub Desktop.
Download ZIP
MLX Fine-tuning Google Gemma
Display the source blob
Display the rendered blob
Raw
mlx_finetuning_gemma.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@johngroves
Copy link

johngroves commented Mar 6, 2024 •
edited

This was super helpful!

One change might be needed:

!python -m mlx_lm.generate --model "google/gemma-7b-it"
--adapter-file checkpoints/600_adapters.npz
--max-tokens 256
--prompt "Why is the sky blue?"
--seed 69

@alexweberk
Copy link
Author

@johngroves glad to hear!
You're right, thanks for pointing that out. Just updated that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment