Skip to content

Instantly share code, notes, and snippets.

@shizheng-rlfresh

shizheng-rlfresh/custom_pytorch_unsloth_gemma7b_4bit.ipynb

Last active April 15, 2024 15:58
Show Gist options
  • Save shizheng-rlfresh/6d7286db1838ae4f89d8332a442b948b to your computer and use it in GitHub Desktop.
Save shizheng-rlfresh/6d7286db1838ae4f89d8332a442b948b to your computer and use it in GitHub Desktop.
Download ZIP
Custom Pytorch Fine-tune Gemma 7B 4bit model through `Unsloth AI` FastLanguageModel
Display the source blob
Display the rendered blob
Raw
custom_pytorch_unsloth_gemma7b_4bit.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@shizheng-rlfresh
Copy link
Author

This notebook demos how to unbox and SFTtrainer class from HF implementation in trl library.
The current status reveals still 15% more memory consumption on T4.

Thanks @unslothai for providing a newly implemented FastLanguageModel and free notebook template to the community.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment