Last active
April 15, 2024 15:58
-
-
Save shizheng-rlfresh/6d7286db1838ae4f89d8332a442b948b to your computer and use it in GitHub Desktop.
Custom Pytorch Fine-tune Gemma 7B 4bit model through `Unsloth AI` FastLanguageModel
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This notebook demos how to unbox and
SFTtrainer
class from HF implementation intrl
library.The current status reveals still 15% more memory consumption on T4.
Thanks @unslothai for providing a newly implemented
FastLanguageModel
and free notebook template to the community.