!pip install git+https://github.com/huggingface/transformers.git -q -U # transformers version: 4.37.0
!pip install git+https://github.com/huggingface/accelerate.git -q -U # accelerate version: 0.27.0
!pip install bitsandbytes # bitsandbytes version: 0.42.0
!pip install git+https://github.com/huggingface/peft.git -q -U # peft version: 0.7.2
Last active
January 24, 2024 05:45
-
-
Save SharathHebbar/91c2d4aeaee05672c7163a59691a16d6 to your computer and use it in GitHub Desktop.
Pushing 4bit quantized model
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment