Skip to content

Instantly share code, notes, and snippets.

@bigsnarfdude

bigsnarfdude/finetune.md

Last active February 21, 2024 17:25
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save bigsnarfdude/50319bbab6c19fced1584f06d0d3e63f to your computer and use it in GitHub Desktop.
Save bigsnarfdude/50319bbab6c19fced1584f06d0d3e63f to your computer and use it in GitHub Desktop.
Download ZIP
vram requirements fine tunes
Raw
finetune.md 
Hardware Requirements


Method	Bits	7B	13B	30B	65B	8x7B
Full	16	160GB	320GB	600GB	1200GB	1000GB
Freeze	16	20GB	40GB	120GB	240GB	200GB
LoRA	16	16GB	32GB	80GB	160GB	120GB
QLoRA	8	10GB	16GB	40GB	80GB	80GB
QLoRA	4	6GB	12GB	24GB	48GB	32GB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment