Skip to content

Instantly share code, notes, and snippets.

@shawwn
Created March 5, 2023 18:07
Show Gist options
  • Star 17 You must be signed in to star a gist
  • Fork 7 You must be signed in to fork a gist
  • Save shawwn/bddb2f91aa45fbcdc0dd105d88816e75 to your computer and use it in GitHub Desktop.
Save shawwn/bddb2f91aa45fbcdc0dd105d88816e75 to your computer and use it in GitHub Desktop.
The size of each file distributed with LLaMA, for reference. See https://github.com/shawwn/llama-dl
./tokenizer_checklist.chk 50
./tokenizer.model 499723
./7B/checklist.chk 100
./7B/consolidated.00.pth 13476939516
./7B/params.json 101
./13B/checklist.chk 154
./13B/consolidated.00.pth 13016334699
./13B/consolidated.01.pth 13016334699
./13B/params.json 101
./30B/checklist.chk 262
./30B/consolidated.00.pth 16265763099
./30B/consolidated.01.pth 16265763099
./30B/consolidated.02.pth 16265763099
./30B/consolidated.03.pth 16265763099
./30B/params.json 101
./65B/checklist.chk 478
./65B/consolidated.00.pth 16323959449
./65B/consolidated.01.pth 16323959449
./65B/consolidated.02.pth 16323959449
./65B/consolidated.03.pth 16323959449
./65B/consolidated.04.pth 16323959449
./65B/consolidated.05.pth 16323959449
./65B/consolidated.06.pth 16323959449
./65B/consolidated.07.pth 16323959449
./65B/params.json 101
---
total 235164838073
@GrahamboJangles
Copy link

./tokenizer_checklist.chk: 0.00005 GB
./tokenizer.model: 0.499723 GB
./7B/checklist.chk: 0.0001 GB
./7B/consolidated.00.pth: 13.476939516 GB
./7B/params.json: 0.000101 GB
./13B/checklist.chk: 0.000154 GB
./13B/consolidated.00.pth: 13.016334699 GB
./13B/consolidated.01.pth: 13.016334699 GB
./13B/params.json: 0.000101 GB
./30B/checklist.chk: 0.000262 GB
./30B/consolidated.00.pth: 16.265763099 GB
./30B/consolidated.01.pth: 16.265763099 GB
./30B/consolidated.02.pth: 16.265763099 GB
./30B/consolidated.03.pth: 16.265763099 GB
./30B/params.json: 0.000101 GB
./65B/checklist.chk: 0.000478 GB
./65B/consolidated.00.pth: 16.323959449 GB
./65B/consolidated.01.pth: 16.323959449 GB
./65B/consolidated.02.pth: 16.323959449 GB
./65B/consolidated.03.pth: 16.323959449 GB
./65B/consolidated.04.pth: 16.323959449 GB
./65B/consolidated.05.pth: 16.323959449 GB
./65B/consolidated.06.pth: 16.323959449 GB
./65B/consolidated.07.pth: 16.323959449 GB
./65B/params.json: 0.000101 GB
total: 235.164838073 GB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment