Skip to content

Instantly share code, notes, and snippets.

@zachrattner

zachrattner/m4-macbook-air.csv Secret

Created January 26, 2026 20:15
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save zachrattner/52a6b56d70ed024b18c992ef14b89656 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save zachrattner/52a6b56d70ed024b18c992ef14b89656 to your computer and use it in GitHub Desktop.
Download ZIP
m4-macbook-air.csv
Raw
m4-macbook-air.csv
model stage tps variance
gemma-3-12b-it-f16.gguf - - -
gemma-3-12b-it-f16.gguf - - -
gemma-3-12b-it-Q4_K_M.gguf pp512 126.46 0.54
gemma-3-12b-it-Q4_K_M.gguf tg128 12.98 0.01
gemma-3-12b-it-Q8_0.gguf pp512 120.45 1.69
gemma-3-12b-it-Q8_0.gguf tg128 8.24 0.03
gemma-3-12b-it-qat-Q4_0.gguf pp512 122.47 1.21
gemma-3-12b-it-qat-Q4_0.gguf tg128 12.92 0.11
gemma-3-1b-it-f16.gguf - - -
gemma-3-1b-it-f16.gguf - - -
gemma-3-1b-it-Q4_K_M.gguf pp512 1551.33 37.92
gemma-3-1b-it-Q4_K_M.gguf tg128 81.17 5.34
gemma-3-1b-it-Q8_0.gguf pp512 1683.50 96.31
gemma-3-1b-it-Q8_0.gguf tg128 66.55 4.78
gemma-3-1b-it-qat-Q4_0.gguf pp512 1723.42 131.64
gemma-3-1b-it-qat-Q4_0.gguf tg128 93.65 8.27
gemma-3-270m-it-Q8_0.gguf pp512 8802.15 136.55
gemma-3-270m-it-Q8_0.gguf tg128 171.85 16.99
gemma-3-270m-it-qat-Q4_0.gguf pp512 8752.72 105.64
gemma-3-270m-it-qat-Q4_0.gguf tg128 190.28 7.39
gemma-3-27b-it-f16-00001-of-00002.gguf - - -
gemma-3-27b-it-f16-00001-of-00002.gguf - - -
gemma-3-27b-it-qat-Q4_0.gguf pp512 47.51 0.39
gemma-3-27b-it-qat-Q4_0.gguf tg128 5.72 0.03
gemma-3-4b-it-f16.gguf - - -
gemma-3-4b-it-f16.gguf - - -
gemma-3-4b-it-Q4_K_M.gguf pp512 333.15 10.05
gemma-3-4b-it-Q4_K_M.gguf tg128 30.05 0.80
gemma-3-4b-it-Q8_0.gguf pp512 333.61 13.09
gemma-3-4b-it-Q8_0.gguf tg128 20.08 0.52
gemma-3-4b-it-qat-Q4_0.gguf pp512 343.54 6.01
gemma-3-4b-it-qat-Q4_0.gguf tg128 31.75 0.83
gpt-oss-120b-mxfp4-00001-of-00003.gguf - - -
gpt-oss-120b-mxfp4-00001-of-00003.gguf - - -
gpt-oss-20b-mxfp4.gguf pp512 307.96 26.68
gpt-oss-20b-mxfp4.gguf tg128 26.63 0.60
Nemotron-Nano-3-30B-A3B-Q4_K_M.gguf - - -
Nemotron-Nano-3-30B-A3B-Q4_K_M.gguf - - -
Nemotron-Nano-3-30B-A3B-Q8_0.gguf - - -
Nemotron-Nano-3-30B-A3B-Q8_0.gguf - - -
Nemotron-Nano-3-30B-A3B.gguf - - -
Nemotron-Nano-3-30B-A3B.gguf - - -
Qwen3-0.6B-f16.gguf - - -
Qwen3-0.6B-f16.gguf - - -
Qwen3-0.6B-Q4_0.gguf pp512 1826.05 133.43
Qwen3-0.6B-Q4_0.gguf tg128 147.52 16.25
Qwen3-0.6B-Q8_0.gguf pp512 1763.55 128.64
Qwen3-0.6B-Q8_0.gguf tg128 85.95 9.51
Qwen3-1.7B-f16.gguf - - -
Qwen3-1.7B-f16.gguf - - -
Qwen3-1.7B-Q4_K_M.gguf pp512 696.99 9.23
Qwen3-1.7B-Q4_K_M.gguf tg128 61.54 5.84
Qwen3-1.7B-Q8_0.gguf pp512 728.61 9.67
Qwen3-1.7B-Q8_0.gguf tg128 41.95 2.26
Qwen3-14B-f16.gguf - - -
Qwen3-14B-f16.gguf - - -
Qwen3-14B-Q8_0.gguf pp512 80.08 0.68
Qwen3-14B-Q8_0.gguf tg128 6.27 0.05
Qwen3-32B-f16-00001-of-00002.gguf - - -
Qwen3-32B-f16-00001-of-00002.gguf - - -
Qwen3-32B-Q4_K_M.gguf - - -
Qwen3-32B-Q4_K_M.gguf - - -
Qwen3-32B-Q8_0.gguf - - -
Qwen3-32B-Q8_0.gguf - - -
Qwen3-4B-f16.gguf - - -
Qwen3-4B-f16.gguf - - -
Qwen3-4B-Q4_K_M.gguf pp512 272.29 3.24
Qwen3-4B-Q4_K_M.gguf tg128 27.78 0.69
Qwen3-4B-Q8_0.gguf pp512 273.32 7.68
Qwen3-4B-Q8_0.gguf tg128 19.33 0.18
Qwen3-8B-f16.gguf - - -
Qwen3-8B-f16.gguf - - -
Qwen3-8B-Q4_K_M.gguf pp512 144.20 3.11
Qwen3-8B-Q4_K_M.gguf tg128 16.19 0.41
Qwen3-8B-Q8_0.gguf pp512 153.83 0.71
Qwen3-8B-Q8_0.gguf tg128 11.37 0.10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment