Skip to content

Instantly share code, notes, and snippets.

@thomas-byern

thomas-byern/local-llms-hardware.csv Secret

Created February 21, 2026 18:43
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save thomas-byern/c7b66d89a7c02b1bdc0463c825b1b87b to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save thomas-byern/c7b66d89a7c02b1bdc0463c825b1b87b to your computer and use it in GitHub Desktop.
Download ZIP
The local LLMs hardware reality check table
Raw
local-llms-hardware.csv
Hardware Tier Comfortable Model Size Tokens/Second (approx) Interactive Use? Typical Cost (2026)
CPU Only (modern) 7B Q4 5-15 Barely Already owned
8-12GB VRAM 7B-13B Q4 30-50 / 15-25 Yes 300-500 USD
16-24GB VRAM 13B-34B Q4 50+ / 15-30 Yes 800-2000 USD
48GB+ / Multi-GPU 70B+ 20-40+ Yes 2000+ USD
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment