Skip to content

Instantly share code, notes, and snippets.

View p15r's full-sized avatar
🏗️

patrick p15r

🏗️
View GitHub Profile

vLLM Installation

Installation of vLLM v0.8.2 using Pytorch v2.6.0 (CPU!) and CPython 3.12 using a Nix developer shell:

  • Activate developer shell: nix develop (see flake.nix below)
  • Build vLLM
    • Switch to tmp dir: cd /tmp/
    • Create venv: python -m venv vllm
      • ensure it uses the python binary from the developer shell
  • Activate venv: source /tmp/vllm/bin/activate
@p15r
p15r / keybase.md
Last active September 18, 2025 11:36

Keybase proof

I hereby claim:

  • I am p15r on github.
  • I am p15r (https://keybase.io/p15r) on keybase.
  • I have a public key ASApiNT8h96HebuIMF6O90QGJ0_F8sn2FvWtqt4t7ANvnwo

To claim this, I am signing this object: