Skip to content

Instantly share code, notes, and snippets.

@gautijha37
gautijha37 / A100 environment details
Last active June 28, 2025 14:48
whisper benchmark latest vllm (0.9.1)
OS [Ubuntu 24.04]
Python version [3.12.3]
torch 2.7.0
Other Python package versions [vLLM (0.9.1), compressed-tensors(0.10.1), numpy(2.2.6)]
Other relevant environment information [CUDA version 12.8]
@gautijha37
gautijha37 / A100 environment details
Last active June 28, 2025 14:47
whisper benchmarks with vllm(0.7.3)
OS [Ubuntu 24.04]
Python version [3.12.3]
torch 2.5.1
Other Python package versions [vLLM (0.7.3), compressed-tensors(0.9.1), numpy(1.26.4)]
Other relevant environment information [CUDA version 12.8]