Skip to content

Instantly share code, notes, and snippets.

@lapp0
lapp0 / calc_vram.py
Last active November 26, 2023 19:51
LLM Memory Requirement Calculator Script (Full Finetune and Inference)
View calc_vram.py
import urllib.request
import json
def bits_to_gb(bits):
return bits / (8 * 1024**3)
def calculate_train_vram_requirements(
batch_size, seq_len, params, precision, num_layers, num_attn_heads, hidden_size, **ignored
View libfreenect2 and freenect2-python
libfreenect2 = with pkgs; stdenv.mkDerivation rec {
pname = "freenect2";
version = "0.2.1";
src = fetchFromGitHub {
owner = "OpenKinect";
repo = "libfreenect2";
rev = "v${version}";
sha256 = "sha256-v+NQiR9LTQOwr1kgVpGmFSSemiPw4rmdQE/B6ycoLpU=";
};