Skip to content

Instantly share code, notes, and snippets.

View vardaan123's full-sized avatar

Vardaan Pahuja vardaan123

View GitHub Profile
@vardaan123
vardaan123 / gpu_profile.py
Created March 2, 2018 05:30 — forked from MInner/gpu_profile.py
A script to generate per-line GPU memory usage trace. For more meaningful results set `CUDA_LAUNCH_BLOCKING=1`.
import datetime
import linecache
import os
import pynvml3
import torch
print_tensor_sizes = True
last_tensor_sizes = set()
gpu_profile_fn = f'{datetime.datetime.now():%d-%b-%y-%H:%M:%S}-gpu_mem_prof.txt'