Skip to content

Instantly share code, notes, and snippets.

View hephaestus-klytotekhnes's full-sized avatar

Hephaestus Klytotékhnēs Kyllopodíōn hephaestus-klytotekhnes

View GitHub Profile
@hephaestus-klytotekhnes
hephaestus-klytotekhnes / ephemeral_runpod.py
Created December 20, 2024 05:58
Python ContextManager to yield an Ollama client connected to a remote GPU
import os
import sys
import time
import subprocess
import contextlib
import functools
import tqdm
import requests