Wolfsauge

README-aphrodite-engine.md

Date: 2024-05-04

This gist describes details about the aphrodite-engine dev 50a9176 20240504 RunPod template.

The image underlying the RunPod template is the result of a multi-stage docker build using the following images:

• build image nvidia/cuda:12.2.2-devel-ubuntu22.04
• run time image nvidia/cuda:12.2.2-runtime-ubuntu22.04

Wolfsauge

README-oobabooga.md

Last changed: May 21, 2024

The contents have moved to https://github.com/Wolfsauge/podman_build_otgw/

RunPod

• text-generation-webui RunPod template
• Docker Hub repo with custom RunPod images

Wolfsauge

README-tabbyAPI.md

Last changed: May 20, 2024

The previous contents of this gist have moved to https://github.com/Wolfsauge/podman_build_tabbyapi

tabbyAPI RunPod templates:

• tabbyAPI RunPod template for CUDA 12.1, derived from nvidia/cuda:12.1.0-runtime-ubuntu22.04
• tabbyAPI RunPod template for CUDA 12.2, derived from nvidia/cuda:12.2.2-runtime-ubuntu22.04
• tabbyAPI RunPod template for CUDA 12.3, derived from nvidia/cuda:12.3.2-runtime-ubuntu22.04