Skip to content

Instantly share code, notes, and snippets.

View rycerzes's full-sized avatar
🐈‍⬛
car on the moon

swappy rycerzes

🐈‍⬛
car on the moon
View GitHub Profile
"""
Test script for group offloading with block_level for various models.
Tests both AutoencoderKL (SDXL) and AutoencoderKLWan to verify that
block-level group offloading works correctly with models that have
standalone encoder/decoder layers.
"""
import os
import sys