Skip to content

Instantly share code, notes, and snippets.

@adamelliotfields

adamelliotfields/omost.ipynb

Last active July 17, 2024 21:21
Show Gist options
  • Save adamelliotfields/71debe26237ea1ddccd750ab6c8e707f to your computer and use it in GitHub Desktop.
Save adamelliotfields/71debe26237ea1ddccd750ab6c8e707f to your computer and use it in GitHub Desktop.
Download ZIP
Omost Notebook
Display the source blob
Display the rendered blob
Raw
omost.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@adamelliotfields
Copy link
Author

adamelliotfields commented Jul 16, 2024 •
edited
Loading

Made this to make the code easier for me to follow.

Changelog:

  • removed Gradio
  • replaced async streaming response with blocking (use Gradio/Streamlit for chat)
  • removed Phi-3 support (slightly simplified code and Llama-3 works great)
  • converted all floats to 16-bit and removed bfloats (Turing)
  • use sampler and scheduler from k-diffusion
  • added hf_transfer for faster downloads
  • added madebyollin/sdxl-vae-fp16-fix VAE
  • added Juggernaut XL model
  • added Colab forms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment