Skip to content

Instantly share code, notes, and snippets.

@noproto

noproto/guide.md

Last active May 26, 2023 04:34
Show Gist options
  • Save noproto/e3a3b5c4da36d9721d67f88713a6b9f2 to your computer and use it in GitHub Desktop.
Save noproto/e3a3b5c4da36d9721d67f88713a6b9f2 to your computer and use it in GitHub Desktop.
Download ZIP
Serge+Guanaco 65B setup guide (local ChatGPT)
Raw
guide.md

Serge+Guanaco 65B setup guide (local ChatGPT)

  1. Ensure you have at least 64 GB of RAM and 90 GB of free disk space
  2. Run docker run -d -v weights:/usr/src/app/weights -v datadb:/data/db/ -p 8008:8008 ghcr.io/nsarrazin/serge:main
  3. In a browser, open http://localhost:8008/ and press the "Download Models" button
  4. Scroll down to Guanaco-65B and press "Download"
  5. When it has finished downloading, start a new chat

There used to be more steps involved, now it's easy!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment