- Ensure you have at least 64 GB of RAM and 90 GB of free disk space
- Run
docker run -d -v weights:/usr/src/app/weights -v datadb:/data/db/ -p 8008:8008 ghcr.io/nsarrazin/serge:main
- In a browser, open http://localhost:8008/ and press the "Download Models" button
- Scroll down to Guanaco-65B and press "Download"
- When it has finished downloading, start a new chat
There used to be more steps involved, now it's easy!