- Download 7B model alpaca model.
- Download client-side program for Windows, Linux or Mac
- Extract alpaca-win.zip
- Copy the previously downloaded ggml-alpaca-7b-q4.bin file into newly extracted alpaca-win folder
- Open command prompt and run
chat.exe
- Type questions you would want to ask an Alpaca.
Customize: chat --threads 4 --n_predict 512 --ctx_size 2048
Help: for more options. chat --help