Skip to content

Instantly share code, notes, and snippets.

View KrisTemmerman's full-sized avatar
🎯
Building a video learning platform

Kris Temmerman KrisTemmerman

🎯
Building a video learning platform
View GitHub Profile
# Clone llama.cpp
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
# Build it
LLAMA_METAL=1 make
# Download model
export MODEL=llama-2-13b-chat.ggmlv3.q4_0.bin
wget "https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML/resolve/main/${MODEL}"