Skip to content

Instantly share code, notes, and snippets.

@thelazt16
thelazt16 / INSTALL.md
Last active May 28, 2024 13:01 — forked from askareija/INSTALL.md
Install Ollama with AMD GPU (On Laptop) Arch Linux
  1. Clone ollama git clone --recursive https://github.com/ollama/ollama.git
  2. go to directory cd ollama
  3. Install dependencies sudo pacman -S rocm-hip-sdk rocm-opencl-sdk clblast go
  4. Build ollama with env AMDGPU_TARGET=gfx1030 ROCM_PATH=/opt/rocm CLBlast_DIR=/usr/lib/cmake/CLBlast go generate -tags rocm ./...
  5. go build -tags rocm
  6. Now to run it HSA_OVERRIDE_GFX_VERSION=10.3.0 ./ollama serve

More info : https://blog.rabu.me/ollama-running-on-an-amd-gpu/

GPU Support : https://github.com/ollama/