Skip to content

Instantly share code, notes, and snippets.

@askareija

askareija/INSTALL.md

Created April 23, 2024 03:19
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save askareija/c1736f321963553a366447e4fa6e051d to your computer and use it in GitHub Desktop.
Save askareija/c1736f321963553a366447e4fa6e051d to your computer and use it in GitHub Desktop.
Download ZIP
Install Ollama with AMD GPU (On Laptop) Arch Linux
Raw
INSTALL.md
  1. Clone ollama git clone --recursive https://github.com/ollama/ollama.git
  2. go to directory cd ollama
  3. Install dependencies sudo pacman -S rocm-hip-sdk rocm-opencl-sdk clblast go
  4. Build ollama with env AMDGPU_TARGET=gfx1030 ROCM_PATH=/opt/rocm CLBlast_DIR=/usr/lib/cmake/CLBlast go generate -tags rocm ./...
  5. go build -tags rocm
  6. Now to run it HSA_OVERRIDE_GFX_VERSION=10.3.0 ./ollama serve
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment