Skip to content

Instantly share code, notes, and snippets.

@davidmezzetti

davidmezzetti/txtai-llamacpp.txt

Created July 8, 2024 12:26
Show Gist options
  • Save davidmezzetti/c1ccee0b307fa20b519fc05727014657 to your computer and use it in GitHub Desktop.
Save davidmezzetti/c1ccee0b307fa20b519fc05727014657 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
txtai-llamacpp.txt
# Install txtai with torch cpu
pip install txtai torch==2.3.1+cpu \
-f https://download.pytorch.org/whl/torch_stable.html
# Install llama.cpp
CMAKE_ARGS="-DLLAMA_CUDA=on" pip install llama-cpp-python
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment