Skip to content

Instantly share code, notes, and snippets.

View okplanbo's full-sized avatar
🐢
Reminder: I need to walk more

Boris okplanbo

🐢
Reminder: I need to walk more
View GitHub Profile
@okplanbo
okplanbo / gist:86fa46b4b0fd7b7094ffacc6a3af2005
Last active November 12, 2023 21:06 — forked from mberman84/gist:45545e48040ef6aafb6a1cb3442edb83
LLaMA 2 13b chat fp16 Install Instructions
install miniconda https://docs.conda.io/projects/miniconda/en/latest/
install git https://git-scm.com/downloads
conda create -n textgen python=3.10.9
conda activate textgen
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
git clone https://github.com/oobabooga/text-generation-webui
cd text-generation-webui
pip install -r requirements.txt
python server.py
# download model