Skip to content

Instantly share code, notes, and snippets.

@ZiTAL
Last active May 5, 2023 08:06
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ZiTAL/f310bb65d965cd74cc74a071a5ccc8d2 to your computer and use it in GitHub Desktop.
Save ZiTAL/f310bb65d965cd74cc74a071a5ccc8d2 to your computer and use it in GitHub Desktop.
local-chat-gpt
su
chown -R pi:pi /opt
exit
cd /opt
curl -L -O "https://github.com/conda-forge/miniforge/releases/latest/download/Mambaforge-$(uname)-$(uname -m).sh"
bash Mambaforge-Linux-aarch64.sh
# /opt/mambaforge
su
ln -s /opt/mambaforge/bin/conda /usr/local/bin/conda
ln -s /opt/mambaforge/bin/compile_et /usr/local/bin/compile_et
ln -s /opt/mambaforge/bin/conda2solv /usr/local/bin/conda2solv
ln -s /opt/mambaforge/bin/conda-env /usr/local/bin/conda-env
exit
source /opt/mambaforge/etc/profile.d/conda.sh
conda create -y -k --prefix /opt/oobabooga_linux/installer_files/env
cd /opt/oobabooga_linux
wget https://github.com/oobabooga/text-generation-webui/releases/download/installers/oobabooga_linux.zip
unzip oobabooga_linux.zip
rm oobabooga_linux.zip
cd /opt/oobabooga_linux/text-generation-webui
su
apt-get install gcc python3-dev python3-pip
pip3 install -r requirements.txt
exit
cd /opt/oobabooga_linux/text-generation-webui/models
git clone https://huggingface.co/eachadea/ggml-vicuna-13b-1.1
cd /opt/oobabooga_linux/text-generation-webui/
python3 server.py --chat
@ZiTAL
Copy link
Author

ZiTAL commented May 5, 2023

Akatsa ematen du :(
INFO:Gradio HTTP request redirected to localhost :) Illegal instruction

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment