Skip to content

Instantly share code, notes, and snippets.

@Praful932
Last active April 11, 2024 06:06
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Praful932/da4b5504c226ef5d64fa0c55063923ae to your computer and use it in GitHub Desktop.
Save Praful932/da4b5504c226ef5d64fa0c55063923ae to your computer and use it in GitHub Desktop.
Runpod post start setup
# cd into directory after running conda init
cd /workspace
# Define the Personal Access Token and repo name
pat="$GITHUB_PAT"
repo_name="$GITHUB_REPO"
username="praful932"
repo_url="https://github.com/Praful932/${repo_name}.git"
# Construct the authenticated URL by injecting the PAT and username into the repository URL
auth_url=$(echo "$repo_url" | sed "s|https://|https://${username}:${pat}@|")
# Clone the repository into the specified directory
git clone "$auth_url" "/workspace/${repo_name}"
pip install -U transformers==4.38.2 datasets bitsandbytes>=0.39.0 accelerate>=0.20.0 optimum nvidia-ml-py3 evaluate rouge_score langchain sacrebleu scikit-learn>=1.3.0
git config --global user.email praful.mohanan@gmail.com
git config --global user.name praful932
# wget https://github.com/turboderp/exllamav2/releases/download/v0.0.14/exllamav2-0.0.14+cu121-cp310-cp310-linux_x86_64.whl
# pip install -q exllamav2-0.0.14+cu121-cp310-cp310-linux_x86_64.whl
pip install autoawq==0.2.4 autoawq_kernels==0.0.6
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment