Skip to content

Instantly share code, notes, and snippets.

@mrowrpurr

mrowrpurr/The Answer.md

Created August 11, 2023 06:28
Show Gist options
  • Save mrowrpurr/c43d8494c476f1b7685457891d32ec23 to your computer and use it in GitHub Desktop.
Save mrowrpurr/c43d8494c476f1b7685457891d32ec23 to your computer and use it in GitHub Desktop.
Download ZIP
@mrowrpurr
Copy link
Author 

docker run -p 80:80 -e MODEL=lmsys/vicuna-7b-v1.5 -v /mnt/c/Users/mrowr/model-cache:/models hyperonym/basaran:0.19.0

With GPU (but it's way slower, not enough VRAM?)

docker run -p 80:80 -e MODEL=lmsys/vicuna-7b-v1.5 --gpus all -v /mnt/c/Users/mrowr/model-cache:/models hyperonym/basaran:0.19.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment