Skip to content

Instantly share code, notes, and snippets.

@sroecker
Created April 2, 2024 14:57
Show Gist options
  • Save sroecker/480e1b361e79db2408932fb0a57e174b to your computer and use it in GitHub Desktop.
Save sroecker/480e1b361e79db2408932fb0a57e174b to your computer and use it in GitHub Desktop.
Run Axolotl fine-tuning with Podman
podman run --rm --device nvidia.com/gpu=all --security-opt=label=disable --mount type=bind,src="${PWD}",target=/workspace/axol
otl -v ${HOME}/.cache/huggingface:/root/.cache/huggingface winglian/axolotl:main-py3.10-cu118-2.0.1 accelerate launch -m axolotl.cli.train examples/openllam
a-3b/lora.yml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment