Skip to content

Instantly share code, notes, and snippets.

View e-p-armstrong's full-sized avatar
💻
Super hacka-ing

Evan Armstrong e-p-armstrong

💻
Super hacka-ing
View GitHub Profile
@mtisz
mtisz / llama-3-70B-qlora.yaml
Created May 15, 2024 16:47
Axolotl Config for Llama-3-70B QLoRA
base_model: meta-llama/Meta-Llama-3-70B
model_type: LlamaForCausalLM
tokenizer_type: AutoTokenizer
load_in_8bit: false
load_in_4bit: true
strict: false
datasets:
- path: /home/migel/ai_datasets/tess-v1.5b-chatml.jsonl