Skip to content

Instantly share code, notes, and snippets.

@sutyum
Created January 21, 2024 08:37
Show Gist options
  • Save sutyum/1cc97834689eab516709541e036c6d1f to your computer and use it in GitHub Desktop.
Save sutyum/1cc97834689eab516709541e036c6d1f to your computer and use it in GitHub Desktop.
models:
- model: NousResearch/Nous-Hermes-Llama2-13b
# no parameters necessary for base model
- model: starmpcc/Asclepius-Llama2-13B
parameters:
weight: 0.08
density: 0.45
- model: axiong/PMC_LLaMA_13B
parameters:
weight: 0.08
density: 0.45
- model: microsoft/Orca-2-13b
parameters:
weight: 0.08
density: 0.4
- model: nlpie/Llama2-MedTuned-13b
parameters:
weight: 0.08
density: 0.4
- model: kaist-ai/prometheus-13b-v1.0
parameters:
weight: 0.08
density: 0.4
merge_method: dare_ties
base_model: NousResearch/Nous-Hermes-Llama2-13b
parameters:
int8_mask: true
dtype: bfloat16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment