Skip to content

Instantly share code, notes, and snippets.

@fakerybakery

fakerybakery/Axolotl_Tips.md

Created April 26, 2024 23:08
Show Gist options
  • Save fakerybakery/5f91f6bc4142401d2879732a2563f511 to your computer and use it in GitHub Desktop.
Save fakerybakery/5f91f6bc4142401d2879732a2563f511 to your computer and use it in GitHub Desktop.
Download ZIP
Axolotl tips
Raw
Axolotl_Tips.md

Tips for Axolotl Training

Adding ChatML Tokens

special_tokens:
  bos_token: "<s>"
  eos_token: "</s>"
  unk_token: "<unk>"
tokens:
  - "<|im_start|>"
  - "<|im_end|>"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment