Skip to content

Instantly share code, notes, and snippets.

@planetrenox
Created April 22, 2024 20:28
Show Gist options
  • Save planetrenox/6b2b5b267725a4ef24a3a79a8dbea59a to your computer and use it in GitHub Desktop.
Save planetrenox/6b2b5b267725a4ef24a3a79a8dbea59a to your computer and use it in GitHub Desktop.
<|begin_of_text|><|start_header_id|>system<|end_header_id|>

{{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>

{{ user_msg_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{{ model_answer_1 }}<|eot_id|>

in LM Studio this translates to:
System Message Prefix: <|start_header_id|>system<|end_header_id|>\n\n
System Message Suffix: <|eot_id|>
User Message Prefix: <|start_header_id|>user<|end_header_id|>\n\n
[x] Auto add input prefix to stop strings
User Message Suffix: <|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n
Stop Strings: <|start_header_id|> <|eot_id|>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment