Skip to content

Instantly share code, notes, and snippets.

@jphme
Created July 24, 2023 23:11
Show Gist options
  • Save jphme/e51fe32d62628c885abba7e7c227ef0f to your computer and use it in GitHub Desktop.
Save jphme/e51fe32d62628c885abba7e7c227ef0f to your computer and use it in GitHub Desktop.
LM Studio Llama 2 Chat Multilingual Configuration
{
"name": "Llama 2 German partial multilang Config",
"inference_params": {
"top_k": 40,
"top_p": 0.95,
"temp": 0.5,
"repeat_penalty": 1.2,
"input_prefix": "[INST]",
"input_suffix": "[/INST]",
"antiprompt": [
"[INST]"
],
"pre_prompt": "[INST]<<SYS>>\\nYou are a helpful, respectful and honest assistant.\n\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information. Please answer in the same language as the user!\\n<</SYS>>\\n\\n[/INST]"
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment