Skip to content

Instantly share code, notes, and snippets.

@olafgeibig

olafgeibig/nous-hermes-2-solar.ollama

Created January 3, 2024 09:35
Show Gist options
  • Save olafgeibig/0e8d8e06c40beda16424843e29fecb6a to your computer and use it in GitHub Desktop.
Save olafgeibig/0e8d8e06c40beda16424843e29fecb6a to your computer and use it in GitHub Desktop.
Download ZIP
Ollama modelfile for nous-hermes-2-solar-10.7b
Raw
nous-hermes-2-solar.ollama
FROM ./nous-hermes-2-solar-10.7b.Q5_K_M.gguf
PARAMETER num_ctx 4096
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
PARAMETER stop "Observation:"
@olafgeibig
Copy link
Author

Tweaked for agents with CrewAI. CrewAI stop word added and maxed out the context window.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment