Skip to content

Instantly share code, notes, and snippets.

@joshreini1

joshreini1/run_evals_with_claude.py

Created November 2, 2023 13:14
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save joshreini1/ba7fba7ebe01c02dc2b83683b0fd9ee3 to your computer and use it in GitHub Desktop.
Save joshreini1/ba7fba7ebe01c02dc2b83683b0fd9ee3 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
run_evals_with_claude.py
claude_2 = LiteLLM(model_engine="claude-2")
context_relevance = (
Feedback(claude_2.qs_relevance_with_cot_reasons,name = "Context Relevance")
.on_input()
.on(TruLlama.select_source_nodes().node.text)
.aggregate(np.mean)
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment