| Metrics | Details | Reference |
|---|---|---|
| Faithfulness | Measures the factual consistency of the generated answer against the given context. | Link |
| Response Relevancy | Measures how relevant a response is to the user input. | Link |
| Context precision | Evaluates whether all the ground truth–relevant items present in the contexts are ranked higher or not. | Link |
| Context relevancy | Measures the relevancy of the retrieved context, calculated based on both the question and contexts. | Link |
| Context Recall | Measures the extent to which the retrieved context aligns with the annotated answer, treated as the ground truth. | Link |
| Answer correctness | Gauges the accuracy of the generated answer when compared to the ground truth. | Link |
-
-
Save hshujuan/c7cad2ac3c4d67f9786d1736564ce183 to your computer and use it in GitHub Desktop.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment