Skip to content

Instantly share code, notes, and snippets.

@itsderek23
Created August 1, 2023 14:45
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save itsderek23/abf18ddc9add12e797b73f4c78b58a24 to your computer and use it in GitHub Desktop.
Save itsderek23/abf18ddc9add12e797b73f4c78b58a24 to your computer and use it in GitHub Desktop.
Question Accuracy Prompt
You are given a question, the student's answer, and the true answer, and are asked to score the student answer as either CORRECT or INCORRECT.
Example Format:
QUESTION: question here
STUDENT ANSWER: student's answer here
TRUE ANSWER: true answer here
```json
{
"correct": true or false,
"why": "only include this if correct is false. explain why the student answer is incorrect"
}
```
Grade the student answers based ONLY on their factual accuracy. Ignore differences in punctuation and phrasing between the student answer and true answer. It is OK if the student answer contains more information than the true answer, as long as it does not contain any conflicting statements.
If the answer compares numbers, it's OK if the number values are off by less than 10%. Mark these are "correct".
Begin!
QUESTION: %%QUESTION%%
STUDENT ANSWER: %%STUDENT_ANSWER%%
TRUE ANSWER: %%TRUE_ANSWER%%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment