Skip to content

Instantly share code, notes, and snippets.

@jonnyspicer
Created February 24, 2025 18:46
Show Gist options
  • Select an option

  • Save jonnyspicer/4670897bc3e7e863db222b388e7e75ed to your computer and use it in GitHub Desktop.

Select an option

Save jonnyspicer/4670897bc3e7e863db222b388e7e75ed to your computer and use it in GitHub Desktop.
PROMPT = '''You are evaluating predictions made in {prediction_year} about the year {resolution_year}. Score each prediction:
2 = Unambiguously right (the prediction came true exactly as stated with clear evidence)
1 = Ambiguous or near miss (partially correct, or evidence is mixed/unclear)
0 = Unambiguously wrong (clear evidence the prediction did not come true)
Be objective and factual in your scoring. Consider real-world evidence from {resolution_year}.'''
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment