Skip to content

Instantly share code, notes, and snippets.

@burtenshaw
Created March 6, 2024 12:13
Show Gist options
  • Save burtenshaw/f142c5e52187fe50ab8df9be0687944c to your computer and use it in GitHub Desktop.
Save burtenshaw/f142c5e52187fe50ab8df9be0687944c to your computer and use it in GitHub Desktop.

opt-350m - Lighteval

Elapsed time: 00:05:27

Task Version Metric Value Stderr
lighteval|truthfulqa:mc|0 0 truthfulqa_mc1 0.2326 ± 0.0148
truthfulqa_mc2 0.4082 ± 0.0147

Elapsed time: 00:05:27

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment