Skip to content

Instantly share code, notes, and snippets.

@monk1337
Created February 21, 2024 14:05
Show Gist options
  • Star 2 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save monk1337/0109d36c43cdde7ed2c687e06e7177a4 to your computer and use it in GitHub Desktop.
Save monk1337/0109d36c43cdde7ed2c687e06e7177a4 to your computer and use it in GitHub Desktop.
{
"Dataset": [
"multimedqa",
"medmcqa",
"medqa_4options",
"mmlu_anatomy",
"mmlu_clinical_knowledge",
"mmlu_college_biology",
"mmlu_college_medicine",
"mmlu_medical_genetics",
"mmlu_professional_medicine",
"pubmedqa"
],
"Mistral-7B-v0.1": [
0.533002,
0.481951,
0.508248,
0.555556,
0.686792,
0.680556,
0.595376,
0.71,
0.683824,
0.754
],
"Gemma": [
0.254791,
0.217547,
0.254517,
0.244444,
0.264151,
0.263889,
0.346821,
0.24,
0.220588,
0.552
]
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment