Skip to content

Instantly share code, notes, and snippets.

View Peilun-Li's full-sized avatar

lplcor Peilun-Li

  • Zillow
  • Seattle, WA
View GitHub Profile
@Peilun-Li
Peilun-Li / geval-logprob.ipynb
Last active March 15, 2024 23:44
LogProb based G-Eval
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Peilun-Li
Peilun-Li / deepeval_bulk_eval.py
Created March 21, 2024 20:57
Deepeval async bulk evaluate
# Note: this is developed and tested against deepeval 0.21.00
import asyncio
from collections.abc import Coroutine
from typing import Any, List
import inspect
import pandas as pd
from deepeval.metrics import BaseMetric
from deepeval.test_case import LLMTestCase