Skip to content

Instantly share code, notes, and snippets.

View TerryBrand231's full-sized avatar
🌴
On vacation

Terry TerryBrand231

🌴
On vacation
View GitHub Profile
@TerryBrand231
TerryBrand231 / mteb_eval.py
Created October 10, 2024 06:04
Modified MTEB eval script
# Source: https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct/blob/main/scripts/eval_mteb.py
import argparse
import logging
import math
import queue
from typing import Dict, List, Optional, Union
from tqdm.autonotebook import trange
import numpy as np
import torch