Skip to content

Instantly share code, notes, and snippets.

@anpigon
Created June 4, 2024 16:16
Show Gist options
  • Save anpigon/36a010c7b46ad4cc67d55fd15a070121 to your computer and use it in GitHub Desktop.
Save anpigon/36a010c7b46ad4cc67d55fd15a070121 to your computer and use it in GitHub Desktop.
한국어 임베딩 테스트.md
module_name module_params execution_time retrieval_f1 retrieval_recall retrieval_precision is_best
vectordb {'top_k': 3, 'embedding_model': 'bge-m3'} 0.21 0.35 0.7 0.23 True
vectordb {'top_k': 3, 'embedding_model': 'ko-sroberta-multitask'} 0.13 0.14 0.28 0.09 False
vectordb {'top_k': 3, 'embedding_model': 'ko-sbert-nli'} 0.03 0.08 0.16 0.05 False
bm25 {'top_k': 3, 'bm25_tokenizer': 'ko_kiwi'} 1.02 0.13 0.26 0.09 False
vectordb {'top_k': 3, 'embedding_model': 'bge-m3'} 0.21 0.35 0.7 0.23 True
vectordb {'top_k': 3, 'embedding_model': 'ko-sroberta-multitask'} 0.13 0.14 0.28 0.09 False
vectordb {'top_k': 3, 'embedding_model': 'ko-sbert-nli'} 0.03 0.08 0.16 0.05 False
vectordb {'top_k': 3, 'embedding_model': 'kosimcse'} 0.07792572021484374 0.09 0.18 0.06 False
vectordb {'top_k': 3, 'embedding_model': 'bge-m3'} 0.07596821784973144 0.35 0.7 0.23333333333333336 True
vectordb {'top_k': 3, 'embedding_model': 'sroberta'} 0.02324132442474365 0.06 0.12 0.04 False
vectordb {'top_k': 3, 'embedding_model': 'bge-m3'} 0.07925112247467041 0.35 0.7 0.23333333333333336 True
vectordb {'top_k': 3, 'embedding_model': 'kosimcse'} 0.0760897970199585 0.1 0.2 0.06666666666666667 False
vectordb {'top_k': 3, 'embedding_model': 'text-embedding-3-small'} 0.39573723793029786 0.22 0.44 0.14666666666666664 False
vectordb {'top_k': 3, 'embedding_model': 'bge-m3'} 0.05466378688812256 0.35 0.7 0.23333333333333336 True
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment