Hassan Shavarani shavarani
shavarani
/ LUKE-CoNLL2003-Original-Code.py
Created
January 13, 2025 05:58
LUKE CoNLL 2003 Original Code
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Evaluation script to evaluate the performance of the fine-tuned Luke model on the CoNLL-2003 dataset. | |
| """ | |
| import unicodedata | |
| import torch | |
| import conlleval | |
| import logging | |
| from transformers import AutoTokenizer, LukeForEntitySpanClassification | |
| from tqdm import tqdm |
shavarani
/ conll2003_luke_evaluation.py
Last active
January 13, 2025 05:59
CoNLL 2003 LUKE Evaluation (Replicated)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Evaluation script to evaluate the performance of the fine-tuned Luke model on the CoNLL-2003 dataset. | |
| """ | |
| import torch | |
| import string | |
| import conlleval | |
| import logging | |
| from transformers import AutoTokenizer, LukeForEntitySpanClassification | |
| from datasets import load_dataset | |
| from tqdm import tqdm |