Skip to content

Instantly share code, notes, and snippets.

View marksverdhei's full-sized avatar

Markus / Mark marksverdhei

View GitHub Profile
@marksverdhei
marksverdhei / train_t5_define.py
Last active April 5, 2022 00:36
Fine-tune T5 on word definition, using transformers Trainer API
from typing import Any, Dict
import numpy as np
import pandas as pd
from datasets import load_dataset
from torch.utils.data import Dataset
from transformers import (
set_seed,
Seq2SeqTrainer,
Seq2SeqTrainingArguments,