Wilfo Iván wilfoderek
wilfoderek
/ fine-tuning-gpt-2-on-a-custom-dataset.ipynb
Created
December 18, 2022 20:48
— forked from MattPitlyk/fine-tuning-gpt-2-on-a-custom-dataset.ipynb
Fine-Tuning GPT-2 on a Custom Dataset
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
wilfoderek
/ gpt2_lyrics.py
Created
September 6, 2022 19:12
— forked from ConradStack/gpt2_lyrics.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Derived from https://towardsdatascience.com/how-to-fine-tune-gpt-2-for-text-generation-ae2ea53bc272 | |
| import os | |
| import pandas as pd | |
| from transformers import GPT2LMHeadModel, GPT2Tokenizer | |
| import numpy as np | |
| import random | |
| import torch | |
| from torch.utils.data import Dataset, DataLoader |
wilfoderek
/ convert_idmap2_idmap.ipynb
Created
October 30, 2021 14:52
— forked from mdouze/convert_idmap2_idmap.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.