Skip to content

Instantly share code, notes, and snippets.

@prakhar21

prakhar21/train_gpt-neo.py

Created May 9, 2021 08:22
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save prakhar21/c5fc81970915f2987ef4b19d0f7255c9 to your computer and use it in GitHub Desktop.
Save prakhar21/c5fc81970915f2987ef4b19d0f7255c9 to your computer and use it in GitHub Desktop.
Download ZIP
gptneo train
Raw
train_gpt-neo.py
from happytransformer import HappyGeneration, GENTrainArgs
gpt_neo = HappyGeneration("GPT-Neo", "EleutherAI/gpt-neo-125M")
train_args = GENTrainArgs(num_train_epochs=1, learning_rate=2e-05, batch_size=2)
gpt_neo.train("train.txt", args=train_args)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment