Skip to content

Instantly share code, notes, and snippets.

@GeorgeDittmar

GeorgeDittmar/load_gpt2_model.py

Last active December 24, 2020 09:23
Show Gist options
  • Save GeorgeDittmar/8a31a774a5fed969ce25cd0ce5349e6e to your computer and use it in GitHub Desktop.
Save GeorgeDittmar/8a31a774a5fed969ce25cd0ce5349e6e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
load_gpt2_model.py
# setup imports to use the model
from transformers import TFGPT2LMHeadModel
from transformers import GPT2Tokenizer
model = TFGPT2LMHeadModel.from_pretrained("<path to model directory>", from_pt=True)
tokenizer = GPT2Tokenizer.from_pretrained("gpt2")
input_ids = tokenizer.encode("Some text to encode", return_tensors='tf')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment