Skip to content

Instantly share code, notes, and snippets.

@LysandreJik

LysandreJik/model_load.py Secret

Last active October 22, 2019 19:28
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save LysandreJik/ced0b008bcefbebcab8a28c99292a1eb to your computer and use it in GitHub Desktop.
Save LysandreJik/ced0b008bcefbebcab8a28c99292a1eb to your computer and use it in GitHub Desktop.
Download ZIP
Loading a model and tokenizer
Raw
model_load.py
from transformers import (TFBertModel, BertTokenizer,
TFGPT2Model, GPT2Tokenizer)
bert_model = TFBertModel.from_pretrained("bert-base-cased") # Automatically loads the config
bert_tokenizer = BertTokenizer.from_pretrained("bert-base-cased")
gpt2_model = TFGPT2Model.from_pretrained("gpt2") # Automatically loads the config
gpt2_tokenizer = GPT2Tokenizer.from_pretrained("gpt2")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment