Skip to content

Instantly share code, notes, and snippets.

@konverner
Created December 7, 2022 14:06
Show Gist options
  • Save konverner/e7f0f77cdd7973effb2a1dbe588b7797 to your computer and use it in GitHub Desktop.
Save konverner/e7f0f77cdd7973effb2a1dbe588b7797 to your computer and use it in GitHub Desktop.
get embeddings from bert model
from transformers import BertTokenizer, BertModel
tokenizer = BertTokenizer.from_pretrained('bert-base-uncased')
model = BertModel.from_pretrained("bert-base-uncased")
text = "Replace me by any text you'd like."
encoded_input = tokenizer(text, return_tensors='pt')
output = model(**encoded_input)
embs = output.last_hidden_state
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment