Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
# sample data
text = ["this is a bert model tutorial", "we will fine-tune a bert model"]
# encode text
sent_id = tokenizer.batch_encode_plus(text, padding=True)
# output
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment