Skip to content

Instantly share code, notes, and snippets.

@iMacUK
Last active January 12, 2023 09:16
Auto tokenizer
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained(”d4data/biomedical-ner-all”)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment