Skip to content

Instantly share code, notes, and snippets.

@oborchers
Created April 3, 2021 11:58
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save oborchers/6cb8eec1130010e16650e029cd940877 to your computer and use it in GitHub Desktop.
Save oborchers/6cb8eec1130010e16650e029cd940877 to your computer and use it in GitHub Desktop.
# Script to export a transformers model
model_name = "sentence-transformers/bert-base-nli-stsb-mean-tokens"
pipeline_name = "feature-extraction"
model_pth = Path(f"encoder/{model_name}.onnx")
nlp = transformers.pipeline(pipeline_name, model=model_name, tokenizer=model_name, device=0)
tokenizer = nlp.tokenizer
if model_pth.exists():
model_pth.unlink()
convert_graph_to_onnx.convert(
framework="pt",
model=model_name,
output=model_pth,
opset=12,
tokenizer=model_name,
use_external_format= False,
pipeline_name= pipeline_name,
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment