Unlocking Real-time Predictions with Shopify's Machine Learning Platform: Settings example for loading a model using the HuggingFace Inference Runtime

model-settings.json

{
   "name": "transformer",
   "implementation": "mlserver_huggingface.HuggingFaceRuntime",
   "parallel_workers": 0,
   "parameters": {
       "extra": {
           "task": "text-generation",
           "pretrained_model": "distilgpt2"
       }
   }
}