| Framework | Supported Models | GPU Libraries | | TensorFlow Serving | TensorFlow | cuDNN | | OpenVINO Model Server | TensorFlow, Caffe, ONNX, MXNet | clDNN | | Trtion Inference Server | TensorFlow, TensorRT, ONNX, Caffe2, PyTorch | cuDNN |
NVIDIA Triton Inference Server Boosts Deep Learning Inference