Skip to content

Instantly share code, notes, and snippets.

@kumar-abhishek

kumar-abhishek/latency_for_distilbert_onnx_model.txt

Last active July 12, 2022 00:42
Show Gist options
  • Save kumar-abhishek/e03cde45839172a096269bcaa9ada9df to your computer and use it in GitHub Desktop.
Save kumar-abhishek/e03cde45839172a096269bcaa9ada9df to your computer and use it in GitHub Desktop.
Download ZIP
Raw
latency_for_distilbert_onnx_model.txt
| Label | Num requests | Avg | tp90 (ms) | tp99 | Min | Max | throughput |
|--------------|--------------|-------|-----------|--------|-------|--------|------------|
| HTTP Request | 60 | 77.25 | 96.75 | 110.67 | 68.25 | 126.75 | 12.71 |
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment