iree-full-benchmark-result-488.md

Full Benchmark Summary

• @ commit b4a466bffd4d0d654c8886eb896b496aea704173 (vs. base 494fa16143c60de167f54b3c63d2ac98675d4d76)
• Pull request
• Buildkite build

Similar Benchmarks

Benchmark Name	Average Latency (ms)	Median Latency (ms)	Latency Standard Deviation (ms)
PoseNet [fp32] (TFLite) full-inference,default-flags with IREE-Dylib-Sync @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	20 (vs. 21, 4.76%↓)	20	0
MobileSSD [fp32] (TFLite) 1-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	42 (vs. 44, 4.55%↓)	42	0
MobileSSD [fp32] (TFLite) full-inference,default-flags with IREE-Dylib-Sync @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	42 (vs. 44, 4.55%↓)	42	0
DeepLabV3 [fp32] (TFLite) full-inference,default-flags with IREE-Dylib-Sync @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	31 (vs. 32, 3.12%↓)	31	0
DeepLabV3 [fp32] (TFLite) 1-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	33 (vs. 34, 2.94%↓)	33	0
MobileBertSquad [fp32] (TFLite) 4-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	73 (vs. 71, 2.82%↑)	73	1
MobileBertSquad [fp32] (TFLite) 1-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	184 (vs. 181, 1.66%↑)	184	0
MobileBertSquad [fp32] (TFLite) full-inference,default-flags with IREE-Dylib-Sync @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	186 (vs. 185, 0.54%↑)	185	2
DeepLabV3 [fp32] (TFLite) 4-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	15 (vs. 15, 0.00%)	15	0
DeepLabV3 [fp32] (TFLite) 8-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	12 (vs. 12, 0.00%)	12	0
MobileBertSquad [fp32] (TFLite) 8-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	53 (vs. 53, 0.00%)	53	0
MobileNetV2 [fp32,imagenet] (TFLite) 1-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	14 (vs. 14, 0.00%)	14	0
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	7 (vs. 7, 0.00%)	7	0
MobileNetV2 [fp32,imagenet] (TFLite) 8-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	6 (vs. 6, 0.00%)	6	0
MobileNetV2 [fp32,imagenet] (TFLite) full-inference,default-flags with IREE-Dylib-Sync @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	14 (vs. 14, 0.00%)	14	0
MobileNetV3Small [fp32,imagenet] (TFLite) 1-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	4 (vs. 4, 0.00%)	4	0
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	3 (vs. 3, 0.00%)	3	0
MobileNetV3Small [fp32,imagenet] (TFLite) 8-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	3 (vs. 3, 0.00%)	3	0
MobileNetV3Small [fp32,imagenet] (TFLite) full-inference,default-flags with IREE-Dylib-Sync @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	4 (vs. 4, 0.00%)	4	0
MobileSSD [fp32] (TFLite) 4-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	17 (vs. 17, 0.00%)	17	0
MobileSSD [fp32] (TFLite) 8-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	13 (vs. 13, 0.00%)	13	0
PoseNet [fp32] (TFLite) 1-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	22 (vs. 22, 0.00%)	22	0
PoseNet [fp32] (TFLite) 4-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	10 (vs. 10, 0.00%)	10	0
PoseNet [fp32] (TFLite) 8-thread,full-inference,default-flags with IREE-Dylib @ GCP-c2-standard-16 (CPU-x86\_64-CascadeLake)	8 (vs. 8, 0.00%)	8	0