Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save iree-github-actions-bot/63095b0fb70a2f70e2c249d82b8a1113 to your computer and use it in GitHub Desktop.
Save iree-github-actions-bot/63095b0fb70a2f70e2c249d82b8a1113 to your computer and use it in GitHub Desktop.

Full Benchmark Summary

Regressed Benchmarks 🚩

Benchmark Name Average Latency (ms) Median Latency (ms) Latency Standard Deviation (ms)
PoseNet [fp32] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 16 (vs. 15, 6.67%↑) 16 0

Similar Benchmarks

Benchmark Name Average Latency (ms) Median Latency (ms) Latency Standard Deviation (ms)
MobileNetV3Small [fp32,imagenet] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 325 (vs. 301, 7.97%↑) 325 2
MobileNetV3Small [fp32,imagenet] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 326 (vs. 302, 7.95%↑) 326 3
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 37 (vs. 40, 7.50%↓) 38 1
DeepLabV3 [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 204 (vs. 191, 6.81%↑) 212 15
MobileNetV2 [fp32,imagenet] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 754 (vs. 786, 4.07%↓) 745 17
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 324 (vs. 337, 3.86%↓) 329 15
MobileNetV3Small [fp32,imagenet] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 29 (vs. 28, 3.57%↑) 27 6
DeepLabV3 [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 1927 (vs. 1875, 2.77%↑) 1886 100
MobileBertSquad [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 471 (vs. 484, 2.69%↓) 472 6
DeepLabV3 [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 530 (vs. 517, 2.51%↑) 507 78
MobileBertSquad [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 1373 (vs. 1408, 2.49%↓) 1364 44
MobileBertSquad [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 4002 (vs. 4087, 2.08%↓) 4044 74
MobileSSD [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 217 (vs. 213, 1.88%↑) 217 3
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 55 (vs. 54, 1.85%↑) 55 0
MobileSSD [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 2326 (vs. 2369, 1.82%↓) 2300 41
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 56 (vs. 57, 1.75%↓) 56 2
MobileNetV2 [fp32,imagenet] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 59 (vs. 60, 1.67%↓) 59 1
MobileBertSquad [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 4101 (vs. 4035, 1.64%↑) 4099 20
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 315 (vs. 310, 1.61%↑) 314 6
MobileNetV2 [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 62 (vs. 63, 1.59%↓) 62 1
MobileSSD [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 124 (vs. 126, 1.59%↓) 124 3
MobileBertSquad [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 478 (vs. 471, 1.49%↑) 481 9
PoseNet [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 862 (vs. 875, 1.49%↓) 861 15
MobileBertSquad [fp16] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 140 (vs. 138, 1.45%↑) 140 2
MobileNetV3Small [fp32,imagenet] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 210 (vs. 213, 1.41%↓) 211 6
MobileSSD [fp32] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 79 (vs. 80, 1.25%↓) 79 1
PoseNet [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 1032 (vs. 1044, 1.15%↓) 1041 18
PoseNet [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 175 (vs. 177, 1.13%↓) 178 7
MobileBertSquad [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 281 (vs. 284, 1.06%↓) 279 6
MobileNetV2 [fp32,imagenet] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 94 (vs. 95, 1.05%↓) 95 1
MobileNetV2 [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 96 (vs. 97, 1.03%↓) 95 1
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-VMVX @ Pixel-6-Pro (CPU-ARMv8.2-A) 7825 (vs. 7906, 1.02%↓) 7887 258
PoseNet [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 108 (vs. 109, 0.92%↓) 108 0
PoseNet [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 108 (vs. 109, 0.92%↓) 108 0
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 115 (vs. 116, 0.86%↓) 113 4
MobileSSD [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 2376 (vs. 2356, 0.85%↑) 2368 17
MobileSSD [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 119 (vs. 120, 0.83%↓) 119 3
MobileBertSquad [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 635 (vs. 640, 0.78%↓) 635 2
PoseNet [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 262 (vs. 264, 0.76%↓) 261 9
MobileSSD [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 132 (vs. 133, 0.75%↓) 133 2
MobileSSD [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 135 (vs. 136, 0.74%↓) 136 2
MobileBertSquad [fp16] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 139 (vs. 138, 0.72%↑) 139 1
MobileBertSquad [fp32] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 137 (vs. 138, 0.72%↓) 137 1
MobileBertSquad [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 140 (vs. 139, 0.72%↑) 141 2
MobileBertSquad [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 4379 (vs. 4348, 0.71%↑) 4383 13
PoseNet [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 472 (vs. 475, 0.63%↓) 462 38
MobileBertSquad [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 479 (vs. 482, 0.62%↓) 481 8
PoseNet [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 320 (vs. 322, 0.62%↓) 321 4
PoseNet [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 163 (vs. 164, 0.61%↓) 163 0
MobileNetV2 [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 168 (vs. 167, 0.60%↑) 168 0
MobileSSD [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 1684 (vs. 1674, 0.60%↑) 1679 19
MobileBertSquad [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 1397 (vs. 1389, 0.58%↑) 1396 6
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-VMVX @ Pixel-4 (CPU-ARMv8.2-A) 9296 (vs. 9348, 0.56%↓) 9380 261
MobileSSD [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 189 (vs. 188, 0.53%↑) 189 0
MobileNetV2 [fp32,imagenet] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 1128 (vs. 1134, 0.53%↓) 1134 15
MobileSSD [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 2516 (vs. 2503, 0.52%↑) 2514 8
MobileNetV3Small [fp32,imagenet] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 200 (vs. 199, 0.50%↑) 200 1
MobileBertSquad [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 425 (vs. 423, 0.47%↑) 425 1
MobileNetV2 [fp32,imagenet] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 1090 (vs. 1095, 0.46%↓) 1090 2
MobileSSD [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 224 (vs. 223, 0.45%↑) 224 2
MobileSSD [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 222 (vs. 223, 0.45%↓) 222 0
DeepLabV3 [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 4887 (vs. 4908, 0.43%↓) 4884 7
PoseNet [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 1927 (vs. 1935, 0.41%↓) 1926 4
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-VMVX @ Pixel-6-Pro (CPU-ARMv8.2-A) 1717 (vs. 1710, 0.41%↑) 1718 89
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-VMVX @ Pixel-4 (CPU-ARMv8.2-A) 1756 (vs. 1749, 0.40%↑) 1749 30
MobileSSD [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 2522 (vs. 2512, 0.40%↑) 2520 11
MobileNetV2 [fp32,imagenet] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 786 (vs. 783, 0.38%↑) 786 3
MobileBertSquad [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 283 (vs. 284, 0.35%↓) 281 5
MobileBertSquad [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 4039 (vs. 4025, 0.35%↑) 4089 88
PoseNet [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 290 (vs. 289, 0.35%↑) 288 3
MobileBertSquad [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 291 (vs. 292, 0.34%↓) 294 9
PoseNet [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 312 (vs. 313, 0.32%↓) 312 5
MobileSSD [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 673 (vs. 671, 0.30%↑) 673 11
MobileBertSquad [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 4385 (vs. 4397, 0.27%↓) 4386 11
DeepLabV3 [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 4695 (vs. 4707, 0.25%↓) 4693 8
DeepLabV3 [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 6416 (vs. 6432, 0.25%↓) 6418 7
MobileBertSquad [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 4370 (vs. 4380, 0.23%↓) 4369 10
PoseNet [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 4402 (vs. 4412, 0.23%↓) 4403 4
PoseNet [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 483 (vs. 484, 0.21%↓) 483 0
MobileBertSquad [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 504 (vs. 503, 0.20%↑) 504 2
DeepLabV3 [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 524 (vs. 523, 0.19%↑) 524 1
PoseNet [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 593 (vs. 594, 0.17%↓) 592 5
DeepLabV3 [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 640 (vs. 639, 0.16%↑) 640 2
MobileBertSquad [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 642 (vs. 641, 0.16%↑) 642 1
MobileSSD [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 662 (vs. 663, 0.15%↓) 661 4
PoseNet [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 6052 (vs. 6061, 0.15%↓) 6053 7
MobileBertSquad [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 851 (vs. 850, 0.12%↑) 851 1
DeepLabV3 [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 1820 (vs. 1818, 0.11%↑) 1821 10
PoseNet [fp32] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 1818 (vs. 1820, 0.11%↓) 1818 3
DeepLabV3 [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 929 (vs. 928, 0.11%↑) 930 2
DeepLabV3 [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 6067 (vs. 6073, 0.10%↓) 6066 11
PoseNet [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 5668 (vs. 5663, 0.09%↑) 5669 8
PoseNet [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 4532 (vs. 4536, 0.09%↓) 4532 5
MobileNetV2 [fp32,imagenet] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 1160 (vs. 1161, 0.09%↓) 1160 2
MobileNetV2 [fp32,imagenet] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 1164 (vs. 1163, 0.09%↑) 1163 3
DeepLabV3 [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 6080 (vs. 6075, 0.08%↑) 6081 12
DeepLabV3 [fp32] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 6440 (vs. 6445, 0.08%↓) 6438 8
MobileSSD [fp32] (TFLite) little-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 1543 (vs. 1544, 0.06%↓) 1543 2
PoseNet [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 5648 (vs. 5646, 0.04%↑) 5648 7
PoseNet [fp32] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 6056 (vs. 6058, 0.03%↓) 6060 11
MobileNetV2 [fp32,imagenet] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 10 (vs. 10, 0.00%) 10 0
MobileNetV2 [fp32,imagenet] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 10 (vs. 10, 0.00%) 10 0
MobileNetV2 [fp32,imagenet] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 10 (vs. 10, 0.00%) 10 0
PoseNet [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 494 (vs. 494, 0.00%) 494 1
PoseNet [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 16 (vs. 16, 0.00%) 16 0
PoseNet [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 16 (vs. 16, 0.00%) 16 0
MobileBertSquad [fp16] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 139 (vs. 139, 0.00%) 140 2
MobileSSD [fp32] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 47 (vs. 47, 0.00%) 47 0
MobileSSD [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 79 (vs. 79, 0.00%) 79 3
MobileSSD [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 50 (vs. 50, 0.00%) 50 1
MobileSSD [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 50 (vs. 50, 0.00%) 50 0
MobileNetV3Small [fp32,imagenet] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 16 (vs. 16, 0.00%) 16 0
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 21 (vs. 21, 0.00%) 21 0
MobileNetV3Small [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 30 (vs. 30, 0.00%) 30 1
MobileNetV3Small [fp32,imagenet] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 6 (vs. 6, 0.00%) 6 0
MobileNetV3Small [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 16 (vs. 16, 0.00%) 16 0
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 12 (vs. 12, 0.00%) 12 0
MobileNetV3Small [fp32,imagenet] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 11 (vs. 11, 0.00%) 11 0
MobileNetV3Small [fp32,imagenet] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 11 (vs. 11, 0.00%) 11 0
MobileBertSquad [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 295 (vs. 295, 0.00%) 297 9
MobileBertSquad [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 139 (vs. 139, 0.00%) 139 2
DeepLabV3 [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-6-Pro (CPU-ARMv8.2-A) 346 (vs. 346, 0.00%) 347 4
DeepLabV3 [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 288 (vs. 288, 0.00%) 293 9
DeepLabV3 [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 542 (vs. 542, 0.00%) 544 6
DeepLabV3 [fp32] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 13 (vs. 13, 0.00%) 13 0
DeepLabV3 [fp32] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-6-Pro (CPU-ARMv8.2-A) 346 (vs. 346, 0.00%) 348 5
DeepLabV3 [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 15 (vs. 15, 0.00%) 15 0
DeepLabV3 [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 15 (vs. 15, 0.00%) 15 0
MobileNetV2 [fp32,imagenet] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 28 (vs. 28, 0.00%) 28 0
MobileNetV2 [fp32,imagenet] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 107 (vs. 107, 0.00%) 107 0
MobileNetV2 [fp32,imagenet] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 25 (vs. 25, 0.00%) 25 0
MobileNetV2 [fp32,imagenet] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 28 (vs. 28, 0.00%) 28 0
MobileNetV2 [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 92 (vs. 92, 0.00%) 92 0
MobileNetV2 [fp32,imagenet] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 202 (vs. 202, 0.00%) 201 1
MobileNetV2 [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 33 (vs. 33, 0.00%) 32 0
PoseNet [fp32] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 103 (vs. 103, 0.00%) 103 0
MobileSSD [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 86 (vs. 86, 0.00%) 86 0
MobileSSD [fp32] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 356 (vs. 356, 0.00%) 356 1
MobileSSD [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 86 (vs. 86, 0.00%) 86 1
MobileSSD [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 420 (vs. 420, 0.00%) 420 0
MobileSSD [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 70 (vs. 70, 0.00%) 70 2
MobileNetV3Small [fp32,imagenet] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 11 (vs. 11, 0.00%) 11 0
MobileNetV3Small [fp32,imagenet] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 29 (vs. 29, 0.00%) 29 0
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 17 (vs. 17, 0.00%) 16 0
MobileNetV3Small [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 45 (vs. 45, 0.00%) 45 0
MobileNetV3Small [fp32,imagenet] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 8 (vs. 8, 0.00%) 8 0
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 100 (vs. 100, 0.00%) 100 0
MobileNetV3Small [fp32,imagenet] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 11 (vs. 11, 0.00%) 11 0
MobileNetV3Small [fp32,imagenet] (TFLite) 1-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 25 (vs. 25, 0.00%) 25 0
MobileNetV3Small [fp32,imagenet] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 53 (vs. 53, 0.00%) 53 0
MobileNetV3Small [fp32,imagenet] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 10 (vs. 10, 0.00%) 10 0
MobileNetV3Small [fp32,imagenet] (TFLite) little-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 320 (vs. 320, 0.00%) 320 1
MobileNetV3Small [fp32,imagenet] (TFLite) 1-thread,little-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 320 (vs. 320, 0.00%) 320 1
MobileBertSquad [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 424 (vs. 424, 0.00%) 423 1
MobileBertSquad [fp32] (TFLite) big-core,full-inference,experimental-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 636 (vs. 636, 0.00%) 634 2
DeepLabV3 [fp32] (TFLite) full-inference,default-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 140 (vs. 140, 0.00%) 140 0
DeepLabV3 [fp32] (TFLite) 4-thread,big-core,full-inference,default-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 287 (vs. 287, 0.00%) 285 5
DeepLabV3 [fp32] (TFLite) full-inference,experimental-flags with IREE-Vulkan @ Pixel-4 (GPU-Adreno-640) 140 (vs. 140, 0.00%) 140 0
DeepLabV3 [fp32] (TFLite) big-core,full-inference,default-flags with IREE-Dylib-Sync @ Pixel-4 (CPU-ARMv8.2-A) 1104 (vs. 1104, 0.00%) 1104 2
DeepLabV3 [fp32] (TFLite) 4-thread,big-core,full-inference,experimental-flags with IREE-Dylib @ Pixel-4 (CPU-ARMv8.2-A) 163 (vs. 163, 0.00%) 162 3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment