Skip to content

Instantly share code, notes, and snippets.

@pzread
Created January 6, 2023 23:43
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save pzread/264deb4157b51e266a2455bf2fbcd229 to your computer and use it in GitHub Desktop.
Save pzread/264deb4157b51e266a2455bf2fbcd229 to your computer and use it in GitHub Desktop.

Full Benchmark Summary

All Compilation Metrics

Benchmark Name Compilation Time (ms) Total Dispatch Size (bytes) Total Artifact Size (bytes)
DeepLabV3_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 24905 143560 2924723
MobileSSD_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 50592 259128 18199603
PoseNet_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 21473 82088 5135281
MobileBertSquad_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 90355 80200 98483193
MobileBertSquad_int8 [int8] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 221119 5812680 31017273
MobileBertSquad_fp16 [fp16] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 91241 77224 99931897
MobileNetV1_fp32 [fp32,imagenet] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 31479 85064 17001533
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 34745 146488 14130043
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 47057 205176 10426618
PersonDetect_int8 [int8] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 22912 90008 337654
EfficientNet_int8 [int8] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 44182 197208 5047606
MiniLML12H384Uncased [int32,seqlen128] (exported_tf) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 18373 67864 133572805
BertForMaskedLMTF [fp32,seqlen512,tensorflow] (exported_tf) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 15598 65560 438236101
EfficientNetV2STF [fp32,cnn,tensorflow] (exported_tf) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 46432 234616 86837125
Resnet50TF [fp32] (exported_tf) [cpu-x86_64-cascadelake-linux-gnu] default-flags,compile-stats 23300 141272 102625093
DeepLabV3_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 28013 152552 2928883
MobileSSD_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 55291 282856 18218035
PoseNet_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 16597 87208 5136049
MobileBertSquad_fp32 [fp32] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 93115 80200 98483193
MobileBertSquad_int8 [int8] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 217461 5812680 31017273
MobileBertSquad_fp16 [fp16] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 101264 77224 99931897
MobileNetV1_fp32 [fp32,imagenet] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 33144 105112 17018749
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 33378 169496 14148347
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 49556 237032 10456954
PersonDetect_int8 [int8] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 22219 90008 337654
EfficientNet_int8 [int8] (exported_tflite) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 44921 203752 5054070
MiniLML12H384Uncased [int32,seqlen128] (exported_tf) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 20065 67864 133572805
BertForMaskedLMTF [fp32,seqlen512,tensorflow] (exported_tf) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 18660 65560 438236101
EfficientNetV2STF [fp32,cnn,tensorflow] (exported_tf) [cpu-x86_64-cascadelake-linux-gnu] experimental-flags,fuse-padding,compile-stats 54374 542120 87136453
MiniLML12H384Uncased [int32,seqlen128] (exported_tf) [gpu-cuda-sm_80-linux-gnu] default-flags,compile-stats 13514 129656 133643369
BertForMaskedLMTF [fp32,seqlen512,tensorflow] (exported_tf) [gpu-cuda-sm_80-linux-gnu] default-flags,compile-stats 14586 173292 438350719
EfficientNetV2STF [fp32,cnn,tensorflow] (exported_tf) [gpu-cuda-sm_80-linux-gnu] default-flags,compile-stats 42400 788828 87431550
Resnet50TF [fp32] (exported_tf) [gpu-cuda-sm_80-linux-gnu] default-flags,compile-stats 18542 356252 102857621
DeepLabV3_fp32 [fp32] (exported_tflite) [cpu-riscv_64-generic-linux-gnu] default-flags,compile-stats 20289 47176 2828405
MobileBertSquad_fp32 [fp32] (exported_tflite) [cpu-riscv_64-generic-linux-gnu] default-flags,compile-stats 88310 22240 98425211
MobileNetV1_fp32 [fp32,imagenet] (exported_tflite) [cpu-riscv_64-generic-linux-gnu] default-flags,compile-stats 26268 36992 16953407
MobileBertSquad_int8 [int8] (exported_tflite) [cpu-riscv_64-generic-linux-gnu] default-flags,compile-stats 148214 1901952 27106555
PersonDetect_int8 [int8] (exported_tflite) [cpu-riscv_64-generic-linux-gnu] default-flags,compile-stats 21115 64504 312184
EfficientNet_int8 [int8] (exported_tflite) [cpu-riscv_64-generic-linux-gnu] default-flags,compile-stats 41321 143568 4994040
PersonDetect_int8 [int8] (exported_tflite) [cpu-riscv_32-generic-linux-gnu] default-flags,compile-stats 47185 880588 1128248
EfficientNet_int8 [int8] (exported_tflite) [cpu-riscv_32-generic-linux-gnu] default-flags,compile-stats 109071 2498416 7348920
DeepLabV3_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] default-flags,compile-stats 30648 96136 2877299
MobileSSD_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] default-flags,compile-stats 82056 286856 18227315
PoseNet_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] default-flags,compile-stats 20054 33880 5087089
MobileBertSquad_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] default-flags,compile-stats 96395 110984 98513977
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] default-flags,compile-stats 42554 98696 14082299
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] default-flags,compile-stats 45249 87336 10308794
MobileBertSquad_int8 [int8] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] default-flags,compile-stats 165851 1901912 27106489
DeepLabV3_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] experimental-flags,mmt4d,compile-stats 43115 87808 2886515
MobileSSD_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] experimental-flags,mmt4d,compile-stats 74306 177600 18138611
PoseNet_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] experimental-flags,mmt4d,compile-stats 24126 43328 5102449
MobileBertSquad_fp32 [fp32] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] experimental-flags,mmt4d,compile-stats 90042 38512 98628345
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] experimental-flags,mmt4d,compile-stats 46231 110720 14109243
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] experimental-flags,mmt4d,compile-stats 63596 133840 10377146
MobileBertSquad_int8 [int8] (exported_tflite) [cpu-armv8.2-a-generic-linux-android29] experimental-flags,mmt4d,dotprod,compile-stats 252777 4445056 29855737
DeepLabV3_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] default-flags,compile-stats 18343 389644 3189359
MobileSSD_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] default-flags,compile-stats 34775 541738 18515931
PoseNet_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] default-flags,compile-stats 14908 137108 5201067
MobileBertSquad_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] default-flags,compile-stats 80743 226508 98640904
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [gpu-adreno-generic-linux-android31] default-flags,compile-stats 27433 329596 14331695
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [gpu-adreno-generic-linux-android31] default-flags,compile-stats 35919 393992 10647209
DeepLabV3_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,compile-stats 15613 412560 3204232
MobileSSD_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,compile-stats 29740 604220 18568130
PoseNet_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,compile-stats 10207 159596 5216797
MobileBertSquad_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,compile-stats 94976 226508 98640904
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,compile-stats 28896 374542 14367681
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,compile-stats 34213 411026 10660014
MobileSSD_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 39701 604220 18651266
PoseNet_fp32 [fp32] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 13772 159596 5245405
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 24191 374542 14414721
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [gpu-adreno-generic-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 32888 411026 10738990
DeepLabV3_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,compile-stats 15750 178304 2978159
MobileSSD_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,compile-stats 42463 353302 18327515
PoseNet_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,compile-stats 14487 95576 5159595
MobileBertSquad_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,compile-stats 86166 129828 98544200
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,compile-stats 30566 194320 14196527
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,compile-stats 33569 263212 10516521
MobileBertSquad_fp16 [fp16] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,demote-f32-to-f16,compile-stats 96836 2978928 52957691
MobileBertSquad_int8 [int8] (exported_tflite) [gpu-mali-valhall-linux-android31] default-flags,demote-f32-to-f16,compile-stats 114203 2575038 28019014
DeepLabV3_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,compile-stats 15709 202756 2994568
MobileSSD_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,compile-stats 39022 378160 18342018
PoseNet_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,compile-stats 10441 118720 5176029
MobileBertSquad_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,compile-stats 103692 129828 98544200
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,compile-stats 24280 213966 14207169
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,compile-stats 32546 288170 10537326
MobileBertSquad_fp16 [fp16] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,demote-f32-to-f16,compile-stats 114622 2978928 52957691
MobileBertSquad_int8 [int8] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,demote-f32-to-f16,compile-stats 118139 2575038 28019014
DeepLabV3_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 18103 202756 3098760
MobileSSD_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 32662 378160 18513922
PoseNet_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 11916 118720 5235101
MobileBertSquad_fp32 [fp32] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 96571 129828 99849736
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 25125 213966 14304385
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,compile-stats 34922 288170 10700526
MobileBertSquad_fp16 [fp16] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,demote-f32-to-f16,compile-stats 120309 2978928 54263163
MobileBertSquad_int8 [int8] (exported_tflite) [gpu-mali-valhall-linux-android31] experimental-flags,fuse-padding,repeated-kernel,demote-f32-to-f16,compile-stats 171515 2575038 30574470
MobileNetV2_fp32 [fp32,imagenet] (exported_tflite) [cpu-vmvx-generic-vmvx] default-flags,compile-stats 28372 96949 14080564
MobileNetV3Small_fp32 [fp32,imagenet] (exported_tflite) [cpu-vmvx-generic-vmvx] default-flags,compile-stats 35238 165493 10386931
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment