Skip to content

Instantly share code, notes, and snippets.

@KungFuJesus
Created August 24, 2022 17:26
Show Gist options
  • Save KungFuJesus/24cca05e5d9283bc0d5fc74385ba5a90 to your computer and use it in GitHub Desktop.
Save KungFuJesus/24cca05e5d9283bc0d5fc74385ba5a90 to your computer and use it in GitHub Desktop.
Benchmarks zlib-dougallj vs zlib-ng (unrealistically compressible)
RUNNING: ./benchmark_zlib_apps_alt --benchmark_repetitions=10 --benchmark_display_aggregates_only=true --benchmark_filter=png_decode/ --benchmark_out=/tmp/tmpz15lkbmi
2022-08-24T13:23:32-04:00
Running ./benchmark_zlib_apps_alt
Run on (28 X 4097.68 MHz CPU s)
CPU Caches:
L1 Data 32 KiB (x14)
L1 Instruction 32 KiB (x14)
L2 Unified 1024 KiB (x14)
L3 Unified 19712 KiB (x1)
Load Average: 0.56, 0.29, 0.22
-------------------------------------------------------------------------
Benchmark Time CPU Iterations
-------------------------------------------------------------------------
png_decode/png_decode/0_mean 829 us 829 us 10
png_decode/png_decode/0_median 829 us 828 us 10
png_decode/png_decode/0_stddev 2.22 us 2.22 us 10
png_decode/png_decode/0_cv 0.27 % 0.27 % 10
png_decode/png_decode/1_mean 681 us 681 us 10
png_decode/png_decode/1_median 673 us 673 us 10
png_decode/png_decode/1_stddev 15.0 us 15.0 us 10
png_decode/png_decode/1_cv 2.20 % 2.20 % 10
png_decode/png_decode/2_mean 667 us 667 us 10
png_decode/png_decode/2_median 667 us 667 us 10
png_decode/png_decode/2_stddev 9.45 us 9.45 us 10
png_decode/png_decode/2_cv 1.42 % 1.42 % 10
png_decode/png_decode/3_mean 643 us 643 us 10
png_decode/png_decode/3_median 644 us 644 us 10
png_decode/png_decode/3_stddev 3.21 us 3.21 us 10
png_decode/png_decode/3_cv 0.50 % 0.50 % 10
png_decode/png_decode/4_mean 1411 us 1410 us 10
png_decode/png_decode/4_median 1414 us 1414 us 10
png_decode/png_decode/4_stddev 12.9 us 12.9 us 10
png_decode/png_decode/4_cv 0.92 % 0.92 % 10
png_decode/png_decode/5_mean 1399 us 1399 us 10
png_decode/png_decode/5_median 1398 us 1398 us 10
png_decode/png_decode/5_stddev 9.29 us 9.29 us 10
png_decode/png_decode/5_cv 0.66 % 0.66 % 10
png_decode/png_decode/6_mean 1370 us 1370 us 10
png_decode/png_decode/6_median 1367 us 1367 us 10
png_decode/png_decode/6_stddev 8.27 us 8.26 us 10
png_decode/png_decode/6_cv 0.60 % 0.60 % 10
png_decode/png_decode/7_mean 1379 us 1379 us 10
png_decode/png_decode/7_median 1383 us 1383 us 10
png_decode/png_decode/7_stddev 8.10 us 8.09 us 10
png_decode/png_decode/7_cv 0.59 % 0.59 % 10
png_decode/png_decode/8_mean 1343 us 1343 us 10
png_decode/png_decode/8_median 1343 us 1343 us 10
png_decode/png_decode/8_stddev 4.68 us 4.67 us 10
png_decode/png_decode/8_cv 0.35 % 0.35 % 10
png_decode/png_decode/9_mean 1343 us 1343 us 10
png_decode/png_decode/9_median 1344 us 1344 us 10
png_decode/png_decode/9_stddev 2.46 us 2.47 us 10
png_decode/png_decode/9_cv 0.18 % 0.18 % 10
RUNNING: ./benchmark_zlib_apps --benchmark_repetitions=10 --benchmark_display_aggregates_only=true --benchmark_filter=png_decode/ --benchmark_out=/tmp/tmpmx4zq4vi
2022-08-24T13:24:48-04:00
Running ./benchmark_zlib_apps
Run on (28 X 2408.11 MHz CPU s)
CPU Caches:
L1 Data 32 KiB (x14)
L1 Instruction 32 KiB (x14)
L2 Unified 1024 KiB (x14)
L3 Unified 19712 KiB (x1)
Load Average: 0.97, 0.48, 0.29
-------------------------------------------------------------------------
Benchmark Time CPU Iterations
-------------------------------------------------------------------------
png_decode/png_decode/0_mean 666 us 666 us 10
png_decode/png_decode/0_median 671 us 671 us 10
png_decode/png_decode/0_stddev 7.93 us 7.94 us 10
png_decode/png_decode/0_cv 1.19 % 1.19 % 10
png_decode/png_decode/1_mean 506 us 506 us 10
png_decode/png_decode/1_median 506 us 506 us 10
png_decode/png_decode/1_stddev 3.42 us 3.41 us 10
png_decode/png_decode/1_cv 0.68 % 0.67 % 10
png_decode/png_decode/2_mean 527 us 527 us 10
png_decode/png_decode/2_median 526 us 526 us 10
png_decode/png_decode/2_stddev 1.30 us 1.30 us 10
png_decode/png_decode/2_cv 0.25 % 0.25 % 10
png_decode/png_decode/3_mean 513 us 513 us 10
png_decode/png_decode/3_median 514 us 514 us 10
png_decode/png_decode/3_stddev 3.98 us 3.98 us 10
png_decode/png_decode/3_cv 0.78 % 0.78 % 10
png_decode/png_decode/4_mean 496 us 496 us 10
png_decode/png_decode/4_median 497 us 497 us 10
png_decode/png_decode/4_stddev 1.43 us 1.43 us 10
png_decode/png_decode/4_cv 0.29 % 0.29 % 10
png_decode/png_decode/5_mean 506 us 506 us 10
png_decode/png_decode/5_median 506 us 506 us 10
png_decode/png_decode/5_stddev 1.57 us 1.57 us 10
png_decode/png_decode/5_cv 0.31 % 0.31 % 10
png_decode/png_decode/6_mean 511 us 511 us 10
png_decode/png_decode/6_median 509 us 509 us 10
png_decode/png_decode/6_stddev 4.91 us 4.91 us 10
png_decode/png_decode/6_cv 0.96 % 0.96 % 10
png_decode/png_decode/7_mean 556 us 556 us 10
png_decode/png_decode/7_median 556 us 556 us 10
png_decode/png_decode/7_stddev 1.30 us 1.30 us 10
png_decode/png_decode/7_cv 0.23 % 0.23 % 10
png_decode/png_decode/8_mean 552 us 552 us 10
png_decode/png_decode/8_median 551 us 551 us 10
png_decode/png_decode/8_stddev 2.52 us 2.52 us 10
png_decode/png_decode/8_cv 0.46 % 0.46 % 10
png_decode/png_decode/9_mean 552 us 552 us 10
png_decode/png_decode/9_median 551 us 551 us 10
png_decode/png_decode/9_stddev 1.86 us 1.86 us 10
png_decode/png_decode/9_cv 0.34 % 0.34 % 10
Comparing png_decode/ (from ./benchmark_zlib_apps_alt) to png_decode/ (from ./benchmark_zlib_apps)
Benchmark Time CPU Time Old Time New CPU Old CPU New
-----------------------------------------------------------------------------------------------------------------------------------------------------------------
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]0_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]0_mean -0.1966 -0.1966 829 666 829 666
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]0_median -0.1906 -0.1906 829 671 828 671
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]0_stddev +2.5720 +2.5711 2 8 2 8
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]0_cv +3.4460 +3.4449 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]1_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]1_mean -0.2569 -0.2569 681 506 681 506
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]1_median -0.2486 -0.2486 673 506 673 506
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]1_stddev -0.7717 -0.7719 15 3 15 3
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]1_cv -0.6928 -0.6931 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]2_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]2_mean -0.2106 -0.2106 667 527 667 527
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]2_median -0.2115 -0.2115 667 526 667 526
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]2_stddev -0.8626 -0.8625 9 1 9 1
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]2_cv -0.8260 -0.8258 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]3_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]3_mean -0.2026 -0.2026 643 513 643 513
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]3_median -0.2012 -0.2012 644 514 644 514
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]3_stddev +0.2387 +0.2393 3 4 3 4
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]3_cv +0.5535 +0.5543 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]4_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]4_mean -0.6481 -0.6481 1411 496 1410 496
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]4_median -0.6487 -0.6487 1414 497 1414 497
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]4_stddev -0.8893 -0.8893 13 1 13 1
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]4_cv -0.6856 -0.6855 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]5_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]5_mean -0.6382 -0.6382 1399 506 1399 506
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]5_median -0.6381 -0.6381 1398 506 1398 506
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]5_stddev -0.8314 -0.8315 9 2 9 2
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]5_cv -0.5340 -0.5342 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]6_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]6_mean -0.6270 -0.6270 1370 511 1370 511
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]6_median -0.6275 -0.6275 1367 509 1367 509
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]6_stddev -0.4056 -0.4051 8 5 8 5
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]6_cv +0.5933 +0.5947 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]7_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]7_mean -0.5967 -0.5967 1379 556 1379 556
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]7_median -0.5983 -0.5983 1383 556 1383 556
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]7_stddev -0.8389 -0.8388 8 1 8 1
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]7_cv -0.6007 -0.6004 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]8_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]8_mean -0.5889 -0.5889 1343 552 1343 552
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]8_median -0.5895 -0.5895 1343 551 1343 551
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]8_stddev -0.4619 -0.4614 5 3 5 3
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]8_cv +0.3089 +0.3102 0 0 0 0
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]9_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]9_mean -0.5893 -0.5893 1343 552 1343 552
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]9_median -0.5902 -0.5902 1344 551 1344 551
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]9_stddev -0.2456 -0.2493 2 2 2 2
[png_decode/ vs. png_decode/][png_decode/ vs. png_decode/]9_cv +0.8366 +0.8278 0 0 0 0
OVERALL_GEOMEAN -0.4889 -0.4889 0 0 0 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment