Skip to content

Instantly share code, notes, and snippets.

@franziskuskiefer

franziskuskiefer/evercrypt

Created September 2, 2020 14:30
Show Gist options
  • Save franziskuskiefer/cc7dfaa16cd433a51f359129894e09a4 to your computer and use it in GitHub Desktop.
Save franziskuskiefer/cc7dfaa16cd433a51f359129894e09a4 to your computer and use it in GitHub Desktop.
Download ZIP
Hacspec Benchmarks
Raw
evercrypt
SHA1 time: [37.673 us 37.760 us 37.861 us]
change: [-0.9373% -0.3104% +0.1528%] (p = 0.31 > 0.05)
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
SHA224 time: [46.138 us 46.201 us 46.273 us]
change: [-0.6403% -0.3001% -0.0023%] (p = 0.07 > 0.05)
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
SHA256 time: [46.092 us 46.163 us 46.248 us]
change: [-1.5905% -0.9374% -0.3989%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) high mild
4 (4.00%) high severe
SHA384 time: [31.421 us 31.516 us 31.629 us]
change: [+0.1542% +0.7341% +1.2108%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
SHA512 time: [30.952 us 31.015 us 31.088 us]
change: [-0.2423% +0.2336% +0.6776%] (p = 0.32 > 0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
AES128 encrypt time: [2.1845 us 2.2028 us 2.2213 us]
change: [-1.1531% +0.2996% +1.7384%] (p = 0.70 > 0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
AES128 decrypt time: [3.5312 us 3.5608 us 3.5905 us]
change: [-0.1275% +0.9850% +2.1555%] (p = 0.09 > 0.05)
No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
AES256 encrypt time: [2.4323 us 2.4489 us 2.4654 us]
change: [-0.3686% +0.6540% +1.6784%] (p = 0.23 > 0.05)
No change in performance detected.
AES256 decrypt time: [3.7859 us 3.8076 us 3.8309 us]
change: [-0.6022% +0.5266% +1.7441%] (p = 0.44 > 0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
ChaCha20Poly1305 encrypt
time: [5.4870 us 5.4989 us 5.5115 us]
change: [-1.4008% -0.7272% -0.1445%] (p = 0.03 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
ChaCha20Poly1305 decrypt
time: [6.6510 us 6.6677 us 6.6840 us]
change: [-0.7917% -0.1836% +0.4168%] (p = 0.55 > 0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
X25519 base time: [30.680 us 30.722 us 30.775 us]
change: [-0.3827% -0.1770% +0.0363%] (p = 0.10 > 0.05)
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
X25519 DH time: [30.635 us 30.700 us 30.776 us]
change: [-0.3200% -0.0100% +0.3168%] (p = 0.95 > 0.05)
No change in performance detected.
Found 10 outliers among 100 measurements (10.00%)
7 (7.00%) high mild
3 (3.00%) high severe
P256 base time: [217.53 us 218.53 us 219.90 us]
change: [-0.3766% +0.3014% +1.1371%] (p = 0.50 > 0.05)
No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low mild
1 (1.00%) high mild
6 (6.00%) high severe
P256 DH time: [650.55 us 651.23 us 651.85 us]
change: [-0.4705% -0.3286% -0.1862%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low severe
5 (5.00%) low mild
3 (3.00%) high mild
2 (2.00%) high severe
P256 base Agile time: [217.21 us 217.47 us 217.74 us]
change: [-0.7197% -0.4583% -0.2016%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 13 outliers among 100 measurements (13.00%)
4 (4.00%) low mild
7 (7.00%) high mild
2 (2.00%) high severe
P256 DH Agile time: [650.39 us 651.54 us 652.65 us]
change: [-0.5660% -0.3654% -0.1800%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 12 outliers among 100 measurements (12.00%)
2 (2.00%) low severe
4 (4.00%) low mild
5 (5.00%) high mild
1 (1.00%) high severe
P256 ECDSA Sign SHA-256 time: [223.79 us 224.08 us 224.39 us]
change: [-0.5811% -0.3882% -0.2000%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) low severe
6 (6.00%) high mild
1 (1.00%) high severe
Benchmarking P256 ECDSA Verify SHA-256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.5s, enable flat sampling, or reduce sample count to 60.
P256 ECDSA Verify SHA-256
time: [857.06 us 860.18 us 865.60 us]
change: [-0.5728% -0.2189% +0.1904%] (p = 0.28 > 0.05)
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) low mild
1 (1.00%) high mild
4 (4.00%) high severe
P256 ECDSA Sign Agile SHA-256
time: [223.93 us 224.25 us 224.60 us]
change: [-1.5969% -1.3422% -1.1160%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
2 (2.00%) low severe
3 (3.00%) low mild
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking P256 ECDSA Verify Agile SHA-256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.5s, enable flat sampling, or reduce sample count to 60.
P256 ECDSA Verify Agile SHA-256
time: [937.03 us 989.28 us 1.0509 ms]
change: [+2.9913% +6.5795% +10.376%] (p = 0.00 < 0.05)
Performance has regressed.
Found 21 outliers among 100 measurements (21.00%)
3 (3.00%) high mild
18 (18.00%) high severe
P256 ECDSA Sign SHA-384 time: [223.28 us 223.91 us 224.63 us]
change: [+0.0283% +0.2917% +0.5340%] (p = 0.03 < 0.05)
Change within noise threshold.
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
Benchmarking P256 ECDSA Verify SHA-384: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.6s, enable flat sampling, or reduce sample count to 60.
P256 ECDSA Verify SHA-384
time: [859.54 us 865.12 us 873.84 us]
change: [+0.2855% +0.7504% +1.2671%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) high mild
4 (4.00%) high severe
P256 ECDSA Sign Agile SHA-384
time: [224.62 us 225.31 us 226.00 us]
change: [+0.1071% +0.3974% +0.6822%] (p = 0.01 < 0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking P256 ECDSA Verify Agile SHA-384: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60.
P256 ECDSA Verify Agile SHA-384
time: [900.16 us 922.83 us 954.56 us]
change: [+11.098% +24.113% +46.268%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
5 (5.00%) high mild
6 (6.00%) high severe
P256 ECDSA Sign SHA-512 time: [224.74 us 225.20 us 225.68 us]
change: [+1.2051% +1.5153% +1.8952%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking P256 ECDSA Verify SHA-512: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.5s, enable flat sampling, or reduce sample count to 60.
P256 ECDSA Verify SHA-512
time: [860.59 us 862.91 us 865.43 us]
change: [+0.0272% +0.3324% +0.6600%] (p = 0.04 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
P256 ECDSA Sign Agile SHA-512
time: [224.33 us 225.53 us 227.27 us]
change: [+0.6766% +1.1926% +1.7987%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) low mild
3 (3.00%) high mild
5 (5.00%) high severe
Benchmarking P256 ECDSA Verify Agile SHA-512: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.5s, enable flat sampling, or reduce sample count to 60.
P256 ECDSA Verify Agile SHA-512
time: [858.27 us 859.46 us 860.68 us]
change: [-0.4694% +0.0457% +0.6006%] (p = 0.87 > 0.05)
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe
ed25519 key gen time: [92.953 us 93.106 us 93.274 us]
change: [-0.3460% -0.0869% +0.1448%] (p = 0.50 > 0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
ed25519 sign time: [192.67 us 193.04 us 193.47 us]
change: [-3.4084% -2.2997% -1.3192%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
ed25519 verify time: [201.63 us 202.08 us 202.55 us]
change: [-4.8316% -4.0706% -3.3615%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
HMAC SHA1 time: [38.451 us 38.525 us 38.610 us]
change: [-0.9907% -0.5035% -0.0529%] (p = 0.03 < 0.05)
Change within noise threshold.
Found 12 outliers among 100 measurements (12.00%)
7 (7.00%) high mild
5 (5.00%) high severe
HMAC SHA256 time: [8.6057 us 8.6223 us 8.6418 us]
change: [-2.1434% -1.5737% -1.0373%] (p = 0.00 < 0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) high mild
6 (6.00%) high severe
HMAC SHA384 time: [32.453 us 32.517 us 32.589 us]
change: [-1.4431% -0.9245% -0.4408%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
HMAC SHA512 time: [32.396 us 32.458 us 32.526 us]
change: [-2.5845% -2.1287% -1.6953%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
6 (6.00%) high mild
2 (2.00%) high severe
HKDF Expand SHA1 time: [77.153 us 77.568 us 78.122 us]
change: [-0.2541% +0.2108% +0.7874%] (p = 0.45 > 0.05)
No change in performance detected.
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe
HKDF Extract SHA1 time: [1.0918 us 1.0929 us 1.0942 us]
change: [-1.6601% -1.2769% -0.9194%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
HKDF Expand SHA256 time: [9.1574 us 9.1828 us 9.2072 us]
change: [-5.5711% -4.6337% -3.7226%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
HKDF Extract SHA256 time: [382.21 ns 383.00 ns 383.92 ns]
change: [-2.1058% -1.6248% -1.2171%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
HKDF Expand SHA384 time: [33.183 us 33.273 us 33.367 us]
change: [-3.3196% -2.2087% -1.1879%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
HKDF Extract SHA384 time: [1.7022 us 1.7050 us 1.7081 us]
change: [-1.0737% -0.5733% -0.1589%] (p = 0.01 < 0.05)
Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
HKDF Expand SHA512 time: [32.668 us 32.777 us 32.899 us]
change: [-0.9072% -0.4094% +0.0565%] (p = 0.10 > 0.05)
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
HKDF Extract SHA512 time: [1.6924 us 1.6973 us 1.7033 us]
change: [-0.2723% +0.0752% +0.4732%] (p = 0.69 > 0.05)
No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe
HKDF SHA1 time: [78.450 us 78.662 us 78.899 us]
change: [-2.8902% -1.9433% -1.1055%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
6 (6.00%) high mild
4 (4.00%) high severe
HKDF SHA256 time: [9.6736 us 9.7055 us 9.7401 us]
change: [-3.1875% -2.4041% -1.6657%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
HKDF SHA384 time: [34.697 us 34.762 us 34.833 us]
change: [-0.0916% +0.2109% +0.5169%] (p = 0.17 > 0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) high mild
4 (4.00%) high severe
HKDF SHA512 time: [34.558 us 34.625 us 34.697 us]
change: [-0.2297% +0.1137% +0.4352%] (p = 0.50 > 0.05)
No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe
Raw
hacspec
GCM time: [35.054 us 35.133 us 35.223 us]
change: [-7.7767% -4.3206% -1.4680%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking AES 128 encrypt: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.5s, enable flat sampling, or reduce sample count to 50.
AES 128 encrypt time: [1.5950 ms 1.5987 ms 1.6027 ms]
change: [-0.5476% +0.3438% +1.1091%] (p = 0.45 > 0.05)
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
AES 128 decrypt time: [1.6072 ms 1.6146 ms 1.6234 ms]
change: [+0.0560% +0.5824% +1.1296%] (p = 0.03 < 0.05)
Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) high mild
5 (5.00%) high severe
AES 256 encrypt time: [2.0506 ms 2.0540 ms 2.0579 ms]
change: [+0.1789% +0.4181% +0.6755%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) low mild
3 (3.00%) high mild
5 (5.00%) high severe
AES 256 decrypt time: [2.0909 ms 2.1028 ms 2.1169 ms]
change: [+1.7361% +2.3108% +3.0388%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
AES GCM 128 encrypt time: [236.87 us 237.75 us 238.76 us]
change: [+0.8056% +1.5450% +2.3476%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
AES GCM 128 decrypt time: [237.58 us 238.76 us 240.05 us]
change: [+0.8864% +1.3330% +1.7994%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
AES GCM 256 encrypt time: [291.18 us 292.80 us 294.79 us]
change: [+1.3640% +2.1992% +3.0587%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
6 (6.00%) high mild
5 (5.00%) high severe
AES GCM 256 decrypt time: [292.24 us 294.41 us 297.20 us]
change: [+2.6197% +3.4356% +4.2640%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking Poly1305: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.7s, enable flat sampling, or reduce sample count to 60.
Poly1305 time: [1.2927 ms 1.3016 ms 1.3159 ms]
change: [+1.1238% +1.6336% +2.2456%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low mild
5 (5.00%) high mild
2 (2.00%) high severe
ChaCha20 time: [731.34 us 735.68 us 740.79 us]
change: [+7.5477% +9.9462% +12.721%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) high mild
12 (12.00%) high severe
ChaCha20Poly1305 encrypt
time: [15.042 ms 15.237 ms 15.477 ms]
change: [+3.7027% +5.1755% +6.4871%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe
ChaCha20Poly1305 decrypt
time: [14.897 ms 15.073 ms 15.284 ms]
change: [+1.8930% +3.4739% +5.3011%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Blake2b time: [333.57 us 335.56 us 338.12 us]
change: [-1.7951% -0.9649% -0.1136%] (p = 0.03 < 0.05)
Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
x25519 time: [32.112 ms 32.275 ms 32.445 ms]
change: [+2.9790% +3.4941% +4.0125%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
FIPS 202 (SHA 3 224) time: [198.61 us 200.15 us 201.92 us]
change: [+2.6234% +3.4695% +4.4571%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe
FIPS 202 (SHA 3 256) time: [207.25 us 207.80 us 208.41 us]
change: [+1.5696% +1.8878% +2.2228%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
FIPS 202 (SHA 3 384) time: [249.34 us 249.90 us 250.50 us]
change: [+0.8815% +1.4193% +1.9777%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 10 outliers among 100 measurements (10.00%)
7 (7.00%) high mild
3 (3.00%) high severe
FIPS 202 (SHA 3 512) time: [347.46 us 348.78 us 350.33 us]
change: [+0.4532% +0.9008% +1.2916%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
Benchmarking P256 ECDH: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.0s, or reduce sample count to 80.
P256 ECDH time: [60.983 ms 61.297 ms 61.661 ms]
change: [+2.8766% +3.4057% +4.0472%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking P384 ECDH: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 11.5s, or reduce sample count to 40.
P384 ECDH time: [114.66 ms 115.19 ms 115.77 ms]
change: [+2.4079% +2.9946% +3.5849%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
7 (7.00%) high mild
2 (2.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment