Skip to content

Instantly share code, notes, and snippets.

@Fraser999
Created November 17, 2020 14:00
Show Gist options
  • Save Fraser999/14999a254f1b52dc43afc30b635b2ebc to your computer and use it in GitHub Desktop.
Save Fraser999/14999a254f1b52dc43afc30b635b2ebc to your computer and use it in GitHub Desktop.
Benchmarks of wrapped bytes
serialize_vector_of_i32s
time: [105.88 us 106.06 us 106.26 us]
change: [+3.7910% +3.9990% +4.2281%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
deserialize_vector_of_i32s
time: [2.3306 us 2.3336 us 2.3372 us]
change: [-50.274% -44.491% -37.527%] (p = 0.00 < 0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) high mild
4 (4.00%) high severe
serialize_vector_of_u8 time: [67.938 ns 68.010 ns 68.091 ns]
change: [-27.293% -26.897% -26.566%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
5 (5.00%) high mild
5 (5.00%) high severe
deserialize_vector_of_u8
time: [70.776 ns 71.239 ns 71.815 ns]
change: [+8.9805% +9.5280% +10.055%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
serialize_u8 time: [14.371 ns 14.409 ns 14.455 ns]
change: [+0.0408% +0.5595% +0.9747%] (p = 0.02 < 0.05)
Change within noise threshold.
Found 14 outliers among 100 measurements (14.00%)
2 (2.00%) high mild
12 (12.00%) high severe
deserialize_u8 time: [4.1918 ns 4.1964 ns 4.2012 ns]
change: [+1.8408% +2.0722% +2.3030%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
serialize_i32 time: [19.179 ns 19.195 ns 19.212 ns]
change: [+0.2253% +0.4109% +0.5709%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
deserialize_i32 time: [4.4431 ns 4.4448 ns 4.4469 ns]
change: [-3.9328% -3.7803% -3.6320%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low severe
1 (1.00%) low mild
1 (1.00%) high mild
7 (7.00%) high severe
serialize_u64 time: [18.969 ns 18.983 ns 18.999 ns]
change: [+0.2471% +0.4452% +0.6355%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 11 outliers among 100 measurements (11.00%)
2 (2.00%) low mild
7 (7.00%) high mild
2 (2.00%) high severe
deserialize_u64 time: [4.8875 ns 4.8899 ns 4.8927 ns]
change: [-2.8498% -2.7113% -2.5749%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) low mild
1 (1.00%) high mild
4 (4.00%) high severe
serialize_some_u64 time: [39.311 ns 40.296 ns 41.302 ns]
change: [+10.187% +11.642% +13.479%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
deserialize_some_u64 time: [6.0713 ns 6.1703 ns 6.2751 ns]
change: [+11.404% +13.094% +14.767%] (p = 0.00 < 0.05)
Performance has regressed.
serialize_none_u64 time: [17.487 ns 17.819 ns 18.165 ns]
change: [+11.682% +13.979% +16.643%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
deserialize_ok_u64 time: [5.2584 ns 5.3349 ns 5.4142 ns]
change: [+10.834% +12.518% +13.897%] (p = 0.00 < 0.05)
Performance has regressed.
serialize_vector_of_vector_of_u8
time: [232.91 ns 237.63 ns 242.31 ns]
change: [+7.2353% +8.9024% +10.253%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
8 (8.00%) low mild
deserialize_vector_of_vector_of_u8
time: [169.14 ns 169.31 ns 169.50 ns]
change: [+28.827% +28.998% +29.170%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
serialize_tree_map time: [344.06 ns 352.78 ns 361.18 ns]
change: [-11.423% -9.5669% -7.6746%] (p = 0.00 < 0.05)
Performance has improved.
deserialize_treemap time: [242.90 ns 243.49 ns 244.09 ns]
change: [-9.0096% -8.7919% -8.5692%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
serialize_string time: [32.899 ns 33.412 ns 34.070 ns]
change: [-34.629% -33.718% -32.710%] (p = 0.00 < 0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) high mild
7 (7.00%) high severe
deserialize_string time: [41.224 ns 41.304 ns 41.367 ns]
change: [+15.401% +16.160% +16.925%] (p = 0.00 < 0.05)
Performance has regressed.
serialize_vec_of_string time: [815.54 ns 816.12 ns 817.07 ns]
change: [-27.143% -26.852% -26.541%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
7 (7.00%) high severe
deserialize_vec_of_string
time: [750.10 ns 773.18 ns 798.58 ns]
change: [-16.406% -14.620% -12.903%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
serialize_unit time: [4.4360 ns 4.6337 ns 4.8449 ns]
change: [+0.5226% +2.6165% +4.9534%] (p = 0.02 < 0.05)
Change within noise threshold.
Found 18 outliers among 100 measurements (18.00%)
3 (3.00%) high mild
15 (15.00%) high severe
deserialize_unit time: [2.7365 ns 2.7382 ns 2.7404 ns]
change: [-5.2928% -5.1824% -5.0870%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
serialize_key_account time: [39.328 ns 39.439 ns 39.557 ns]
change: [-2.4854% -1.9753% -1.4735%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
2 (2.00%) low severe
4 (4.00%) low mild
3 (3.00%) high mild
2 (2.00%) high severe
deserialize_key_account time: [24.545 ns 24.699 ns 24.909 ns]
change: [-1.6253% -0.7772% +0.1901%] (p = 0.13 > 0.05)
No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
serialize_key_hash time: [39.144 ns 40.955 ns 42.917 ns]
change: [+1.3654% +4.1492% +7.6440%] (p = 0.01 < 0.05)
Performance has regressed.
Found 14 outliers among 100 measurements (14.00%)
12 (12.00%) high mild
2 (2.00%) high severe
deserialize_key_hash time: [18.166 ns 18.179 ns 18.192 ns]
change: [+8.5976% +9.0044% +9.3303%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
serialize_key_uref time: [59.953 ns 60.091 ns 60.263 ns]
change: [-2.8829% -2.1026% -1.6175%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low mild
4 (4.00%) high mild
6 (6.00%) high severe
deserialize_key_uref time: [28.547 ns 28.591 ns 28.639 ns]
change: [-7.2098% -7.0386% -6.8650%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
serialize_vec_of_keys time: [2.3006 us 2.3029 us 2.3056 us]
change: [-4.2847% -3.7282% -3.2284%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) high mild
7 (7.00%) high severe
deserialize_vec_of_keys time: [1.3198 us 1.3216 us 1.3237 us]
change: [-4.3186% -4.1550% -3.9961%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low mild
2 (2.00%) high mild
5 (5.00%) high severe
serialize_access_rights_read
time: [13.032 ns 13.041 ns 13.051 ns]
change: [-0.9106% -0.3468% +0.1262%] (p = 0.21 > 0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) low mild
2 (2.00%) high mild
1 (1.00%) high severe
deserialize_access_rights_read
time: [3.9641 ns 3.9684 ns 3.9726 ns]
change: [+4.9743% +5.1583% +5.3235%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) low mild
3 (3.00%) high mild
serialize_access_rights_write
time: [12.857 ns 12.871 ns 12.886 ns]
change: [-5.6071% -4.1700% -2.9464%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
deserialize_access_rights_write
time: [3.9763 ns 3.9813 ns 3.9870 ns]
change: [-4.9330% -3.6395% -2.4001%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
serialize_access_rights_add
time: [13.016 ns 13.033 ns 13.051 ns]
change: [-10.703% -9.0395% -7.4687%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) low severe
1 (1.00%) low mild
4 (4.00%) high mild
deserialize_access_rights_add
time: [3.9792 ns 3.9870 ns 3.9958 ns]
change: [-3.8106% -2.1042% -0.4607%] (p = 0.02 < 0.05)
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
serialize_access_rights_read_add
time: [13.142 ns 13.276 ns 13.438 ns]
change: [-30.002% -28.191% -26.208%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) high mild
4 (4.00%) high severe
deserialize_access_rights_read_add
time: [3.9691 ns 3.9762 ns 3.9841 ns]
change: [+5.1714% +5.3764% +5.5796%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
7 (7.00%) high mild
1 (1.00%) high severe
serialize_access_rights_read_write
time: [13.068 ns 13.092 ns 13.119 ns]
change: [+0.1808% +0.4395% +0.7018%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
deserialize_access_rights_read_write
time: [3.9678 ns 3.9738 ns 3.9799 ns]
change: [+4.6816% +4.8881% +5.0845%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) low mild
4 (4.00%) high mild
serialize_access_rights_add_write
time: [13.014 ns 13.036 ns 13.059 ns]
change: [-1.6657% -1.0510% -0.5230%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 10 outliers among 100 measurements (10.00%)
8 (8.00%) high mild
2 (2.00%) high severe
deserialize_access_rights_add_write
time: [3.9704 ns 3.9745 ns 3.9788 ns]
change: [+5.1864% +5.4034% +5.5903%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
serialize_cl_value_int32
time: [93.284 ns 93.464 ns 93.686 ns]
change: [-7.5103% -6.9117% -6.2087%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
deserialize_cl_value_int32
time: [81.648 ns 81.792 ns 81.937 ns]
change: [+4.2347% +4.5467% +4.8847%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high severe
serialize_cl_value_uint128
time: [109.81 ns 110.27 ns 110.97 ns]
change: [-13.925% -13.416% -12.736%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) high mild
5 (5.00%) high severe
deserialize_cl_value_uint128
time: [120.98 ns 121.17 ns 121.35 ns]
change: [+6.9484% +7.2474% +7.5288%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
serialize_cl_value_uint256
time: [119.03 ns 119.32 ns 119.60 ns]
change: [-12.146% -11.801% -11.491%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
deserialize_cl_value_uint256
time: [121.71 ns 121.95 ns 122.22 ns]
change: [+2.3680% +2.5796% +2.8011%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) high mild
7 (7.00%) high severe
serialize_cl_value_uint512
time: [129.70 ns 129.86 ns 130.05 ns]
change: [-5.0392% -4.8310% -4.6275%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
deserialize_cl_value_uint512
time: [128.14 ns 128.25 ns 128.38 ns]
change: [+1.3308% +1.5230% +1.7304%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) high mild
5 (5.00%) high severe
serialize_cl_value_bytearray
time: [184.09 ns 184.49 ns 184.92 ns]
change: [-14.987% -14.582% -14.269%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe
deserialize_cl_value_bytearray
time: [147.12 ns 147.36 ns 147.63 ns]
change: [+11.527% +11.824% +12.144%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
serialize_cl_value_listint32
time: [27.933 us 27.963 us 28.001 us]
change: [-6.9696% -6.8791% -6.7866%] (p = 0.00 < 0.05)
Performance has improved.
Found 14 outliers among 100 measurements (14.00%)
3 (3.00%) high mild
11 (11.00%) high severe
deserialize_cl_value_listint32
time: [862.10 ns 863.62 ns 865.21 ns]
change: [-49.229% -45.287% -40.696%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
serialize_cl_value_string
time: [119.56 ns 119.78 ns 120.01 ns]
change: [-23.362% -23.163% -22.966%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
deserialize_cl_value_string
time: [110.51 ns 110.66 ns 110.82 ns]
change: [-0.4239% -0.2229% -0.0256%] (p = 0.03 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
serialize_cl_value_liststring
time: [259.61 ns 259.93 ns 260.25 ns]
change: [-16.024% -15.844% -15.669%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
deserialize_cl_value_liststring
time: [184.03 ns 184.40 ns 184.78 ns]
change: [-16.786% -16.615% -16.465%] (p = 0.00 < 0.05)
Performance has improved.
serialize_cl_value_namedkey
time: [249.10 ns 249.39 ns 249.69 ns]
change: [-12.475% -12.065% -11.739%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
deserialize_cl_value_namedkey
time: [236.15 ns 236.37 ns 236.60 ns]
change: [+1.9614% +2.6099% +3.1435%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
serialize_u128 time: [29.579 ns 29.700 ns 29.827 ns]
change: [+1.5825% +2.2380% +2.8704%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
deserialize_u128 time: [9.7957 ns 9.8571 ns 9.9309 ns]
change: [+0.8796% +1.2158% +1.5924%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) high mild
5 (5.00%) high severe
serialize_u256 time: [30.778 ns 30.917 ns 31.067 ns]
change: [-1.3050% -0.6096% +0.0683%] (p = 0.09 > 0.05)
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
deserialize_u256 time: [11.854 ns 11.881 ns 11.910 ns]
change: [-0.9691% -0.4478% +0.1147%] (p = 0.10 > 0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
serialize_u512 time: [39.075 ns 39.321 ns 39.611 ns]
change: [-1.0308% +0.0083% +0.9669%] (p = 0.98 > 0.05)
No change in performance detected.
Found 9 outliers among 100 measurements (9.00%)
6 (6.00%) high mild
3 (3.00%) high severe
deserialize_u512 time: [18.979 ns 19.041 ns 19.130 ns]
change: [+0.6839% +0.8971% +1.1084%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment