Skip to content

Instantly share code, notes, and snippets.

@dconroy
Created February 6, 2024 16:26
Show Gist options
  • Save dconroy/b72978f634aea086a80678a6c821c3a0 to your computer and use it in GitHub Desktop.
Save dconroy/b72978f634aea086a80678a6c821c3a0 to your computer and use it in GitHub Desktop.
OVH Scale A5 - Aptos Validator Benchmark results
Scale A5
AMD EPYC GENOA 9554 - 64c/128t - 3.1GHz/3.75GHz
ubuntu 22.04 LTS
kernel 6.5.0-15-generic
tuned-adm profile throughput-performance
Results:
{"grep": "grep_json_single_node_perf", "transaction_type": "token-v2-ambassador-mint", "module_working_set_size": 20, "executor_type": "VM", "block_size": 6800, "expected_tps": 6800, "waived": false, "tps": 9470.480458697759, "gps": 104175.28504567535, "gpt": 11.0, "code_perf_version": "v4", "test_index": 41}
transaction_type module_working_set executor block_size expected t/s t/s
--------------------------------------- -------------------- ---------- ------------ -------------- -----
warmup 1 VM 10000 0 18583
no-op 1 VM 10000 24000 32476
no-op 1000 VM 3600 3600 4933
coin-transfer 1 VM 10000 15000 20769
coin-transfer 1 native 10000 37500 56031
account-generation 1 VM 10000 12800 17574
account-resource32-b 1 VM 10000 20700 27907
modify-global-resource 1 VM 4500 4500 7443
publish-package 1 VM 135 135 177
mix_publish_transfer 1 VM 2620 2620 4098
batch100-transfer 1 VM 365 365 525
vector-picture30k 1 VM 165 165 217
smart-table-picture30-k-with200-change 1 VM 17 17 22
resource-groups-global-write-tag1-kb 1 VM 3800 3800 6190
resource-groups-sender-multi-change1-kb 1 VM 10000 16230 21788
token-v2-ambassador-mint 1 VM 1610 1610 2610
token-v2-ambassador-mint 20 VM 6800 6800 9470
transaction_type module_working_set executor block_size expected t/s g/s
--------------------------------------- -------------------- ---------- ------------ -------------- ------
warmup 1 VM 10000 0 0
no-op 1 VM 10000 24000 97428
no-op 1000 VM 3600 3600 14799
coin-transfer 1 VM 10000 15000 145380
coin-transfer 1 native 10000 37500 0
account-generation 1 VM 10000 12800 87871
account-resource32-b 1 VM 10000 20700 135814
modify-global-resource 1 VM 4500 4500 37217
publish-package 1 VM 135 135 16183
mix_publish_transfer 1 VM 2620 2620 29403
batch100-transfer 1 VM 365 365 125036
vector-picture30k 1 VM 165 165 8910
smart-table-picture30-k-with200-change 1 VM 17 17 10849
resource-groups-global-write-tag1-kb 1 VM 3800 3800 49521
resource-groups-sender-multi-change1-kb 1 VM 10000 16230 169377
token-v2-ambassador-mint 1 VM 1610 1610 28707
token-v2-ambassador-mint 20 VM 6800 6800 104175
transaction_type module_working_set executor block_size expected t/s exe/total
--------------------------------------- -------------------- ---------- ------------ -------------- -----------
warmup 1 VM 10000 0 0
no-op 1 VM 10000 24000 0.958
no-op 1000 VM 3600 3600 0.993
coin-transfer 1 VM 10000 15000 0.959
coin-transfer 1 native 10000 37500 0.911
account-generation 1 VM 10000 12800 0.968
account-resource32-b 1 VM 10000 20700 0.959
modify-global-resource 1 VM 4500 4500 0.989
publish-package 1 VM 135 135 0.996
mix_publish_transfer 1 VM 2620 2620 0.992
batch100-transfer 1 VM 365 365 0.962
vector-picture30k 1 VM 165 165 0.992
smart-table-picture30-k-with200-change 1 VM 17 17 0.998
resource-groups-global-write-tag1-kb 1 VM 3800 3800 0.977
resource-groups-sender-multi-change1-kb 1 VM 10000 16230 0.93
token-v2-ambassador-mint 1 VM 1610 1610 0.995
token-v2-ambassador-mint 20 VM 6800 6800 0.978
transaction_type module_working_set executor block_size expected t/s vm/exe
--------------------------------------- -------------------- ---------- ------------ -------------- --------
warmup 1 VM 10000 0 0
no-op 1 VM 10000 24000 0.812
no-op 1000 VM 3600 3600 0.98
coin-transfer 1 VM 10000 15000 0.873
coin-transfer 1 native 10000 37500 0.653
account-generation 1 VM 10000 12800 0.881
account-resource32-b 1 VM 10000 20700 0.821
modify-global-resource 1 VM 4500 4500 0.958
publish-package 1 VM 135 135 0.996
mix_publish_transfer 1 VM 2620 2620 0.979
batch100-transfer 1 VM 365 365 0.955
vector-picture30k 1 VM 165 165 0.998
smart-table-picture30-k-with200-change 1 VM 17 17 0.998
resource-groups-global-write-tag1-kb 1 VM 3800 3800 0.973
resource-groups-sender-multi-change1-kb 1 VM 10000 16230 0.845
token-v2-ambassador-mint 1 VM 1610 1610 0.987
token-v2-ambassador-mint 20 VM 6800 6800 0.943
transaction_type module_working_set executor block_size expected t/s t/s exe/total vm/exe commit/total g/s eff g/s io g/s exe g/s g/t out B/s
--------------------------------------- -------------------- ---------- ------------ -------------- ----- ----------- -------- -------------- ------ --------- -------- --------- ----- ---------
warmup 1 VM 10000 0 18583 0 0 0 0 0 0 0 0 0
no-op 1 VM 10000 24000 32476 0.958 0.812 0.394 97428 97428 0 97428 3 23220381
no-op 1000 VM 3600 3600 4933 0.993 0.98 0.065 14799 14799 0 14799 3 3527056
coin-transfer 1 VM 10000 15000 20769 0.959 0.873 0.373 145380 145389 62306 83075 7 30882995
coin-transfer 1 native 10000 37500 56031 0.911 0.653 0.893 0 0 0 0 0 56366995
account-generation 1 VM 10000 12800 17574 0.968 0.881 0.311 87871 87871 17574 70297 5 24445643
account-resource32-b 1 VM 10000 20700 27907 0.959 0.821 0.41 135814 135814 52093 83721 5 22967405
modify-global-resource 1 VM 4500 4500 7443 0.989 0.958 0.105 37217 297508 14887 22330 5 6230225
publish-package 1 VM 135 135 177 0.996 0.996 0.029 16183 129468 10177 6007 92 4857655
mix_publish_transfer 1 VM 2620 2620 4098 0.992 0.979 0.068 29403 235221 12754 16648 7 6316223
batch100-transfer 1 VM 365 365 525 0.962 0.955 0.298 125036 153058 103496 21540 238 40934105
vector-picture30k 1 VM 165 165 217 0.992 0.998 0.081 8910 69771 8258 652 41 20252131
smart-table-picture30-k-with200-change 1 VM 17 17 22 0.998 0.998 0.012 10849 69009 520 10329 499 2488824
resource-groups-global-write-tag1-kb 1 VM 3800 3800 6190 0.977 0.973 0.272 49521 395811 24759 24762 8 60171657
resource-groups-sender-multi-change1-kb 1 VM 10000 16230 21788 0.93 0.845 0.75 169377 169377 82225 87152 8 162988308
token-v2-ambassador-mint 1 VM 1610 1610 2610 0.995 0.987 0.049 28707 229160 15659 13049 11 7491452
token-v2-ambassador-mint 20 VM 6800 6800 9470 0.978 0.943 0.188 104175 140537 56823 47352 11 27178241
Errors:
perf improvement detected 32475.99898155527 > 27599.999999999996 = 24000 * 1.15, RunGroupKey(transaction_type='no-op', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 4932.920992525997 > 4140.0 = 3600 * 1.15, RunGroupKey(transaction_type='no-op', module_working_set_size=1000, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 20768.640144251996 > 17250.0 = 15000 * 1.15, RunGroupKey(transaction_type='coin-transfer', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 56030.73740168994 > 43125.0 = 37500 * 1.15, RunGroupKey(transaction_type='coin-transfer', module_working_set_size=1, executor_type='native', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 17574.13359778824 > 14719.999999999998 = 12800 * 1.15, RunGroupKey(transaction_type='account-generation', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 27906.887976918377 > 23804.999999999996 = 20700 * 1.15, RunGroupKey(transaction_type='account-resource32-b', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 7443.493407082689 > 5175.0 = 4500 * 1.15, RunGroupKey(transaction_type='modify-global-resource', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 176.85165659516977 > 155.25 = 135 * 1.15, RunGroupKey(transaction_type='publish-package', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 4097.876430091567 > 3012.9999999999995 = 2620 * 1.15, RunGroupKey(transaction_type='mix_publish_transfer', module_working_set_size=1, executor_type='VM', transaction_type_override='publish-package coin-transfer', transaction_weights_override='1 500', sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 525.3623999708443 > 419.74999999999994 = 365 * 1.15, RunGroupKey(transaction_type='batch100-transfer', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 217.32767427898577 > 189.74999999999997 = 165 * 1.15, RunGroupKey(transaction_type='vector-picture30k', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 21.731687481885427 > 19.549999999999997 = 17 * 1.15, RunGroupKey(transaction_type='smart-table-picture30-k-with200-change', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 6190.443566993741 > 4370.0 = 3800 * 1.15, RunGroupKey(transaction_type='resource-groups-global-write-tag1-kb', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 21788.005126841363 > 18664.5 = 16230 * 1.15, RunGroupKey(transaction_type='resource-groups-sender-multi-change1-kb', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 2609.7635998583987 > 1851.4999999999998 = 1610 * 1.15, RunGroupKey(transaction_type='token-v2-ambassador-mint', module_working_set_size=1, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
perf improvement detected 9470.480458697759 > 7819.999999999999 = 6800 * 1.15, RunGroupKey(transaction_type='token-v2-ambassador-mint', module_working_set_size=20, executor_type='VM', transaction_type_override=None, transaction_weights_override=None, sharding_traffic_flags=None, smaller_working_set=False) exceeded TPS requirements, increase TPS requirements to match new baseline
@dconroy
Comment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment