Benchmark with 5 parallel clients querying '/health' as indicator.

multiclient-with-health.txt

// Batching
[----------] 2 tests from AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test
[ RUN      ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/0
Test setup: 100 agents with a total of 10000 running tasks and 10000 completed tasks; 50 '/state' requests will be sent while constantly probing '/health'
Launching 50 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [471312ns, 526136ns, 550777ns, 577803ns, 596056ns, 790455ns] from 50 measurements
Launching 5 * 50 '/state' requests in background
Launching 50 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [156.599993ms, 171.324777ms, 180.105329ms, 216.092973ms, 238.826894ms, 313.303898ms] from 75 measurements
'/state' response [min, p25, p50, p75, p90, max]: [107.083018ms, 265.769455ms, 299.848309ms, 333.216036ms, 381.40314ms, 449.103044ms] from 240 measurements
[       OK ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/0 (15514 ms)
[ RUN      ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/1
Test setup: 1000 agents with a total of 100000 running tasks and 100000 completed tasks; 10 '/state' requests will be sent while constantly probing '/health'
Launching 10 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [526637ns, 562219ns, 572329ns, 629120ns, 727018ns, 1.403758ms] from 10 measurements
Launching 5 * 10 '/state' requests in background
Launching 10 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [1.250607017secs, 2.772189027secs, 2.859852692secs, 3.863025652secs, 4.109850664secs, 4.188432961secs] from 16 measurements
'/state' response [min, p25, p50, p75, p90, max]: [1.939043512secs, 4.485128147secs, 5.466092499secs, 5.593344541secs, 5.775923144secs, 6.888275522secs] from 49 measurements
[       OK ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/1 (60649 ms)
[----------] 2 tests from AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test (76163 ms total)

// No batching
[----------] 2 tests from AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test
[ RUN      ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/0
Test setup: 100 agents with a total of 10000 running tasks and 10000 completed tasks; 50 '/state' requests will be sent while constantly probing '/health'
Launching 50 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [509738ns, 547121ns, 560455ns, 591322ns, 614944ns, 822370ns] from 50 measurements
Launching 5 * 50 '/state' requests in background
Launching 50 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [78.679905ms, 282.996015ms, 293.222893ms, 322.461402ms, 335.254164ms, 346.252251ms] from 63 measurements
'/state' response [min, p25, p50, p75, p90, max]: [109.686866ms, 358.038903ms, 375.780316ms, 395.827287ms, 411.125481ms, 450.42892ms] from 250 measurements
[       OK ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/0 (19894 ms)
[ RUN      ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/1
Test setup: 1000 agents with a total of 100000 running tasks and 100000 completed tasks; 10 '/state' requests will be sent while constantly probing '/health'
Launching 10 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [523855ns, 551893ns, 591285ns, 634842ns, 682495ns, 847760ns] from 10 measurements
Launching 5 * 10 '/state' requests in background
Launching 10 '/health' requests
'/health' response [min, p25, p50, p75, p90, max]: [2.507943608secs, 5.215679175secs, 5.246621408secs, 5.388002487secs, 5.435535174secs, 5.445548961secs] from 13 measurements
'/state' response [min, p25, p50, p75, p90, max]: [1.882306611secs, 6.488822113secs, 6.556003248secs, 6.71327846secs, 6.832402935secs, 7.074507037secs] from 50 measurements
[       OK ] AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test.WithV0StateLoad/1 (75562 ms)
[----------] 2 tests from AgentFrameworkTaskCount/MasterActorResponsivenessMulticlient_BENCHMARK_Test (95456 ms total)