2 * bench
$ ~/dev/cbt/compare.py -a /tmp/seastar/ -b /tmp/classic/ -v 17:55:05 - DEBUG - cbt - Nodes : gen8 17:55:05 - DEBUG - cbt - Nodes : gen8 17:55:05 - DEBUG - cbt - Nodes : gen8 17:55:05 - WARNING - cbt - prefill/gen8/0: bandwidth: (or (greater) (near 0.05)):: 0.153824/2.67928 => rejected 17:55:05 - WARNING - cbt - prefill/gen8/0: iops_avg: (or (greater) (near 0.05)):: 39.0/685.0 => rejected 17:55:05 - INFO - cbt - prefill/gen8/0: iops_stddev: (or (less) (near 0.50)):: 8.02081/31.8198 => accepted 17:55:05 - WARNING - cbt - prefill/gen8/0: latency_avg: (or (less) (near 0.05)):: 0.405547/0.0233105 => rejected 17:55:05 - WARNING - cbt - prefill/gen8/1: bandwidth: (or (greater) (near 0.05)):: 0.144901/2.5052 => rejected 17:55:05 - WARNING - cbt - prefill/gen8/1: iops_avg: (or (greater) (near 0.05)):: 37.0/641.0 => rejected 17:55:05 - INFO - cbt - prefill/gen8/1: iops_stddev: (or (less) (near 0.50)):: 2.08167/48.9932 => accepted 17:55:05 - WARNING - cbt - prefill/gen8/1: latency_avg: (or (less) (near 0.05)):: 0.429396/0.0249327 => rejected 17:55:05 - WARNING - cbt - rand/gen8/0: bandwidth: (or (greater) (near 0.05)):: 0.823615/11.2914 => rejected 17:55:05 - WARNING - cbt - rand/gen8/0: iops_avg: (or (greater) (near 0.05)):: 210.0/2890.0 => rejected 17:55:05 - INFO - cbt - rand/gen8/0: iops_stddev: (or (less) (near 0.50)):: 53.5356/1452.15 => accepted 17:55:05 - WARNING - cbt - rand/gen8/0: latency_avg: (or (less) (near 0.05)):: 0.0758435/0.00550528 => rejected 17:55:05 - WARNING - cbt - rand/gen8/1: bandwidth: (or (greater) (near 0.05)):: 0.834413/11.2419 => rejected 17:55:05 - WARNING - cbt - rand/gen8/1: iops_avg: (or (greater) (near 0.05)):: 213.0/2877.0 => rejected 17:55:05 - INFO - cbt - rand/gen8/1: iops_stddev: (or (less) (near 0.50)):: 50.8524/1412.39 => accepted 17:55:05 - WARNING - cbt - rand/gen8/1: latency_avg: (or (less) (near 0.05)):: 0.0748226/0.00553119 => rejected 17:55:05 - WARNING - cbt - 12 tests failed out of 16
2 * bench
18:41:48 - DEBUG - cbt - Nodes : gen8 18:41:48 - WARNING - cbt - prefill/gen8/0: bandwidth: (or (greater) (near 0.05)):: 0.764544/5.62173 => rejected 18:41:48 - WARNING - cbt - prefill/gen8/0: iops_avg: (or (greater) (near 0.05)):: 195.0/1439.0 => rejected 18:41:48 - INFO - cbt - prefill/gen8/0: iops_stddev: (or (less) (near 0.50)):: 2.08167/71.5984 => accepted 18:41:48 - WARNING - cbt - prefill/gen8/0: latency_avg: (or (less) (near 0.05)):: 0.0809972/0.0111094 => rejected 18:41:48 - WARNING - cbt - prefill/gen8/1: bandwidth: (or (greater) (near 0.05)):: 0.766766/5.60986 => rejected 18:41:48 - WARNING - cbt - prefill/gen8/1: iops_avg: (or (greater) (near 0.05)):: 196.0/1436.0 => rejected 18:41:48 - INFO - cbt - prefill/gen8/1: iops_stddev: (or (less) (near 0.50)):: 4.16333/48.1283 => accepted 18:41:48 - WARNING - cbt - prefill/gen8/1: latency_avg: (or (less) (near 0.05)):: 0.0807624/0.0111323 => rejected 18:41:48 - WARNING - cbt - rand/gen8/0: bandwidth: (or (greater) (near 0.05)):: 1.07839/4.98876 => rejected 18:41:48 - WARNING - cbt - rand/gen8/0: iops_avg: (or (greater) (near 0.05)):: 276.0/1277.0 => rejected 18:41:48 - INFO - cbt - rand/gen8/0: iops_stddev: (or (less) (near 0.50)):: 6.22527/1027.95 => accepted 18:41:48 - WARNING - cbt - rand/gen8/0: latency_avg: (or (less) (near 0.05)):: 0.0578931/0.0125121 => rejected 18:41:48 - WARNING - cbt - rand/gen8/1: bandwidth: (or (greater) (near 0.05)):: 1.08071/4.93508 => rejected 18:41:48 - WARNING - cbt - rand/gen8/1: iops_avg: (or (greater) (near 0.05)):: 276.0/1263.0 => rejected 18:41:48 - INFO - cbt - rand/gen8/1: iops_stddev: (or (less) (near 0.50)):: 6.01378/1007.33 => accepted 18:41:48 - WARNING - cbt - rand/gen8/1: latency_avg: (or (less) (near 0.05)):: 0.0577636/0.0126488 => rejected