scheduler performance results

on_master.txt

# really, plus https://github.com/squito/spark/commit/8ce85969b680424ebda51ff9fe8f6e9ab9a9c4a9, b/c otherwise
# its getting unfairly penalized for my stupid framework
# but it really should also have 8b41649 (offers.toIndexedSeq) to be a fair comparison

[info] SchedulerPerformanceSuite:
Iteration 0 finished in 470 ms
Iteration 1 finished in 150 ms
Iteration 2 finished in 122 ms
Iteration 3 finished in 122 ms
Iteration 4 finished in 101 ms
Iteration 5 finished in 72 ms
Iteration 6 finished in 65 ms
Iteration 7 finished in 80 ms
Iteration 8 finished in 89 ms
Iteration 9 finished in 66 ms
Iteration 10 finished in 64 ms
Iteration 11 finished in 56 ms
Iteration 12 finished in 60 ms
Iteration 13 finished in 68 ms
Iteration 14 finished in 50 ms
Iteration 15 finished in 56 ms
Iteration 16 finished in 52 ms
Iteration 17 finished in 56 ms
Iteration 18 finished in 71 ms
Iteration 19 finished in 57 ms
Iteration 20 finished in 59 ms
Iteration 21 finished in 63 ms
Iteration 22 finished in 60 ms
Iteration 23 finished in 59 ms
Iteration 24 finished in 67 ms
Iteration 25 finished in 60 ms
Iteration 26 finished in 57 ms
Iteration 27 finished in 57 ms
Iteration 28 finished in 59 ms
Iteration 29 finished in 63 ms
Iteration 30 finished in 67 ms
Iteration 31 finished in 56 ms
Iteration 32 finished in 51 ms
Iteration 33 finished in 54 ms
Iteration 34 finished in 53 ms
Iteration 35 finished in 53 ms
Iteration 36 finished in 67 ms
Iteration 37 finished in 50 ms
Iteration 38 finished in 54 ms
Iteration 39 finished in 53 ms
Iteration 40 finished in 50 ms
Iteration 41 finished in 64 ms
Iteration 42 finished in 56 ms
Iteration 43 finished in 46 ms
Iteration 44 finished in 49 ms
Iteration 45 finished in 49 ms
Iteration 46 finished in 51 ms
Iteration 47 finished in 59 ms
Iteration 48 finished in 51 ms
Iteration 49 finished in 52 ms
Iteration 50 finished in 51 ms
Iteration 51 finished in 51 ms
Iteration 52 finished in 50 ms
Iteration 53 finished in 54 ms
Iteration 54 finished in 46 ms
Iteration 55 finished in 46 ms
Iteration 56 finished in 63 ms
Iteration 57 finished in 48 ms
Iteration 58 finished in 48 ms
Iteration 59 finished in 55 ms
Iteration 60 finished in 51 ms
Iteration 61 finished in 58 ms
Iteration 62 finished in 45 ms
Iteration 63 finished in 49 ms
Iteration 64 finished in 45 ms
Iteration 65 finished in 56 ms
Iteration 66 finished in 62 ms
Iteration 67 finished in 56 ms
Iteration 68 finished in 50 ms
Iteration 69 finished in 63 ms
Iteration 70 finished in 47 ms
Iteration 71 finished in 54 ms
Iteration 72 finished in 45 ms
Iteration 73 finished in 45 ms
Iteration 74 finished in 64 ms
Iteration 75 finished in 52 ms
Iteration 76 finished in 46 ms
Iteration 77 finished in 67 ms
Iteration 78 finished in 47 ms
Iteration 79 finished in 62 ms
Iteration 80 finished in 55 ms
Iteration 81 finished in 44 ms
Iteration 82 finished in 60 ms
Iteration 83 finished in 46 ms
Iteration 84 finished in 42 ms
Iteration 85 finished in 50 ms
Iteration 86 finished in 51 ms
Iteration 87 finished in 48 ms
Iteration 88 finished in 55 ms
Iteration 89 finished in 49 ms
Iteration 90 finished in 61 ms
Iteration 91 finished in 58 ms
Iteration 92 finished in 45 ms
Iteration 93 finished in 64 ms
Iteration 94 finished in 57 ms
Iteration 95 finished in 48 ms
Iteration 96 finished in 41 ms
Iteration 97 finished in 61 ms
Iteration 98 finished in 43 ms
Iteration 99 finished in 49 ms
Iteration 100 finished in 51 ms
Iteration 101 finished in 44 ms
Iteration 102 finished in 59 ms
Iteration 103 finished in 52 ms
Iteration 104 finished in 47 ms
Iteration 105 finished in 49 ms
Iteration 106 finished in 54 ms
Iteration 107 finished in 43 ms
Iteration 108 finished in 46 ms
Iteration 109 finished in 62 ms
Iteration 110 finished in 49 ms
Iteration 111 finished in 55 ms
Iteration 112 finished in 62 ms
Iteration 113 finished in 43 ms
Iteration 114 finished in 59 ms
Iteration 115 finished in 48 ms
Iteration 116 finished in 50 ms
Iteration 117 finished in 67 ms
Iteration 118 finished in 54 ms
Iteration 119 finished in 47 ms
Iteration 120 finished in 47 ms
Iteration 121 finished in 49 ms
Iteration 122 finished in 46 ms
Iteration 123 finished in 53 ms
Iteration 124 finished in 48 ms
Iteration 125 finished in 43 ms
Iteration 126 finished in 45 ms
Iteration 127 finished in 48 ms
Iteration 128 finished in 46 ms
Iteration 129 finished in 55 ms
Iteration 130 finished in 51 ms
Iteration 131 finished in 52 ms
Iteration 132 finished in 43 ms
Iteration 133 finished in 64 ms
Iteration 134 finished in 45 ms
Iteration 135 finished in 49 ms
Iteration 136 finished in 57 ms
Iteration 137 finished in 45 ms
Iteration 138 finished in 48 ms
Iteration 139 finished in 47 ms
Iteration 140 finished in 44 ms
Iteration 141 finished in 55 ms
Iteration 142 finished in 48 ms
Iteration 143 finished in 58 ms
Iteration 144 finished in 45 ms
Iteration 145 finished in 46 ms
Iteration 146 finished in 52 ms
Iteration 147 finished in 50 ms
Iteration 148 finished in 60 ms
Iteration 149 finished in 44 ms
Iteration 150 finished in 46 ms
Iteration 151 finished in 46 ms
Iteration 152 finished in 48 ms
Iteration 153 finished in 60 ms
Iteration 154 finished in 52 ms
Iteration 155 finished in 45 ms
Iteration 156 finished in 47 ms
Iteration 157 finished in 48 ms
Iteration 158 finished in 46 ms
Iteration 159 finished in 61 ms
Iteration 160 finished in 50 ms
Iteration 161 finished in 42 ms
Iteration 162 finished in 49 ms
Iteration 163 finished in 46 ms
Iteration 164 finished in 50 ms
Iteration 165 finished in 56 ms
Iteration 166 finished in 43 ms
Iteration 167 finished in 50 ms
Iteration 168 finished in 49 ms
Iteration 169 finished in 58 ms
Iteration 170 finished in 46 ms
Iteration 171 finished in 56 ms
Iteration 172 finished in 48 ms
Iteration 173 finished in 48 ms
Iteration 174 finished in 49 ms
ran 175 iterations in 10.0 s (57 ms per itr)
[info] - Scheduling speed -- small job on a small cluster (10 seconds, 969 milliseconds)
Iteration 0 finished in 2.0 s
Iteration 1 finished in 1.8 s
Iteration 2 finished in 1.7 s
Iteration 3 finished in 1.7 s
Iteration 4 finished in 1.8 s
Iteration 5 finished in 1.7 s
ran 6 iterations in 10.7 s (1.8 s per itr)
[info] - COMPARE C Scheduling speed -- large job on a small cluster (10 seconds, 761 milliseconds)
Iteration 0 finished in 1.8 s
Iteration 1 finished in 1.7 s
Iteration 2 finished in 1.7 s
Iteration 3 finished in 1.7 s
Iteration 4 finished in 1.7 s
Iteration 5 finished in 1.7 s
ran 6 iterations in 10.4 s (1.7 s per itr)
[info] - COMPARE C Scheduling speed -- large job on a small cluster with advanced blacklist (10 seconds, 420 milliseconds)
Iteration 0 finished in 2.5 s
Iteration 1 finished in 2.4 s
Iteration 2 finished in 2.4 s
Iteration 3 finished in 2.4 s
Iteration 4 finished in 2.3 s
ran 5 iterations in 11.9 s (2.4 s per itr)
[info] - COMPARE A Scheduling speed -- large job on a super node (11 seconds, 968 milliseconds)
Iteration 0 finished in 1.8 s
Iteration 1 finished in 1.8 s
Iteration 2 finished in 1.8 s
Iteration 3 finished in 1.8 s
Iteration 4 finished in 1.8 s
Iteration 5 finished in 1.8 s
ran 6 iterations in 10.8 s (1.8 s per itr)
[info] - COMPARE A Scheduling speed -- large job on 50 node cluster (10 seconds, 887 milliseconds)
Iteration 0 finished in 1.8 s
Iteration 1 finished in 1.8 s
Iteration 2 finished in 1.7 s
Iteration 3 finished in 1.8 s
Iteration 4 finished in 1.8 s
Iteration 5 finished in 1.8 s
ran 6 iterations in 10.7 s (1.8 s per itr)
[info] - COMPARE A Scheduling speed -- large job on 100 node cluster (10 seconds, 726 milliseconds)
Iteration 0 finished in 2.0 s
Iteration 1 finished in 2.0 s
Iteration 2 finished in 2.0 s
Iteration 3 finished in 2.0 s
Iteration 4 finished in 2.0 s
Iteration 5 finished in 2.1 s
ran 6 iterations in 12.0 s (2.0 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 200 node cluster (12 seconds, 39 milliseconds)
Iteration 0 finished in 2.2 s
Iteration 1 finished in 2.3 s
Iteration 2 finished in 2.3 s
Iteration 3 finished in 2.2 s
Iteration 4 finished in 2.2 s
ran 5 iterations in 11.4 s (2.3 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 300 node cluster (11 seconds, 388 milliseconds)
Iteration 0 finished in 4.1 s
Iteration 1 finished in 4.4 s
Iteration 2 finished in 4.3 s
ran 3 iterations in 12.9 s (4.3 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 400 node cluster (12 seconds, 904 milliseconds)
Iteration 0 finished in 7.7 s
Iteration 1 finished in 7.4 s
ran 2 iterations in 15.1 s (7.6 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 450 node cluster (15 seconds, 138 milliseconds)
Iteration 0 finished in 19.0 s
ran 1 iterations in 19.0 s (19.0 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 500 node cluster (18 seconds, 999 milliseconds)
Iteration 0 finished in 28.5 s
ran 1 iterations in 28.5 s (28.5 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 550 node cluster (28 seconds, 536 milliseconds)
Iteration 0 finished in 1.8 s
Iteration 1 finished in 1.8 s
Iteration 2 finished in 1.8 s
Iteration 3 finished in 1.8 s
Iteration 4 finished in 1.8 s
Iteration 5 finished in 1.9 s
ran 6 iterations in 10.8 s (1.8 s per itr)
[info] - COMPARE B: Lots of nodes (10 seconds, 790 milliseconds)
Iteration 0 finished in 1.7 s
Iteration 1 finished in 1.8 s
Iteration 2 finished in 1.8 s
Iteration 3 finished in 1.8 s
Iteration 4 finished in 1.8 s
Iteration 5 finished in 1.9 s
ran 6 iterations in 10.6 s (1.8 s per itr)
[info] - COMPARE B: Lots of executors, one node (10 seconds, 667 milliseconds)
Iteration 0 finished in 1.7 s
Iteration 1 finished in 1.7 s
Iteration 2 finished in 1.7 s
Iteration 3 finished in 1.7 s
Iteration 4 finished in 1.7 s
Iteration 5 finished in 1.7 s
ran 6 iterations in 10.4 s (1.7 s per itr)
[info] - COMPARE B: Super executor (10 seconds, 398 milliseconds)
Bad execs = Set(0)
Iteration 0 finished in 12.8 s
ran 1 iterations in 12.8 s (12.8 s per itr)
[info] - COMPARE D bad exec with simple blacklist (12 seconds, 854 milliseconds)
Bad execs = Set(0, 15)
Iteration 0 finished in 23.7 s
ran 1 iterations in 23.7 s (23.7 s per itr)
[info] - COMPARE D two bad execs with simple blacklist (23 seconds, 775 milliseconds)
Bad execs = Set(0)
Iteration 0 finished in 12.5 s
ran 1 iterations in 12.5 s (12.5 s per itr)
[info] - COMPARE D bad exec with advanced blacklist (12 seconds, 515 milliseconds)

w_new_blacklist.txt

# as of https://github.com/squito/spark/commit/4ba65b1e62a5510c8de0e3884b611a420667750f
[info] SchedulerPerformanceSuite:
Iteration 0 finished in 528 ms
Iteration 1 finished in 183 ms
Iteration 2 finished in 146 ms
Iteration 3 finished in 104 ms
Iteration 4 finished in 99 ms
Iteration 5 finished in 89 ms
Iteration 6 finished in 74 ms
Iteration 7 finished in 67 ms
Iteration 8 finished in 81 ms
Iteration 9 finished in 62 ms
Iteration 10 finished in 61 ms
Iteration 11 finished in 67 ms
Iteration 12 finished in 73 ms
Iteration 13 finished in 62 ms
Iteration 14 finished in 66 ms
Iteration 15 finished in 67 ms
Iteration 16 finished in 65 ms
Iteration 17 finished in 69 ms
Iteration 18 finished in 80 ms
Iteration 19 finished in 59 ms
Iteration 20 finished in 61 ms
Iteration 21 finished in 68 ms
Iteration 22 finished in 66 ms
Iteration 23 finished in 78 ms
Iteration 24 finished in 62 ms
Iteration 25 finished in 65 ms
Iteration 26 finished in 64 ms
Iteration 27 finished in 71 ms
Iteration 28 finished in 68 ms
Iteration 29 finished in 57 ms
Iteration 30 finished in 58 ms
Iteration 31 finished in 56 ms
Iteration 32 finished in 59 ms
Iteration 33 finished in 58 ms
Iteration 34 finished in 72 ms
Iteration 35 finished in 60 ms
Iteration 36 finished in 53 ms
Iteration 37 finished in 52 ms
Iteration 38 finished in 50 ms
Iteration 39 finished in 51 ms
Iteration 40 finished in 64 ms
Iteration 41 finished in 52 ms
Iteration 42 finished in 57 ms
Iteration 43 finished in 55 ms
Iteration 44 finished in 52 ms
Iteration 45 finished in 65 ms
Iteration 46 finished in 55 ms
Iteration 47 finished in 55 ms
Iteration 48 finished in 57 ms
Iteration 49 finished in 52 ms
Iteration 50 finished in 51 ms
Iteration 51 finished in 69 ms
Iteration 52 finished in 62 ms
Iteration 53 finished in 64 ms
Iteration 54 finished in 68 ms
Iteration 55 finished in 52 ms
Iteration 56 finished in 60 ms
Iteration 57 finished in 65 ms
Iteration 58 finished in 51 ms
Iteration 59 finished in 52 ms
Iteration 60 finished in 52 ms
Iteration 61 finished in 54 ms
Iteration 62 finished in 67 ms
Iteration 63 finished in 65 ms
Iteration 64 finished in 50 ms
Iteration 65 finished in 48 ms
Iteration 66 finished in 70 ms
Iteration 67 finished in 52 ms
Iteration 68 finished in 62 ms
Iteration 69 finished in 58 ms
Iteration 70 finished in 61 ms
Iteration 71 finished in 65 ms
Iteration 72 finished in 65 ms
Iteration 73 finished in 58 ms
Iteration 74 finished in 49 ms
Iteration 75 finished in 45 ms
Iteration 76 finished in 49 ms
Iteration 77 finished in 49 ms
Iteration 78 finished in 47 ms
Iteration 79 finished in 55 ms
Iteration 80 finished in 47 ms
Iteration 81 finished in 54 ms
Iteration 82 finished in 48 ms
Iteration 83 finished in 50 ms
Iteration 84 finished in 50 ms
Iteration 85 finished in 49 ms
Iteration 86 finished in 66 ms
Iteration 87 finished in 44 ms
Iteration 88 finished in 49 ms
Iteration 89 finished in 46 ms
Iteration 90 finished in 58 ms
Iteration 91 finished in 63 ms
Iteration 92 finished in 52 ms
Iteration 93 finished in 44 ms
Iteration 94 finished in 47 ms
Iteration 95 finished in 54 ms
Iteration 96 finished in 45 ms
Iteration 97 finished in 45 ms
Iteration 98 finished in 69 ms
Iteration 99 finished in 51 ms
Iteration 100 finished in 51 ms
Iteration 101 finished in 62 ms
Iteration 102 finished in 43 ms
Iteration 103 finished in 57 ms
Iteration 104 finished in 64 ms
Iteration 105 finished in 55 ms
Iteration 106 finished in 51 ms
Iteration 107 finished in 61 ms
Iteration 108 finished in 45 ms
Iteration 109 finished in 45 ms
Iteration 110 finished in 47 ms
Iteration 111 finished in 52 ms
Iteration 112 finished in 43 ms
Iteration 113 finished in 70 ms
Iteration 114 finished in 50 ms
Iteration 115 finished in 67 ms
Iteration 116 finished in 48 ms
Iteration 117 finished in 62 ms
Iteration 118 finished in 59 ms
Iteration 119 finished in 53 ms
Iteration 120 finished in 54 ms
Iteration 121 finished in 45 ms
Iteration 122 finished in 46 ms
Iteration 123 finished in 52 ms
Iteration 124 finished in 54 ms
Iteration 125 finished in 43 ms
Iteration 126 finished in 51 ms
Iteration 127 finished in 50 ms
Iteration 128 finished in 51 ms
Iteration 129 finished in 55 ms
Iteration 130 finished in 47 ms
Iteration 131 finished in 48 ms
Iteration 132 finished in 50 ms
Iteration 133 finished in 50 ms
Iteration 134 finished in 50 ms
Iteration 135 finished in 53 ms
Iteration 136 finished in 47 ms
Iteration 137 finished in 49 ms
Iteration 138 finished in 50 ms
Iteration 139 finished in 53 ms
Iteration 140 finished in 48 ms
Iteration 141 finished in 52 ms
Iteration 142 finished in 50 ms
Iteration 143 finished in 47 ms
Iteration 144 finished in 50 ms
Iteration 145 finished in 51 ms
Iteration 146 finished in 56 ms
Iteration 147 finished in 50 ms
Iteration 148 finished in 46 ms
Iteration 149 finished in 46 ms
Iteration 150 finished in 54 ms
Iteration 151 finished in 49 ms
Iteration 152 finished in 52 ms
Iteration 153 finished in 56 ms
Iteration 154 finished in 64 ms
Iteration 155 finished in 52 ms
Iteration 156 finished in 48 ms
Iteration 157 finished in 42 ms
Iteration 158 finished in 50 ms
Iteration 159 finished in 47 ms
Iteration 160 finished in 53 ms
Iteration 161 finished in 51 ms
Iteration 162 finished in 52 ms
Iteration 163 finished in 51 ms
Iteration 164 finished in 48 ms
ran 165 iterations in 10.0 s (60 ms per itr)
[info] - Scheduling speed -- small job on a small cluster (11 seconds, 12 milliseconds)
Iteration 0 finished in 2.8 s
Iteration 1 finished in 2.7 s
Iteration 2 finished in 2.8 s
Iteration 3 finished in 2.8 s
ran 4 iterations in 11.0 s (2.8 s per itr)
[info] - COMPARE C Scheduling speed -- large job on a small cluster (11 seconds, 52 milliseconds)
Iteration 0 finished in 2.8 s
Iteration 1 finished in 2.9 s
Iteration 2 finished in 2.8 s
Iteration 3 finished in 2.7 s
ran 4 iterations in 11.1 s (2.8 s per itr)
[info] - COMPARE C Scheduling speed -- large job on a small cluster with advanced blacklist (11 seconds, 125 milliseconds)
Iteration 0 finished in 2.6 s
Iteration 1 finished in 2.7 s
Iteration 2 finished in 2.7 s
Iteration 3 finished in 2.7 s
ran 4 iterations in 10.7 s (2.7 s per itr)
[info] - COMPARE A Scheduling speed -- large job on a super node (10 seconds, 780 milliseconds)
Iteration 0 finished in 3.4 s
Iteration 1 finished in 3.2 s
Iteration 2 finished in 2.6 s
Iteration 3 finished in 2.6 s
ran 4 iterations in 11.8 s (2.9 s per itr)
[info] - COMPARE A Scheduling speed -- large job on 50 node cluster (11 seconds, 808 milliseconds)
Iteration 0 finished in 2.6 s
Iteration 1 finished in 2.7 s
Iteration 2 finished in 2.9 s
Iteration 3 finished in 2.8 s
ran 4 iterations in 11.0 s (2.8 s per itr)
[info] - COMPARE A Scheduling speed -- large job on 100 node cluster (11 seconds, 34 milliseconds)
Iteration 0 finished in 2.7 s
Iteration 1 finished in 2.4 s
Iteration 2 finished in 2.3 s
Iteration 3 finished in 2.5 s
Iteration 4 finished in 2.5 s
ran 5 iterations in 12.4 s (2.5 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 200 node cluster (12 seconds, 427 milliseconds)
Iteration 0 finished in 2.4 s
Iteration 1 finished in 2.9 s
Iteration 2 finished in 2.6 s
Iteration 3 finished in 2.6 s
ran 4 iterations in 10.4 s (2.6 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 300 node cluster (10 seconds, 457 milliseconds)
Iteration 0 finished in 2.6 s
Iteration 1 finished in 2.6 s
Iteration 2 finished in 2.6 s
Iteration 3 finished in 2.7 s
ran 4 iterations in 10.5 s (2.6 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 400 node cluster (10 seconds, 497 milliseconds)
Iteration 0 finished in 2.5 s
Iteration 1 finished in 2.6 s
Iteration 2 finished in 2.8 s
Iteration 3 finished in 2.6 s
ran 4 iterations in 10.5 s (2.6 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 450 node cluster (10 seconds, 560 milliseconds)
Iteration 0 finished in 2.8 s
Iteration 1 finished in 2.5 s
Iteration 2 finished in 2.5 s
Iteration 3 finished in 2.8 s
ran 4 iterations in 10.6 s (2.7 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 500 node cluster (10 seconds, 650 milliseconds)
Iteration 0 finished in 3.0 s
Iteration 1 finished in 2.8 s
Iteration 2 finished in 2.6 s
Iteration 3 finished in 2.6 s
ran 4 iterations in 11.1 s (2.8 s per itr)
[info] - COMPARE A: Scheduling speed -- large job on 550 node cluster (11 seconds, 94 milliseconds)
Iteration 0 finished in 2.6 s
Iteration 1 finished in 2.5 s
Iteration 2 finished in 2.8 s
Iteration 3 finished in 2.6 s
ran 4 iterations in 10.4 s (2.6 s per itr)
[info] - COMPARE B: Lots of nodes (10 seconds, 463 milliseconds)
Iteration 0 finished in 3.6 s
Iteration 1 finished in 3.7 s
Iteration 2 finished in 4.0 s
ran 3 iterations in 11.2 s (3.7 s per itr)
[info] - COMPARE B: Lots of executors, one node (11 seconds, 276 milliseconds)
Iteration 0 finished in 2.7 s
Iteration 1 finished in 5.8 s
Iteration 2 finished in 3.1 s
ran 3 iterations in 11.6 s (3.9 s per itr)
[info] - COMPARE B: Super executor (11 seconds, 658 milliseconds)
Bad execs = Set(0)
Iteration 0 finished in 3.8 s
Iteration 1 finished in 2.9 s
Iteration 2 finished in 2.7 s
Iteration 3 finished in 2.8 s
ran 4 iterations in 12.2 s (3.0 s per itr)
[info] - COMPARE D bad exec with simple blacklist (12 seconds, 235 milliseconds)
Bad execs = Set(0, 15)
Iteration 0 finished in 3.4 s
Iteration 1 finished in 3.2 s
Iteration 2 finished in 3.0 s
Iteration 3 finished in 2.8 s
ran 4 iterations in 12.3 s (3.1 s per itr)
[info] - COMPARE D two bad execs with simple blacklist (12 seconds, 323 milliseconds)
Bad execs = Set(0)
Iteration 0 finished in 3.1 s
Iteration 1 finished in 3.5 s
Iteration 2 finished in 2.7 s
Iteration 3 finished in 2.7 s
ran 4 iterations in 12.1 s (3.0 s per itr)
[info] - COMPARE D bad exec with advanced blacklist (12 seconds, 101 milliseconds)
Bad execs = Set()
Iteration 0 finished in 3.3 s
Iteration 1 finished in 3.4 s
Iteration 2 finished in 3.3 s
Iteration 3 finished in 3.5 s
ran 4 iterations in 13.4 s (3.4 s per itr)
[info] - COMPARE D bad host with advanced blacklist (13 seconds, 465 milliseconds)
Bad execs = Set(0)
Iteration 0 finished in 3.4 s
Iteration 1 finished in 2.8 s
Iteration 2 finished in 2.8 s
Iteration 3 finished in 2.8 s
ran 4 iterations in 11.8 s (2.9 s per itr)
[info] - COMPARE D bad exec and host with advanced blacklist (11 seconds, 826 milliseconds)