gistfile1.txt

1> merklet_bench:main([10000, 30]).
x build-old
+ build-new
+--------------------------------------------------------------------------+
|+++++++++                             x x x x  xxxxxxx x  xx  x xx       x|
|+++++                                   x        xxxx  x  x      x        |
|+++++                                   x              x                  |
|++++                                    x                                 |
|++ +                                    x                                 |
|++                                                                        |
|+                                                                         |
|+                                                                         |
|                                           |_______MA_______|             |
||_A_|                                                                     |
+--------------------------------------------------------------------------+
------

Dataset: x N=30 CI=95.0000
Statistic     Value     [         Bias] (Bootstrapped LB‥UB)
Min:         8.62463e+5
1st Qu.      9.56584e+5
Median:      1.06064e+6
3rd Qu.      1.17556e+6
Max:         1.41198e+6
Average:     1.07129e+6 [      62.3881] (   1.02491e+6 ‥    1.12412e+6)
Std. Dev:    1.40137e+5 [     -3257.44] (   1.14763e+5 ‥    1.80939e+5)

Outliers: 0/0 = 0 (μ=1.07135e+6, σ=1.36880e+5)
        Outlier variance:      0.685086 (severe, the data set is probably unusable)

------

Dataset: + N=30 CI=95.0000
Statistic     Value     [         Bias] (Bootstrapped LB‥UB)
Min:         2.54434e+5
1st Qu.      2.60592e+5
Median:      2.86980e+5
3rd Qu.      3.02758e+5
Max:         3.74902e+5
Average:     2.91122e+5 [     -35.5134] (   2.81147e+5 ‥    3.04888e+5)
Std. Dev:    3.30155e+4 [     -955.652] (   2.45768e+4 ‥    4.37154e+4)

Outliers: 0/2 = 2 (μ=2.91087e+5, σ=3.20598e+4)
        Outlier variance:      0.617090 (severe, the data set is probably unusable)

Difference at 95.0% confidence
        -7.80165e+5 ± 5.26245e+4
        -72.8250% ± 4.91227%
        (Student's t, pooled s = 1.01805e+5)
----

2> merklet_bench:main([100000, 100]).
x build-new
+ build-array
+--------------------------------------------------------------------------+
|+++++++++++++++*****+**x******x**xxxxxx*xx*x    xx         +      x x    x|
|    +++++++++++***** **x**xxxxxxxxxxxxx  x x                              |
|     ++++++ ++++***+ **xxxxxxxxx x x xx                                   |
|      + +++ ++++* x+ + x xxxxxxx x x  x                                   |
|      + + + +++++ x+   x   x x x x    x                                   |
|      + + +    +  x    x   x x                                            |
|        + +    +                                                          |
|        +      +                                                          |
|        +                                                                 |
|                   |________M_A_________|                                 |
|      |______M_A________|                                                 |
+--------------------------------------------------------------------------+
------

Dataset: x N=100 CI=95.0000
Statistic     Value     [         Bias] (Bootstrapped LB‥UB)
Min:         5.36220e+6
1st Qu.      5.94420e+6
Median:      6.35960e+6
3rd Qu.      6.81369e+6
Max:         9.59121e+6
Average:     6.44504e+6 [      534.022] (   6.31540e+6 ‥    6.60901e+6)
Std. Dev:    7.59651e+5 [  -1.04405e+4] (   6.13886e+5 ‥    9.95928e+5)

Outliers: 0/3 = 3 (μ=6.44557e+6, σ=7.49211e+5)
        Outlier variance:      0.841874 (severe, the data set is probably unusable)

------

Dataset: + N=100 CI=95.0000
Statistic     Value     [         Bias] (Bootstrapped LB‥UB)
Min:         4.29937e+6
1st Qu.      4.89278e+6
Median:      5.27239e+6
3rd Qu.      5.64522e+6
Max:         8.59931e+6
Average:     5.35995e+6 [      131.789] (   5.24601e+6 ‥    5.50803e+6)
Std. Dev:    6.53010e+5 [     -9201.50] (   5.25371e+5 ‥    9.30069e+5)

Outliers: 0/3 = 3 (μ=5.36008e+6, σ=6.43808e+5)
        Outlier variance:      0.852214 (severe, the data set is probably unusable)

Difference at 95.0% confidence
        -1.08509e+6 ± 1.96342e+5
        -16.8361% ± 3.04640%
        (Student's t, pooled s = 7.08340e+5)
------

{profiles, [
 ... 
 {bench, [
    {project_app_dirs, ["apps/*", "lib/*", "bench/*", "."]},
    {deps, [
        {eministat,
          {git, "https://github.com/jlouis/eministat.git", {branch, "master"}}}
    ]}
  ]}
]}.