gistfile1.txt

$ time cargo bench -- --verbose 2>&1 |ts -i
00:00:00    Compiling rethnet_evm v0.1.0-dev (/home/gene/dev/nomiclabs/rethnet/crates/rethnet_evm)
00:00:04     Finished bench [optimized] target(s) in 4.59s
00:00:00      Running benches/state_ref_basic.rs (/home/gene/dev/nomiclabs/rethnet/target/release/deps/state_ref_basic-a361ed5b0ff66871)
00:00:01 Benchmarking layered_create_with_{}_addresses/100
00:00:00 Benchmarking layered_create_with_{}_addresses/100: Warming up for 3.0000 s
00:00:04 Benchmarking layered_create_with_{}_addresses/100: Collecting 10 samples in estimated 5.1261 s (330 iterations)
00:00:05 Benchmarking layered_create_with_{}_addresses/100: Analyzing
00:00:00 layered_create_with_{}_addresses/100
00:00:00                         time:   [15.447 ms 15.563 ms 15.713 ms]
00:00:00                         change: [-0.7018% -0.1099% +0.5794%] (p = 0.76 > 0.10)
00:00:00                         No change in performance detected.
00:00:00 Found 1 outliers among 10 measurements (10.00%)
00:00:00   1 (10.00%) high mild
00:00:00 slope  [15.447 ms 15.713 ms] R^2            [0.9966048 0.9958521]
00:00:00 mean   [15.442 ms 15.632 ms] std. dev.      [66.093 µs 211.86 µs]
00:00:00 median [15.401 ms 15.632 ms] med. abs. dev. [26.788 µs 260.94 µs]
00:00:00 
00:00:00 Benchmarking layered_create_with_{}_addresses/500
00:00:00 Benchmarking layered_create_with_{}_addresses/500: Warming up for 3.0000 s
00:00:06 Benchmarking layered_create_with_{}_addresses/500: Collecting 10 samples in estimated 7.8666 s (20 iterations)
00:00:08 Benchmarking layered_create_with_{}_addresses/500: Analyzing
00:00:00 layered_create_with_{}_addresses/500
00:00:00                         time:   [394.90 ms 398.82 ms 404.64 ms]
00:00:00                         change: [-0.5367% +0.5700% +2.1717%] (p = 0.51 > 0.10)
00:00:00                         No change in performance detected.
00:00:00 Found 1 outliers among 10 measurements (10.00%)
00:00:00   1 (10.00%) high severe
00:00:00 mean   [394.90 ms 404.64 ms] std. dev.      [1.5398 ms 13.178 ms]
00:00:00 median [394.03 ms 398.97 ms] med. abs. dev. [510.41 µs 7.1748 ms]
00:00:00 
00:00:00 Benchmarking layered_create_with_{}_addresses/1000
00:00:00 Benchmarking layered_create_with_{}_addresses/1000: Warming up for 3.0000 s
00:00:05 
00:00:00 Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 16.0s.
00:00:00 Benchmarking layered_create_with_{}_addresses/1000: Collecting 10 samples in estimated 16.005 s (10 iterations)
00:00:16 Benchmarking layered_create_with_{}_addresses/1000: Analyzing
00:00:00 layered_create_with_{}_addresses/1000
00:00:00                         time:   [1.6313 s 1.6461 s 1.6625 s]
00:00:00                         change: [-2.4472% -1.1453% +0.3431%] (p = 0.14 > 0.10)
00:00:00                         No change in performance detected.
00:00:00 Found 1 outliers among 10 measurements (10.00%)
00:00:00   1 (10.00%) high mild
00:00:00 mean   [1.6313 s 1.6625 s] std. dev.      [12.279 ms 36.176 ms]
00:00:00 median [1.6264 s 1.6570 s] med. abs. dev. [569.85 µs 45.314 ms]
00:00:00 
00:00:00 Benchmarking layered_create_with_{}_addresses/2000
00:00:00 Benchmarking layered_create_with_{}_addresses/2000: Warming up for 3.0000 s
00:00:07 
00:00:00 Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 66.2s.
00:00:00 Benchmarking layered_create_with_{}_addresses/2000: Collecting 10 samples in estimated 66.234 s (10 iterations)
00:01:09 Benchmarking layered_create_with_{}_addresses/2000: Analyzing
00:00:00 layered_create_with_{}_addresses/2000
00:00:00                         time:   [6.8042 s 6.8449 s 6.8768 s]
00:00:00                         change: [-28.542% -18.491% -6.1247%] (p = 0.01 < 0.10)
00:00:00                         Performance has improved.
00:00:00 Found 2 outliers among 10 measurements (20.00%)
00:00:00   1 (10.00%) low severe
00:00:00   1 (10.00%) high mild
00:00:00 mean   [6.8042 s 6.8768 s] std. dev.      [17.053 ms 89.427 ms]
00:00:00 median [6.8324 s 6.8770 s] med. abs. dev. [6.0422 ms 73.979 ms]
00:00:00 
00:00:00 Benchmarking layered_basic_with_clone_with_{}_addresses/100
00:00:00 Benchmarking layered_basic_with_clone_with_{}_addresses/100: Warming up for 3.0000 s
00:00:06 Benchmarking layered_basic_with_clone_with_{}_addresses/100: Collecting 10 samples in estimated 5.0010 s (209275 iterations)
00:00:02 Benchmarking layered_basic_with_clone_with_{}_addresses/100: Analyzing
00:00:00 layered_basic_with_clone_with_{}_addresses/100
00:00:00                         time:   [3.0822 µs 3.1345 µs 3.1968 µs]
00:00:00                         change: [-30.961% -20.021% -7.9254%] (p = 0.01 < 0.10)
00:00:00                         Performance has improved.
00:00:00 Found 2 outliers among 10 measurements (20.00%)
00:00:00   2 (20.00%) high severe
00:00:00 slope  [3.0822 µs 3.1968 µs] R^2            [0.9869460 0.9851294]
00:00:00 mean   [3.0803 µs 3.1747 µs] std. dev.      [20.234 ns 103.64 ns]
00:00:00 median [3.0737 µs 3.1818 µs] med. abs. dev. [5.8820 ns 116.23 ns]
00:00:00 
00:00:01 Benchmarking layered_basic_with_clone_with_{}_addresses/500
00:00:00 Benchmarking layered_basic_with_clone_with_{}_addresses/500: Warming up for 3.0000 s
00:00:14 Benchmarking layered_basic_with_clone_with_{}_addresses/500: Collecting 10 samples in estimated 5.0004 s (23650 iterations)
00:00:02 Benchmarking layered_basic_with_clone_with_{}_addresses/500: Analyzing
00:00:00 layered_basic_with_clone_with_{}_addresses/500
00:00:00                         time:   [25.243 µs 27.088 µs 28.307 µs]
00:00:00                         change: [-28.350% -19.236% -9.8219%] (p = 0.00 < 0.10)
00:00:00                         Performance has improved.
00:00:00 slope  [25.243 µs 28.307 µs] R^2            [0.8781979 0.9078195]
00:00:00 mean   [25.502 µs 27.812 µs] std. dev.      [1.0909 µs 2.4637 µs]
00:00:00 median [25.095 µs 28.845 µs] med. abs. dev. [162.68 ns 3.7091 µs]
00:00:00 
00:00:03 Benchmarking layered_basic_with_clone_with_{}_addresses/1000
00:00:00 Benchmarking layered_basic_with_clone_with_{}_addresses/1000: Warming up for 3.0000 s
00:00:05 Benchmarking layered_basic_with_clone_with_{}_addresses/1000: Collecting 10 samples in estimated 5.0048 s (14905 iterations)
00:00:03 Benchmarking layered_basic_with_clone_with_{}_addresses/1000: Analyzing
00:00:00 layered_basic_with_clone_with_{}_addresses/1000
00:00:00                         time:   [49.528 µs 50.631 µs 52.038 µs]
00:00:00                         change: [-18.758% -11.898% -4.7799%] (p = 0.01 < 0.10)
00:00:00                         Performance has improved.
00:00:00 Found 1 outliers among 10 measurements (10.00%)
00:00:00   1 (10.00%) high severe
00:00:00 slope  [49.528 µs 52.038 µs] R^2            [0.9690989 0.9637597]
00:00:00 mean   [49.528 µs 54.204 µs] std. dev.      [1.2963 µs 5.8336 µs]
00:00:00 median [49.338 µs 52.995 µs] med. abs. dev. [154.71 ns 5.0186 µs]
00:00:00 
00:00:11 Benchmarking layered_basic_with_clone_with_{}_addresses/2000
00:00:00 Benchmarking layered_basic_with_clone_with_{}_addresses/2000: Warming up for 3.0000 s
00:00:05 Benchmarking layered_basic_with_clone_with_{}_addresses/2000: Collecting 10 samples in estimated 5.0239 s (7150 iterations)
00:00:02 Benchmarking layered_basic_with_clone_with_{}_addresses/2000: Analyzing
00:00:00 layered_basic_with_clone_with_{}_addresses/2000
00:00:00                         time:   [60.943 µs 63.075 µs 68.415 µs]
00:00:00                         change: [-45.808% -40.418% -34.843%] (p = 0.00 < 0.10)
00:00:00                         Performance has improved.
00:00:00 slope  [60.943 µs 68.415 µs] R^2            [0.7725459 0.6932251]
00:00:00 mean   [63.232 µs 74.847 µs] std. dev.      [5.0714 µs 13.056 µs]
00:00:00 median [60.638 µs 74.748 µs] med. abs. dev. [176.64 ns 17.153 µs]
00:00:00 
00:00:00 Benchmarking layered_basic_with_{}_addresses/100
00:00:00 Benchmarking layered_basic_with_{}_addresses/100: Warming up for 3.0000 s
00:00:04 Benchmarking layered_basic_with_{}_addresses/100: Collecting 10 samples in estimated 5.1729 s (330 iterations)
00:00:05 Benchmarking layered_basic_with_{}_addresses/100: Analyzing
00:00:01 layered_basic_with_{}_addresses/100
00:00:00                         time:   [5.1636 µs 5.2928 µs 5.3918 µs]
00:00:00                         change: [-52.004% -48.114% -43.670%] (p = 0.00 < 0.10)
00:00:00                         Performance has improved.
00:00:00 Found 4 outliers among 10 measurements (40.00%)
00:00:00   2 (20.00%) low severe
00:00:00   2 (20.00%) high severe
00:00:00 slope  [5.1636 µs 5.3918 µs] R^2            [0.9721890 0.9763476]
00:00:00 mean   [5.1967 µs 5.5740 µs] std. dev.      [124.30 ns 440.75 ns]
00:00:00 median [5.1550 µs 5.5396 µs] med. abs. dev. [7.7466 ns 539.79 ns]
00:00:00 
00:00:00 Benchmarking layered_basic_with_{}_addresses/500
00:00:00 Benchmarking layered_basic_with_{}_addresses/500: Warming up for 3.0000 s
00:00:06 Benchmarking layered_basic_with_{}_addresses/500: Collecting 10 samples in estimated 8.2600 s (20 iterations)
00:00:08 Benchmarking layered_basic_with_{}_addresses/500: Analyzing
00:00:00 layered_basic_with_{}_addresses/500
00:00:00                         time:   [32.958 µs 41.268 µs 50.409 µs]
00:00:00                         change: [-18.886% +6.3175% +36.751%] (p = 0.67 > 0.10)
00:00:00                         No change in performance detected.
00:00:00 mean   [32.958 µs 50.409 µs] std. dev.      [7.5695 µs 17.554 µs]
00:00:00 median [28.939 µs 56.623 µs] med. abs. dev. [1.0886 µs 23.507 µs]
00:00:00 
00:00:00 Benchmarking layered_basic_with_{}_addresses/1000
00:00:00 Benchmarking layered_basic_with_{}_addresses/1000: Warming up for 3.0000 s
00:00:05 
00:00:00 Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 16.8s.
00:00:00 Benchmarking layered_basic_with_{}_addresses/1000: Collecting 10 samples in estimated 16.770 s (10 iterations)
00:00:17 Benchmarking layered_basic_with_{}_addresses/1000: Analyzing
00:00:00 layered_basic_with_{}_addresses/1000
00:00:00                         time:   [63.077 µs 75.270 µs 91.411 µs]
00:00:00                         change: [-52.671% -35.024% -6.9283%] (p = 0.05 < 0.10)
00:00:00                         Performance has improved.
00:00:00 Found 1 outliers among 10 measurements (10.00%)
00:00:00   1 (10.00%) high mild
00:00:00 mean   [63.077 µs 91.411 µs] std. dev.      [9.0613 µs 35.536 µs]
00:00:00 median [57.465 µs 83.525 µs] med. abs. dev. [2.7102 µs 31.001 µs]
00:00:00 
00:00:00 Benchmarking layered_basic_with_{}_addresses/2000
00:00:00 Benchmarking layered_basic_with_{}_addresses/2000: Warming up for 3.0000 s
00:00:09 
00:00:00 Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 95.0s.
00:00:00 Benchmarking layered_basic_with_{}_addresses/2000: Collecting 10 samples in estimated 95.049 s (10 iterations)
00:01:28 Benchmarking layered_basic_with_{}_addresses/2000: Analyzing
00:00:00 layered_basic_with_{}_addresses/2000
00:00:00                         time:   [178.35 µs 227.31 µs 276.86 µs]
00:00:00                         change: [-26.099% +4.6396% +48.921%] (p = 0.81 > 0.10)
00:00:00                         No change in performance detected.
00:00:00 mean   [178.35 µs 276.86 µs] std. dev.      [52.641 µs 102.17 µs]
00:00:00 median [143.46 µs 289.98 µs] med. abs. dev. [22.492 µs 146.68 µs]
00:00:00 

real	5m22.826s
user	5m18.202s
sys	0m14.179s