cc.log

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out

Gnuplot not found, disabling plotting
Benchmarking hashbrown_rwlock_insert_100k_u64_u64
Benchmarking hashbrown_rwlock_insert_100k_u64_u64: Warming up for 3.0000 s
Benchmarking hashbrown_rwlock_insert_100k_u64_u64: Collecting 100 samples in estimated 79.054 s (5050 iterations)
Benchmarking hashbrown_rwlock_insert_100k_u64_u64: Analyzing
hashbrown_rwlock_insert_100k_u64_u64
                        time:   [14.733 ms 14.944 ms 15.143 ms]
                        change: [-5.5979% -3.3336% -1.1930%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) low mild

Benchmarking contrie_conmap_insert_100k_u64_u64
Benchmarking contrie_conmap_insert_100k_u64_u64: Warming up for 3.0000 s
Benchmarking contrie_conmap_insert_100k_u64_u64: Collecting 100 samples in estimated 204.88 s (5050 iterations)
Benchmarking contrie_conmap_insert_100k_u64_u64: Analyzing
contrie_conmap_insert_100k_u64_u64
                        time:   [40.789 ms 41.748 ms 42.853 ms]
                        change: [+4.6559% +6.6250% +8.4604%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high severe

Benchmarking chashmap_insert_100k_u64_u64
Benchmarking chashmap_insert_100k_u64_u64: Warming up for 3.0000 s
Benchmarking chashmap_insert_100k_u64_u64: Collecting 100 samples in estimated 124.83 s (5050 iterations)
Benchmarking chashmap_insert_100k_u64_u64: Analyzing
chashmap_insert_100k_u64_u64
                        time:   [22.837 ms 23.730 ms 24.705 ms]
                        change: [+3.2597% +5.0536% +6.9449%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
  3 (3.00%) high mild
  6 (6.00%) high severe

Benchmarking ccl_dhashmap_insert_100k_u64_u64
Benchmarking ccl_dhashmap_insert_100k_u64_u64: Warming up for 3.0000 s
Benchmarking ccl_dhashmap_insert_100k_u64_u64: Collecting 100 samples in estimated 30.968 s (5050 iterations)
Benchmarking ccl_dhashmap_insert_100k_u64_u64: Analyzing
ccl_dhashmap_insert_100k_u64_u64
                        time:   [5.7333 ms 5.9046 ms 6.1077 ms]
                        change: [+26.508% +30.161% +34.632%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

Benchmarking crossbeam_skiplist_insert_100k_u64_u64
Benchmarking crossbeam_skiplist_insert_100k_u64_u64: Warming up for 3.0000 s
Benchmarking crossbeam_skiplist_insert_100k_u64_u64: Collecting 100 samples in estimated 85.836 s (5050 iterations)
Benchmarking crossbeam_skiplist_insert_100k_u64_u64: Analyzing
crossbeam_skiplist_insert_100k_u64_u64
                        time:   [15.069 ms 15.268 ms 15.490 ms]
                        change: [+17.104% +19.703% +22.480%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high mild

Benchmarking kudzu_insert_100k_u64_u64
Benchmarking kudzu_insert_100k_u64_u64: Warming up for 3.0000 s
Benchmarking kudzu_insert_100k_u64_u64: Collecting 100 samples in estimated 59.447 s (5050 iterations)
Benchmarking kudzu_insert_100k_u64_u64: Analyzing
kudzu_insert_100k_u64_u64
                        time:   [11.234 ms 11.362 ms 11.501 ms]
                        change: [+5.4094% +7.6647% +9.8307%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) high mild
  3 (3.00%) high severe

Benchmarking hashbrown_rwlock_insert_100k_u64_u128x16
Benchmarking hashbrown_rwlock_insert_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking hashbrown_rwlock_insert_100k_u64_u128x16: Collecting 100 samples in estimated 313.59 s (5050 iterations)
Benchmarking hashbrown_rwlock_insert_100k_u64_u128x16: Analyzing
hashbrown_rwlock_insert_100k_u64_u128x16
                        time:   [61.712 ms 62.160 ms 62.647 ms]
                        change: [+1.5245% +2.3038% +3.0505%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Benchmarking contrie_conmap_insert_100k_u64_u128x16
Benchmarking contrie_conmap_insert_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking contrie_conmap_insert_100k_u64_u128x16: Collecting 100 samples in estimated 277.71 s (5050 iterations)
Benchmarking contrie_conmap_insert_100k_u64_u128x16: Analyzing
contrie_conmap_insert_100k_u64_u128x16
                        time:   [56.244 ms 56.692 ms 57.135 ms]
                        change: [+2.5083% +3.6536% +4.7350%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild

Benchmarking chashmap_insert_100k_u64_u128x16
Benchmarking chashmap_insert_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking chashmap_insert_100k_u64_u128x16: Collecting 100 samples in estimated 509.82 s (5050 iterations)
Benchmarking chashmap_insert_100k_u64_u128x16: Analyzing
chashmap_insert_100k_u64_u128x16
                        time:   [95.656 ms 96.150 ms 96.702 ms]
Found 7 outliers among 100 measurements (7.00%)
  2 (2.00%) high mild
  5 (5.00%) high severe

Benchmarking ccl_dhashmap_insert_100k_u64_u128x16
Benchmarking ccl_dhashmap_insert_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking ccl_dhashmap_insert_100k_u64_u128x16: Collecting 100 samples in estimated 203.38 s (5050 iterations)
Benchmarking ccl_dhashmap_insert_100k_u64_u128x16: Analyzing
ccl_dhashmap_insert_100k_u64_u128x16
                        time:   [39.972 ms 40.244 ms 40.559 ms]
Found 8 outliers among 100 measurements (8.00%)
  4 (4.00%) high mild
  4 (4.00%) high severe

Benchmarking crossbeam_skiplist_insert_100k_u64_u128x16
Benchmarking crossbeam_skiplist_insert_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking crossbeam_skiplist_insert_100k_u64_u128x16: Collecting 100 samples in estimated 131.95 s (5050 iterations)
Benchmarking crossbeam_skiplist_insert_100k_u64_u128x16: Analyzing
crossbeam_skiplist_insert_100k_u64_u128x16
                        time:   [27.120 ms 27.649 ms 28.345 ms]
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe

Benchmarking kudzu_insert_100k_u64_u128x16
Benchmarking kudzu_insert_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking kudzu_insert_100k_u64_u128x16: Collecting 100 samples in estimated 129.31 s (5050 iterations)
Benchmarking kudzu_insert_100k_u64_u128x16: Analyzing
kudzu_insert_100k_u64_u128x16
                        time:   [25.586 ms 25.888 ms 26.192 ms]

Benchmarking hashbrown_rwlock_read_100k_u64_u64
Benchmarking hashbrown_rwlock_read_100k_u64_u64: Warming up for 3.0000 s
Benchmarking hashbrown_rwlock_read_100k_u64_u64: Collecting 100 samples in estimated 51.943 s (5050 iterations)
Benchmarking hashbrown_rwlock_read_100k_u64_u64: Analyzing
hashbrown_rwlock_read_100k_u64_u64
                        time:   [10.220 ms 10.243 ms 10.268 ms]
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) low mild
  2 (2.00%) high mild
  1 (1.00%) high severe

Benchmarking contrie_conmap_read_100k_u64_u64
Benchmarking contrie_conmap_read_100k_u64_u64: Warming up for 3.0000 s
Benchmarking contrie_conmap_read_100k_u64_u64: Collecting 100 samples in estimated 24.983 s (5050 iterations)
Benchmarking contrie_conmap_read_100k_u64_u64: Analyzing
contrie_conmap_read_100k_u64_u64
                        time:   [4.4244 ms 4.5144 ms 4.6284 ms]
Found 9 outliers among 100 measurements (9.00%)
  4 (4.00%) high mild
  5 (5.00%) high severe

Benchmarking chashmap_read_100k_u64_u64
Benchmarking chashmap_read_100k_u64_u64: Warming up for 3.0000 s
Benchmarking chashmap_read_100k_u64_u64: Collecting 100 samples in estimated 76.542 s (5050 iterations)
Benchmarking chashmap_read_100k_u64_u64: Analyzing
chashmap_read_100k_u64_u64
                        time:   [15.078 ms 15.146 ms 15.224 ms]
Found 5 outliers among 100 measurements (5.00%)
  2 (2.00%) high mild
  3 (3.00%) high severe

Benchmarking ccl_dhashmap_read_100k_u64_u64
Benchmarking ccl_dhashmap_read_100k_u64_u64: Warming up for 3.0000 s
Benchmarking ccl_dhashmap_read_100k_u64_u64: Collecting 100 samples in estimated 11.535 s (5050 iterations)
Benchmarking ccl_dhashmap_read_100k_u64_u64: Analyzing
ccl_dhashmap_read_100k_u64_u64
                        time:   [2.2628 ms 2.2899 ms 2.3195 ms]
Found 14 outliers among 100 measurements (14.00%)
  8 (8.00%) high mild
  6 (6.00%) high severe

Benchmarking crossbeam_skiplist_read_100k_u64_u64
Benchmarking crossbeam_skiplist_read_100k_u64_u64: Warming up for 3.0000 s
Benchmarking crossbeam_skiplist_read_100k_u64_u64: Collecting 100 samples in estimated 15.802 s (5050 iterations)
Benchmarking crossbeam_skiplist_read_100k_u64_u64: Analyzing
crossbeam_skiplist_read_100k_u64_u64
                        time:   [3.0945 ms 3.1236 ms 3.1565 ms]
Found 10 outliers among 100 measurements (10.00%)
  1 (1.00%) low mild
  4 (4.00%) high mild
  5 (5.00%) high severe

Benchmarking kudzu_read_100k_u64_u64
Benchmarking kudzu_read_100k_u64_u64: Warming up for 3.0000 s
Benchmarking kudzu_read_100k_u64_u64: Collecting 100 samples in estimated 15.521 s (5050 iterations)
Benchmarking kudzu_read_100k_u64_u64: Analyzing
kudzu_read_100k_u64_u64 time:   [3.0692 ms 3.1123 ms 3.1602 ms]
Found 9 outliers among 100 measurements (9.00%)
  8 (8.00%) high mild
  1 (1.00%) high severe

Benchmarking hashbrown_rwlock_read_100k_u64_u128x16
Benchmarking hashbrown_rwlock_read_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking hashbrown_rwlock_read_100k_u64_u128x16: Collecting 100 samples in estimated 56.269 s (5050 iterations)
Benchmarking hashbrown_rwlock_read_100k_u64_u128x16: Analyzing
hashbrown_rwlock_read_100k_u64_u128x16
                        time:   [10.998 ms 11.010 ms 11.021 ms]
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) low mild
  3 (3.00%) high mild

Benchmarking contrie_conmap_read_100k_u64_u128x16
Benchmarking contrie_conmap_read_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking contrie_conmap_read_100k_u64_u128x16: Collecting 100 samples in estimated 34.399 s (5050 iterations)
Benchmarking contrie_conmap_read_100k_u64_u128x16: Analyzing
contrie_conmap_read_100k_u64_u128x16
                        time:   [6.7289 ms 6.8883 ms 7.0809 ms]
Found 10 outliers among 100 measurements (10.00%)
  6 (6.00%) high mild
  4 (4.00%) high severe

Benchmarking chashmap_read_100k_u64_u128x16
Benchmarking chashmap_read_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking chashmap_read_100k_u64_u128x16: Collecting 100 samples in estimated 72.490 s (5050 iterations)
Benchmarking chashmap_read_100k_u64_u128x16: Analyzing
chashmap_read_100k_u64_u128x16
                        time:   [14.063 ms 14.084 ms 14.108 ms]
Found 8 outliers among 100 measurements (8.00%)
  1 (1.00%) high mild
  7 (7.00%) high severe

Benchmarking ccl_dhashmap_read_100k_u64_u128x16
Benchmarking ccl_dhashmap_read_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking ccl_dhashmap_read_100k_u64_u128x16: Collecting 100 samples in estimated 30.246 s (5050 iterations)
Benchmarking ccl_dhashmap_read_100k_u64_u128x16: Analyzing
ccl_dhashmap_read_100k_u64_u128x16
                        time:   [6.8181 ms 7.0439 ms 7.2759 ms]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild

Benchmarking crossbeam_skiplist_read_100k_u64_u128x16
Benchmarking crossbeam_skiplist_read_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking crossbeam_skiplist_read_100k_u64_u128x16: Collecting 100 samples in estimated 26.077 s (5050 iterations)
Benchmarking crossbeam_skiplist_read_100k_u64_u128x16: Analyzing
crossbeam_skiplist_read_100k_u64_u128x16
                        time:   [4.9054 ms 4.9840 ms 5.0713 ms]
Found 12 outliers among 100 measurements (12.00%)
  9 (9.00%) high mild
  3 (3.00%) high severe

Benchmarking kudzu_read_100k_u64_u128x16
Benchmarking kudzu_read_100k_u64_u128x16: Warming up for 3.0000 s
Benchmarking kudzu_read_100k_u64_u128x16: Collecting 100 samples in estimated 24.017 s (5050 iterations)
Benchmarking kudzu_read_100k_u64_u128x16: Analyzing
kudzu_read_100k_u64_u128x16
                        time:   [4.1262 ms 4.2229 ms 4.3308 ms]
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild

Gnuplot not found, disabling plotting