Skip to content

Instantly share code, notes, and snippets.

@siying

siying/gist:d1c16c286d7c59c4d7bba718ca198163 Secret

Created October 14, 2021 17:07
Show Gist options
  • Save siying/d1c16c286d7c59c4d7bba718ca198163 to your computer and use it in GitHub Desktop.
Save siying/d1c16c286d7c59c4d7bba718ca198163 to your computer and use it in GitHub Desktop.
Download ZIP
Universal Benchmarks with incremental
Raw
gistfile1.txt
== Non Incremental ==
TEST_TMPDIR=/dev/shm/ ./db_bench --benchmarks=fillrandom,stats --write_buffer_size=4000000 --benchmark_write_rate_limit=5000000 -target_file_size_base=2000000 --compaction_style=1 -num=10000000 -num_levels=20 -universal_max_size_amplification_percent=30
Flush(GB): cumulative 0.641, interval 0.634
Cumulative compaction: 3.55 GB write, 10.74 MB/s write, 3.11 GB read, 9.40 MB/s read, 370.8 seconds
== Incremental ==
TEST_TMPDIR=/dev/shm/ ./db_bench --benchmarks=fillrandom,stats --write_buffer_size=4000000 --benchmark_write_rate_limit=5000000 -target_file_size_base=2000000 --compaction_style=1 -universal_incremental -num=10000000 -num_levels=20 -universal_max_size_amplification_percent=30
Flush(GB): cumulative 0.641, interval 0.634
Cumulative compaction: 3.31 GB write, 10.71 MB/s write, 2.86 GB read, 9.27 MB/s read, 355.0 seconds
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 10] Compacting 3@0 + 4@19 files to L19, score 1.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 14] Compacting 3@0 + 6@19 files to L19, score 1.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 18] Compacting 3@0 + 9@19 files to L19, score 1.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 22] Compacting 3@0 files to L18, score 1.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 25] Compacting 5@18 + 10@19 files to L19, score 1.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 29] Compacting 4@0 + 1@18 files to L18, score 1.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 31] Compacting 6@18 + 11@19 files to L19, score 1.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 35] Compacting 2@18 + 4@19 files to L19, score 1.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 37] Compacting 6@0 + 17@19 files to L19, score 1.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 45] Compacting 6@0 files to L18, score 1.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 47] Compacting 5@18 + 10@19 files to L19, score 1.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 52] Compacting 5@18 + 8@19 files to L19, score 2.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 56] Compacting 2@18 + 4@19 files to L19, score 2.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 59] Compacting 10@0 + 28@19 files to L19, score 2.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 71] Compacting 11@0 files to L18, score 3.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 75] Compacting 5@18 + 10@19 files to L19, score 1.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 79] Compacting 5@18 + 10@19 files to L19, score 2.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 84] Compacting 5@18 + 9@19 files to L19, score 3.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 88] Compacting 3@18 + 6@19 files to L19, score 4.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 91] Compacting 16@0 + 45@19 files to L19, score 4.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 109] Compacting 17@0 files to L18, score 4.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 114] Compacting 5@18 + 10@19 files to L19, score 1.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 119] Compacting 5@18 + 10@19 files to L19, score 2.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 124] Compacting 2@18 + 3@19 files to L19, score 3.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 125] Compacting 5@18 + 10@19 files to L19, score 3.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 130] Compacting 5@18 + 10@19 files to L19, score 4.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 134] Compacting 1@18 + 2@19 files to L19, score 5.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 136] Compacting 1@18 + 2@19 files to L19, score 5.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 138] Compacting 4@18 + 8@19 files to L19, score 5.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 141] Compacting 23@0 + 71@19 files to L19, score 6.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 154] Compacting 12@0 files to L18, score 3.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 158] Compacting 3@0 files to L17, score 1.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 163] Compacting 2@0 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:447] [default] Universal: compacting for file num — 2
[JOB 167] Compacting 1@0 + 3@16 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 169] Compacting 5@16 + 9@17 files to L17, score 1.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 171] Compacting 2@0 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:447] [default] Universal: compacting for file num — 2
[JOB 173] Compacting 1@0 + 4@16 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:447] [default] Universal: compacting for file num — 2
[JOB 176] Compacting 1@0 + 6@16 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:447] [default] Universal: compacting for file num — 2
[JOB 179] Compacting 1@0 + 6@16 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:447] [default] Universal: compacting for file num — 2
[JOB 181] Compacting 1@0 + 6@16 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 184] Compacting 7@16 + 11@17 + 41@18 files to L18, score 1.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 191] Compacting 5@18 + 10@19 files to L19, score 2.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 196] Compacting 5@18 + 10@19 files to L19, score 3.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 200] Compacting 5@18 + 10@19 files to L19, score 4.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 204] Compacting 5@18 + 10@19 files to L19, score 5.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 206] Compacting 5@18 + 10@19 files to L19, score 5.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 207] Compacting 19@0 + 16@18 files to L18, score 5.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 210] Compacting 2@0 files to L17, score 1.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 212] Compacting 3@17 + 5@18 + 10@19 files to L19, score 1.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 217] Compacting 5@0 + 13@17 files to L17, score 2.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 220] Compacting 2@17 + 5@18 + 10@19 files to L19, score 1.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 225] Compacting 6@0 + 13@17 files to L17, score 2.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 230] Compacting 1@17 + 5@18 + 10@19 files to L19, score 1.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 235] Compacting 2@17 + 5@18 + 10@19 files to L19, score 2.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 240] Compacting 12@0 + 13@17 + 26@18 files to L18, score 3.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 247] Compacting 6@18 + 10@19 files to L19, score 2.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 252] Compacting 5@18 + 10@19 files to L19, score 3.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 256] Compacting 5@18 + 10@19 files to L19, score 3.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 261] Compacting 17@0 files to L17, score 4.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 264] Compacting 2@17 + 5@18 + 10@19 files to L19, score 1.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 269] Compacting 6@0 files to L16, score 2.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 272] Compacting 19@17 + 32@18 files to L18, score 1.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 280] Compacting 9@18 + 10@19 files to L19, score 3.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 285] Compacting 7@18 + 9@19 files to L19, score 4.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 290] Compacting 5@18 + 10@19 files to L19, score 5.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 293] Compacting 2@18 + 4@19 files to L19, score 5.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 295] Compacting 6@18 + 12@19 files to L19, score 5.50
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 298] Compacting 22@0 + 9@16 + 30@18 files to L18, score 6.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 305] Compacting 6@18 + 9@19 files to L19, score 2.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 310] Compacting 5@18 + 10@19 files to L19, score 2.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 314] Compacting 13@0 files to L17, score 3.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 319] Compacting 2@17 + 7@18 + 11@19 files to L19, score 1.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 324] Compacting 2@17 + 5@18 + 10@19 files to L19, score 2.50
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 328] Compacting 11@0 + 19@17 + 43@18 files to L18, score 3.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 340] Compacting 5@18 + 10@19 files to L19, score 3.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 345] Compacting 5@18 + 10@19 files to L19, score 4.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 350] Compacting 5@18 + 10@19 files to L19, score 5.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 355] Compacting 5@18 + 10@19 files to L19, score 6.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 359] Compacting 5@18 + 10@19 files to L19, score 7.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 364] Compacting 5@18 + 10@19 files to L19, score 8.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 368] Compacting 2@18 + 3@19 files to L19, score 8.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 370] Compacting 5@18 + 10@19 files to L19, score 9.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 371] Compacting 34@0 + 32@18 files to L18, score 9.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 374] Compacting 2@0 files to L17, score 1.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 379] Compacting 2@0 + 24@17 files to L17, score 1.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 384] Compacting 2@17 + 7@18 + 10@19 files to L19, score 1.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 388] Compacting 4@0 + 22@17 files to L17, score 1.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 390] Compacting 2@0 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 392] Compacting 1@17 + 5@18 + 10@19 files to L19, score 1.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 396] Compacting 4@0 + 6@16 files to L16, score 2.00
[/compaction/compaction_picker_universal.cc:447] [default] Universal: compacting for file num — 2
[JOB 398] Compacting 1@0 + 8@16 files to L16, score 1.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 401] Compacting 2@17 + 5@18 + 10@19 files to L19, score 1.50
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 405] Compacting 5@0 files to L15, score 2.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 407] Compacting 1@17 + 7@18 + 11@19 files to L19, score 1.50
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 411] Compacting 4@0 files to L14, score 2.25
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 413] Compacting 9@16 + 20@17 files to L17, score 1.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 417] Compacting 2@17 + 6@18 + 12@19 files to L19, score 2.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 421] Compacting 1@17 + 6@18 + 10@19 files to L19, score 3.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 425] Compacting 10@0 + 5@14 + 8@15 + 21@17 + 46@18 files to L18, score 3.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 432] Compacting 6@18 + 10@19 files to L19, score 1.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 436] Compacting 6@18 + 11@19 files to L19, score 2.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 441] Compacting 13@0 files to L17, score 3.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 446] Compacting 2@17 + 5@18 + 10@19 files to L19, score 1.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 451] Compacting 2@17 + 5@18 + 10@19 files to L19, score 2.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 456] Compacting 1@17 + 1@18 + 2@19 files to L19, score 3.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 458] Compacting 12@0 + 23@17 files to L17, score 3.75
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 463] Compacting 2@17 + 5@18 + 10@19 files to L19, score 2.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 468] Compacting 1@17 + 5@18 + 10@19 files to L19, score 3.00
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 473] Compacting 2@17 + 5@18 + 10@19 files to L19, score 4.00
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 477] Compacting 16@0 files to L16, score 4.75
[/compaction/compaction_picker_universal.cc:418] [default] Universal: compacting for size ratio
[JOB 479] Compacting 24@17 + 46@18 files to L18, score 1.25
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 490] Compacting 6@18 + 9@19 files to L19, score 3.50
[/compaction/compaction_picker_universal.cc:408] [default] Universal: compacting for size amp
[JOB 495] Compacting 1@16 + 5@18 + 10@19 files to L19, score 4.25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment