Skip to content

Instantly share code, notes, and snippets.

@gwicke
Created April 23, 2018 18:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save gwicke/3286cc87f09c81052d33e08a9d3d1cec to your computer and use it in GitHub Desktop.
Save gwicke/3286cc87f09c81052d33e08a9d3d1cec to your computer and use it in GitHub Desktop.
+ strong_compression='--compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13'
+ bench='./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio'
+ echo '#### Without cpu prio, basic zstd'
#### Without cpu prio, basic zstd
++ seq 1 10
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:31:18 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.084 micros/op 922887 ops/sec; 37.3 MB/s (894747 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 54.6293 StdDev: 20.46
Min: 0 Median: 1.9472 Max: 678033
Percentiles: P50: 1.95 P75: 24.90 P99: 168.56 P99.9: 12413.59 P99.99: 32011.82
------------------------------------------------------
[ 0, 1 ] 44657036 23.259% 23.259% #####
( 1, 2 ] 54203330 28.231% 51.490% ######
( 2, 3 ] 17239003 8.979% 60.468% ##
( 3, 4 ] 8200419 4.271% 64.739% #
( 4, 6 ] 6810730 3.547% 68.287% #
( 6, 10 ] 2512175 1.308% 69.595%
( 10, 15 ] 453968 0.236% 69.832%
( 15, 22 ] 8477477 4.415% 74.247% #
( 22, 34 ] 5981632 3.115% 77.362% #
( 34, 51 ] 9215030 4.799% 82.162% #
( 51, 76 ] 10910781 5.683% 87.845% #
( 76, 110 ] 14583380 7.596% 95.440% ##
( 110, 170 ] 7003582 3.648% 99.088% #
( 170, 250 ] 962931 0.502% 99.589%
( 250, 380 ] 144302 0.075% 99.664%
( 380, 580 ] 17557 0.009% 99.674%
( 580, 870 ] 21784 0.011% 99.685%
( 870, 1300 ] 28209 0.015% 99.700%
( 1300, 1900 ] 34274 0.018% 99.718%
( 1900, 2900 ] 50399 0.026% 99.744%
( 2900, 4400 ] 61572 0.032% 99.776%
( 4400, 6600 ] 71545 0.037% 99.813%
( 6600, 9900 ] 82357 0.043% 99.856%
( 9900, 14000 ] 137875 0.072% 99.928%
( 14000, 22000 ] 73576 0.038% 99.966%
( 22000, 33000 ] 50404 0.026% 99.992%
( 33000, 50000 ] 12496 0.007% 99.999%
( 50000, 75000 ] 1763 0.001% 100.000%
( 75000, 110000 ] 251 0.000% 100.000%
( 110000, 170000 ] 83 0.000% 100.000%
( 170000, 250000 ] 34 0.000% 100.000%
( 250000, 380000 ] 18 0.000% 100.000%
( 380000, 570000 ] 16 0.000% 100.000%
( 570000, 860000 ] 11 0.000% 100.000%
real 3m28.172s
user 69m14.460s
sys 7m20.409s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:34:46 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.272 micros/op 785887 ops/sec; 38.8 MB/s (1070597 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 68.8901 StdDev: 17.56
Min: 0 Median: 2.5094 Max: 872546
Percentiles: P50: 2.51 P75: 42.74 P99: 166.87 P99.9: 13605.72 P99.99: 32456.17
------------------------------------------------------
[ 0, 1 ] 44761601 23.313% 23.313% #####
( 1, 2 ] 43640589 22.729% 46.043% #####
( 2, 3 ] 14914082 7.768% 53.811% ##
( 3, 4 ] 8658671 4.510% 58.320% #
( 4, 6 ] 6283004 3.272% 61.593% #
( 6, 10 ] 2411182 1.256% 62.849%
( 10, 15 ] 411650 0.214% 63.063%
( 15, 22 ] 10786367 5.618% 68.681% #
( 22, 34 ] 6444247 3.356% 72.037% #
( 34, 51 ] 11063895 5.762% 77.800% #
( 51, 76 ] 13573046 7.069% 84.869% #
( 76, 110 ] 17919206 9.333% 94.202% ##
( 110, 170 ] 9718982 5.062% 99.264% #
( 170, 250 ] 471037 0.245% 99.509%
( 250, 380 ] 38174 0.020% 99.529%
( 380, 580 ] 24267 0.013% 99.542%
( 580, 870 ] 32540 0.017% 99.559%
( 870, 1300 ] 42676 0.022% 99.581%
( 1300, 1900 ] 52603 0.027% 99.608%
( 1900, 2900 ] 76192 0.040% 99.648%
( 2900, 4400 ] 93592 0.049% 99.697%
( 4400, 6600 ] 108951 0.057% 99.753%
( 6600, 9900 ] 123565 0.064% 99.818%
( 9900, 14000 ] 174679 0.091% 99.909%
( 14000, 22000 ] 100359 0.052% 99.961%
( 22000, 33000 ] 58537 0.030% 99.992%
( 33000, 50000 ] 14162 0.007% 99.999%
( 50000, 75000 ] 1826 0.001% 100.000%
( 75000, 110000 ] 198 0.000% 100.000%
( 110000, 170000 ] 52 0.000% 100.000%
( 170000, 250000 ] 26 0.000% 100.000%
( 250000, 380000 ] 20 0.000% 100.000%
( 380000, 570000 ] 9 0.000% 100.000%
( 570000, 860000 ] 11 0.000% 100.000%
( 860000, 1200000 ] 2 0.000% 100.000%
real 4m5.054s
user 82m37.196s
sys 8m54.181s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:38:51 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.228 micros/op 814131 ops/sec; 36.5 MB/s (692657 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 65.9190 StdDev: 17.29
Min: 0 Median: 2.1058 Max: 574737
Percentiles: P50: 2.11 P75: 36.62 P99: 206.36 P99.9: 13621.27 P99.99: 35015.97
------------------------------------------------------
[ 0, 1 ] 45150428 23.516% 23.516% #####
( 1, 2 ] 49181900 25.616% 49.131% #####
( 2, 3 ] 15757760 8.207% 57.339% ##
( 3, 4 ] 8088280 4.213% 61.551% #
( 4, 6 ] 6780333 3.531% 65.083% #
( 6, 10 ] 2885253 1.503% 66.585%
( 10, 15 ] 521692 0.272% 66.857%
( 15, 22 ] 7692070 4.006% 70.863% #
( 22, 34 ] 6585113 3.430% 74.293% #
( 34, 51 ] 8799356 4.583% 78.876% #
( 51, 76 ] 12317365 6.415% 85.291% #
( 76, 110 ] 16047141 8.358% 93.649% ##
( 110, 170 ] 9495150 4.945% 98.595% #
( 170, 250 ] 1711946 0.892% 99.486%
( 250, 380 ] 239355 0.125% 99.611%
( 380, 580 ] 18115 0.009% 99.620%
( 580, 870 ] 22996 0.012% 99.632%
( 870, 1300 ] 30411 0.016% 99.648%
( 1300, 1900 ] 37116 0.019% 99.668%
( 1900, 2900 ] 54493 0.028% 99.696%
( 2900, 4400 ] 66864 0.035% 99.731%
( 4400, 6600 ] 78196 0.041% 99.772%
( 6600, 9900 ] 92847 0.048% 99.820%
( 9900, 14000 ] 169475 0.088% 99.908%
( 14000, 22000 ] 90878 0.047% 99.955%
( 22000, 33000 ] 64143 0.033% 99.989%
( 33000, 50000 ] 17911 0.009% 99.998%
( 50000, 75000 ] 2906 0.002% 100.000%
( 75000, 110000 ] 374 0.000% 100.000%
( 110000, 170000 ] 77 0.000% 100.000%
( 170000, 250000 ] 20 0.000% 100.000%
( 250000, 380000 ] 15 0.000% 100.000%
( 380000, 570000 ] 20 0.000% 100.000%
( 570000, 860000 ] 1 0.000% 100.000%
real 3m56.023s
user 81m3.689s
sys 8m23.700s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:42:47 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.038 micros/op 963052 ops/sec; 38.1 MB/s (198525 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 52.6155 StdDev: 17.32
Min: 0 Median: 1.7670 Max: 707665
Percentiles: P50: 1.77 P75: 21.58 P99: 168.53 P99.9: 12210.43 P99.99: 31215.84
------------------------------------------------------
[ 0, 1 ] 56498389 29.426% 29.426% ######
( 1, 2 ] 51502760 26.824% 56.251% #####
( 2, 3 ] 12468753 6.494% 62.745% #
( 3, 4 ] 7245197 3.774% 66.518% #
( 4, 6 ] 5548042 2.890% 69.408% #
( 6, 10 ] 2227113 1.160% 70.568%
( 10, 15 ] 380987 0.198% 70.766%
( 15, 22 ] 8645048 4.503% 75.269% #
( 22, 34 ] 5151426 2.683% 77.952% #
( 34, 51 ] 9000837 4.688% 82.640% #
( 51, 76 ] 11462189 5.970% 88.610% #
( 76, 110 ] 13399568 6.979% 95.589% #
( 110, 170 ] 6714305 3.497% 99.086% #
( 170, 250 ] 980764 0.511% 99.597%
( 250, 380 ] 115913 0.060% 99.657%
( 380, 580 ] 19861 0.010% 99.667%
( 580, 870 ] 24656 0.013% 99.680%
( 870, 1300 ] 33499 0.017% 99.698%
( 1300, 1900 ] 40281 0.021% 99.719%
( 1900, 2900 ] 55389 0.029% 99.747%
( 2900, 4400 ] 63474 0.033% 99.780%
( 4400, 6600 ] 73045 0.038% 99.818%
( 6600, 9900 ] 84955 0.044% 99.863%
( 9900, 14000 ] 126968 0.066% 99.929%
( 14000, 22000 ] 77835 0.041% 99.969%
( 22000, 33000 ] 47202 0.025% 99.994%
( 33000, 50000 ] 10010 0.005% 99.999%
( 50000, 75000 ] 1292 0.001% 100.000%
( 75000, 110000 ] 151 0.000% 100.000%
( 110000, 170000 ] 44 0.000% 100.000%
( 170000, 250000 ] 14 0.000% 100.000%
( 250000, 380000 ] 13 0.000% 100.000%
( 380000, 570000 ] 11 0.000% 100.000%
( 570000, 860000 ] 9 0.000% 100.000%
real 3m19.783s
user 66m22.990s
sys 7m5.029s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:46:07 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.134 micros/op 882076 ops/sec; 39.9 MB/s (1196920 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 60.1719 StdDev: 15.95
Min: 0 Median: 1.9713 Max: 871196
Percentiles: P50: 1.97 P75: 35.79 P99: 164.94 P99.9: 12771.21 P99.99: 31770.60
------------------------------------------------------
[ 0, 1 ] 50774864 26.445% 26.445% #####
( 1, 2 ] 46561320 24.251% 50.696% #####
( 2, 3 ] 13367408 6.962% 57.658% #
( 3, 4 ] 7872126 4.100% 61.758% #
( 4, 6 ] 5638511 2.937% 64.695% #
( 6, 10 ] 2241383 1.167% 65.862%
( 10, 15 ] 385463 0.201% 66.063%
( 15, 22 ] 10019257 5.218% 71.281% #
( 22, 34 ] 6042532 3.147% 74.429% #
( 34, 51 ] 10394082 5.414% 79.842% #
( 51, 76 ] 13146256 6.847% 86.689% #
( 76, 110 ] 16204048 8.440% 95.129% ##
( 110, 170 ] 8116700 4.227% 99.356% #
( 170, 250 ] 404183 0.211% 99.567%
( 250, 380 ] 45047 0.023% 99.590%
( 380, 580 ] 22953 0.012% 99.602%
( 580, 870 ] 29640 0.015% 99.618%
( 870, 1300 ] 38553 0.020% 99.638%
( 1300, 1900 ] 47770 0.025% 99.663%
( 1900, 2900 ] 68705 0.036% 99.698%
( 2900, 4400 ] 83424 0.043% 99.742%
( 4400, 6600 ] 94423 0.049% 99.791%
( 6600, 9900 ] 105503 0.055% 99.846%
( 9900, 14000 ] 148293 0.077% 99.923%
( 14000, 22000 ] 83739 0.044% 99.967%
( 22000, 33000 ] 50231 0.026% 99.993%
( 33000, 50000 ] 11618 0.006% 99.999%
( 50000, 75000 ] 1630 0.001% 100.000%
( 75000, 110000 ] 188 0.000% 100.000%
( 110000, 170000 ] 79 0.000% 100.000%
( 170000, 250000 ] 34 0.000% 100.000%
( 250000, 380000 ] 15 0.000% 100.000%
( 380000, 570000 ] 6 0.000% 100.000%
( 570000, 860000 ] 15 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
real 3m38.099s
user 74m33.053s
sys 8m11.346s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:49:45 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.749 micros/op 1334411 ops/sec; 41.3 MB/s (138884 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 32.3246 StdDev: 19.51
Min: 0 Median: 1.4119 Max: 629713
Percentiles: P50: 1.41 P75: 5.27 P99: 144.77 P99.9: 6835.64 P99.99: 24890.69
------------------------------------------------------
[ 0, 1 ] 75687185 39.420% 39.420% ########
( 1, 2 ] 49314017 25.684% 65.105% #####
( 2, 3 ] 10864626 5.659% 70.763% #
( 3, 4 ] 5389413 2.807% 73.570% #
( 4, 6 ] 4310862 2.245% 75.816%
( 6, 10 ] 1754978 0.914% 76.730%
( 10, 15 ] 296741 0.155% 76.884%
( 15, 22 ] 7477503 3.895% 80.779% #
( 22, 34 ] 4546705 2.368% 83.147%
( 34, 51 ] 8262060 4.303% 87.450% #
( 51, 76 ] 9687887 5.046% 92.496% #
( 76, 110 ] 10570911 5.506% 98.002% #
( 110, 170 ] 3308124 1.723% 99.724%
( 170, 250 ] 75536 0.039% 99.764%
( 250, 380 ] 16697 0.009% 99.773%
( 380, 580 ] 14627 0.008% 99.780%
( 580, 870 ] 18902 0.010% 99.790%
( 870, 1300 ] 24519 0.013% 99.803%
( 1300, 1900 ] 30119 0.016% 99.818%
( 1900, 2900 ] 44383 0.023% 99.842%
( 2900, 4400 ] 52147 0.027% 99.869%
( 4400, 6600 ] 55885 0.029% 99.898%
( 6600, 9900 ] 58441 0.030% 99.928%
( 9900, 14000 ] 81111 0.042% 99.971%
( 14000, 22000 ] 31853 0.017% 99.987%
( 22000, 33000 ] 21188 0.011% 99.998%
( 33000, 50000 ] 3040 0.002% 100.000%
( 50000, 75000 ] 410 0.000% 100.000%
( 75000, 110000 ] 45 0.000% 100.000%
( 110000, 170000 ] 34 0.000% 100.000%
( 170000, 250000 ] 21 0.000% 100.000%
( 250000, 380000 ] 14 0.000% 100.000%
( 380000, 570000 ] 11 0.000% 100.000%
( 570000, 860000 ] 5 0.000% 100.000%
real 2m24.471s
user 47m41.917s
sys 5m0.622s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:52:10 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.325 micros/op 754593 ops/sec; 38.5 MB/s (799413 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 72.1771 StdDev: 17.84
Min: 0 Median: 2.6416 Max: 737653
Percentiles: P50: 2.64 P75: 46.11 P99: 169.71 P99.9: 14081.22 P99.99: 33785.11
------------------------------------------------------
[ 0, 1 ] 44401867 23.126% 23.126% #####
( 1, 2 ] 42433907 22.101% 45.227% ####
( 2, 3 ] 14283007 7.439% 52.666% #
( 3, 4 ] 8066068 4.201% 56.867% #
( 4, 6 ] 6008437 3.129% 59.997% #
( 6, 10 ] 2528924 1.317% 61.314%
( 10, 15 ] 444884 0.232% 61.545%
( 15, 22 ] 10851504 5.652% 67.197% #
( 22, 34 ] 6590283 3.432% 70.630% #
( 34, 51 ] 11778643 6.135% 76.764% #
( 51, 76 ] 14725805 7.670% 84.434% ##
( 76, 110 ] 17817383 9.280% 93.714% ##
( 110, 170 ] 10198095 5.312% 99.025% #
( 170, 250 ] 916862 0.478% 99.503%
( 250, 380 ] 70932 0.037% 99.540%
( 380, 580 ] 23003 0.012% 99.552%
( 580, 870 ] 28722 0.015% 99.567%
( 870, 1300 ] 38257 0.020% 99.587%
( 1300, 1900 ] 47883 0.025% 99.612%
( 1900, 2900 ] 70875 0.037% 99.649%
( 2900, 4400 ] 85622 0.045% 99.693%
( 4400, 6600 ] 98497 0.051% 99.745%
( 6600, 9900 ] 117832 0.061% 99.806%
( 9900, 14000 ] 179601 0.094% 99.899%
( 14000, 22000 ] 109043 0.057% 99.956%
( 22000, 33000 ] 64077 0.033% 99.990%
( 33000, 50000 ] 17041 0.009% 99.998%
( 50000, 75000 ] 2570 0.001% 100.000%
( 75000, 110000 ] 264 0.000% 100.000%
( 110000, 170000 ] 39 0.000% 100.000%
( 170000, 250000 ] 31 0.000% 100.000%
( 250000, 380000 ] 16 0.000% 100.000%
( 380000, 570000 ] 14 0.000% 100.000%
( 570000, 860000 ] 12 0.000% 100.000%
real 4m14.586s
user 86m30.281s
sys 9m26.206s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 08:56:24 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.217 micros/op 821517 ops/sec; 37.4 MB/s (857105 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 65.6709 StdDev: 13.29
Min: 0 Median: 2.4841 Max: 618176
Percentiles: P50: 2.48 P75: 36.75 P99: 182.54 P99.9: 13639.48 P99.99: 32913.87
------------------------------------------------------
[ 0, 1 ] 31803879 16.565% 16.565% ###
( 1, 2 ] 53137952 27.676% 44.241% ######
( 2, 3 ] 22843632 11.898% 56.138% ##
( 3, 4 ] 9038627 4.708% 60.846% #
( 4, 6 ] 7166119 3.732% 64.578% #
( 6, 10 ] 2795678 1.456% 66.034%
( 10, 15 ] 536511 0.279% 66.314%
( 15, 22 ] 8894574 4.633% 70.946% #
( 22, 34 ] 6141361 3.199% 74.145% #
( 34, 51 ] 10131396 5.277% 79.422% #
( 51, 76 ] 12604972 6.565% 85.987% #
( 76, 110 ] 16220249 8.448% 94.435% ##
( 110, 170 ] 8586054 4.472% 98.907% #
( 170, 250 ] 1142137 0.595% 99.502%
( 250, 380 ] 147668 0.077% 99.579%
( 380, 580 ] 23067 0.012% 99.591%
( 580, 870 ] 27811 0.014% 99.605%
( 870, 1300 ] 36512 0.019% 99.624%
( 1300, 1900 ] 45187 0.024% 99.648%
( 1900, 2900 ] 65455 0.034% 99.682%
( 2900, 4400 ] 78844 0.041% 99.723%
( 4400, 6600 ] 90973 0.047% 99.770%
( 6600, 9900 ] 105279 0.055% 99.825%
( 9900, 14000 ] 157952 0.082% 99.907%
( 14000, 22000 ] 98213 0.051% 99.958%
( 22000, 33000 ] 61177 0.032% 99.990%
( 33000, 50000 ] 15838 0.008% 99.998%
( 50000, 75000 ] 2495 0.001% 100.000%
( 75000, 110000 ] 264 0.000% 100.000%
( 110000, 170000 ] 57 0.000% 100.000%
( 170000, 250000 ] 24 0.000% 100.000%
( 250000, 380000 ] 19 0.000% 100.000%
( 380000, 570000 ] 20 0.000% 100.000%
( 570000, 860000 ] 4 0.000% 100.000%
real 3m53.847s
user 78m28.707s
sys 8m24.524s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:00:18 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.115 micros/op 896703 ops/sec; 40.6 MB/s (1093585 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 62.0710 StdDev: 14.83
Min: 0 Median: 1.9383 Max: 677692
Percentiles: P50: 1.94 P75: 35.91 P99: 164.45 P99.9: 13227.18 P99.99: 32395.52
------------------------------------------------------
[ 0, 1 ] 47970912 24.985% 24.985% #####
( 1, 2 ] 51187690 26.660% 51.645% #####
( 2, 3 ] 13809430 7.192% 58.838% #
( 3, 4 ] 6260956 3.261% 62.098% #
( 4, 6 ] 4675030 2.435% 64.533%
( 6, 10 ] 2146084 1.118% 65.651%
( 10, 15 ] 371374 0.193% 65.845%
( 15, 22 ] 10393627 5.413% 71.258% #
( 22, 34 ] 5915681 3.081% 74.339% #
( 34, 51 ] 11269859 5.870% 80.209% #
( 51, 76 ] 13203913 6.877% 87.086% #
( 76, 110 ] 15686012 8.170% 95.256% ##
( 110, 170 ] 7921545 4.126% 99.381% #
( 170, 250 ] 358181 0.187% 99.568%
( 250, 380 ] 31859 0.017% 99.584%
( 380, 580 ] 22695 0.012% 99.596%
( 580, 870 ] 28535 0.015% 99.611%
( 870, 1300 ] 37173 0.019% 99.630%
( 1300, 1900 ] 46144 0.024% 99.655%
( 1900, 2900 ] 66456 0.035% 99.689%
( 2900, 4400 ] 82240 0.043% 99.732%
( 4400, 6600 ] 93702 0.049% 99.781%
( 6600, 9900 ] 107137 0.056% 99.837%
( 9900, 14000 ] 150048 0.078% 99.915%
( 14000, 22000 ] 92959 0.048% 99.963%
( 22000, 33000 ] 54556 0.028% 99.992%
( 33000, 50000 ] 13879 0.007% 99.999%
( 50000, 75000 ] 1958 0.001% 100.000%
( 75000, 110000 ] 225 0.000% 100.000%
( 110000, 170000 ] 70 0.000% 100.000%
( 170000, 250000 ] 28 0.000% 100.000%
( 250000, 380000 ] 24 0.000% 100.000%
( 380000, 570000 ] 17 0.000% 100.000%
( 570000, 860000 ] 1 0.000% 100.000%
real 3m34.311s
user 73m30.896s
sys 8m6.017s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:03:53 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.052 micros/op 951013 ops/sec; 39.6 MB/s (916355 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 55.1348 StdDev: 20.92
Min: 0 Median: 1.8715 Max: 624319
Percentiles: P50: 1.87 P75: 26.60 P99: 165.95 P99.9: 12377.20 P99.99: 31421.07
------------------------------------------------------
[ 0, 1 ] 50742283 26.428% 26.428% #####
( 1, 2 ] 51929962 27.047% 53.475% #####
( 2, 3 ] 13910102 7.245% 60.720% #
( 3, 4 ] 7509470 3.911% 64.631% #
( 4, 6 ] 5541878 2.886% 67.518% #
( 6, 10 ] 2155267 1.123% 68.640%
( 10, 15 ] 359305 0.187% 68.827%
( 15, 22 ] 9570296 4.985% 73.812% #
( 22, 34 ] 5956381 3.102% 76.914% #
( 34, 51 ] 9674989 5.039% 81.953% #
( 51, 76 ] 11721399 6.105% 88.058% #
( 76, 110 ] 14707477 7.660% 95.718% ##
( 110, 170 ] 6757232 3.519% 99.238% #
( 170, 250 ] 686711 0.358% 99.595%
( 250, 380 ] 74958 0.039% 99.634%
( 380, 580 ] 19918 0.010% 99.645%
( 580, 870 ] 25561 0.013% 99.658%
( 870, 1300 ] 33126 0.017% 99.675%
( 1300, 1900 ] 40286 0.021% 99.696%
( 1900, 2900 ] 57998 0.030% 99.726%
( 2900, 4400 ] 71744 0.037% 99.764%
( 4400, 6600 ] 82479 0.043% 99.807%
( 6600, 9900 ] 93946 0.049% 99.856%
( 9900, 14000 ] 141067 0.073% 99.929%
( 14000, 22000 ] 76964 0.040% 99.969%
( 22000, 33000 ] 46705 0.024% 99.993%
( 33000, 50000 ] 10652 0.006% 99.999%
( 50000, 75000 ] 1511 0.001% 100.000%
( 75000, 110000 ] 219 0.000% 100.000%
( 110000, 170000 ] 66 0.000% 100.000%
( 170000, 250000 ] 14 0.000% 100.000%
( 250000, 380000 ] 13 0.000% 100.000%
( 380000, 570000 ] 15 0.000% 100.000%
( 570000, 860000 ] 6 0.000% 100.000%
real 3m22.176s
user 68m40.481s
sys 7m13.556s
+ echo '#### With cpu prio, basic zstd'
#### With cpu prio, basic zstd
++ seq 1 10
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:07:15 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.179 micros/op 5579790 ops/sec; 96.8 MB/s (508529 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 8.1882 StdDev: 14.20
Min: 0 Median: 2.2205 Max: 1238014
Percentiles: P50: 2.22 P75: 3.92 P99: 9.80 P99.9: 38.45 P99.99: 25924.95
------------------------------------------------------
[ 0, 1 ] 32040092 16.688% 16.688% ###
( 1, 2 ] 57759028 30.083% 46.770% ######
( 2, 3 ] 28121035 14.646% 61.417% ###
( 3, 4 ] 28459069 14.822% 76.239% ###
( 4, 6 ] 35932872 18.715% 94.954% ####
( 6, 10 ] 8180661 4.261% 99.215% #
( 10, 15 ] 735779 0.383% 99.598%
( 15, 22 ] 178834 0.093% 99.691%
( 22, 34 ] 369739 0.193% 99.884%
( 34, 51 ] 117897 0.061% 99.945%
( 51, 76 ] 49873 0.026% 99.971%
( 76, 110 ] 7817 0.004% 99.975%
( 110, 170 ] 1250 0.001% 99.976%
( 170, 250 ] 867 0.000% 99.976%
( 250, 380 ] 666 0.000% 99.977%
( 380, 580 ] 520 0.000% 99.977%
( 580, 870 ] 430 0.000% 99.977%
( 870, 1300 ] 424 0.000% 99.978%
( 1300, 1900 ] 294 0.000% 99.978%
( 1900, 2900 ] 539 0.000% 99.978%
( 2900, 4400 ] 272 0.000% 99.978%
( 4400, 6600 ] 100 0.000% 99.978%
( 6600, 9900 ] 111 0.000% 99.978%
( 9900, 14000 ] 9814 0.005% 99.983%
( 14000, 22000 ] 4003 0.002% 99.985%
( 22000, 33000 ] 24702 0.013% 99.998%
( 33000, 50000 ] 2388 0.001% 100.000%
( 50000, 75000 ] 437 0.000% 100.000%
( 75000, 110000 ] 206 0.000% 100.000%
( 110000, 170000 ] 162 0.000% 100.000%
( 170000, 250000 ] 60 0.000% 100.000%
( 250000, 380000 ] 45 0.000% 100.000%
( 380000, 570000 ] 11 0.000% 100.000%
( 570000, 860000 ] 2 0.000% 100.000%
( 1200000, 1900000 ] 1 0.000% 100.000%
real 0m34.587s
user 10m44.791s
sys 0m7.179s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:07:49 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.187 micros/op 5337930 ops/sec; 86.3 MB/s (374819 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.9309 StdDev: 15.57
Min: 0 Median: 2.1082 Max: 928017
Percentiles: P50: 2.11 P75: 4.07 P99: 10.06 P99.9: 48.48 P99.99: 25098.06
------------------------------------------------------
[ 0, 1 ] 42526924 22.149% 22.149% ####
( 1, 2 ] 50655268 26.383% 48.532% #####
( 2, 3 ] 26037028 13.561% 62.093% ###
( 3, 4 ] 23531548 12.256% 74.349% ##
( 4, 6 ] 35837342 18.665% 93.015% ####
( 6, 10 ] 11482692 5.981% 98.995% #
( 10, 15 ] 764672 0.398% 99.393%
( 15, 22 ] 289818 0.151% 99.544%
( 22, 34 ] 463120 0.241% 99.786%
( 34, 51 ] 257873 0.134% 99.920%
( 51, 76 ] 95620 0.050% 99.970%
( 76, 110 ] 12633 0.007% 99.976%
( 110, 170 ] 852 0.000% 99.977%
( 170, 250 ] 566 0.000% 99.977%
( 250, 380 ] 471 0.000% 99.977%
( 380, 580 ] 354 0.000% 99.977%
( 580, 870 ] 252 0.000% 99.978%
( 870, 1300 ] 428 0.000% 99.978%
( 1300, 1900 ] 222 0.000% 99.978%
( 1900, 2900 ] 520 0.000% 99.978%
( 2900, 4400 ] 380 0.000% 99.978%
( 4400, 6600 ] 132 0.000% 99.978%
( 6600, 9900 ] 123 0.000% 99.979%
( 9900, 14000 ] 12385 0.006% 99.985%
( 14000, 22000 ] 2957 0.002% 99.987%
( 22000, 33000 ] 23505 0.012% 99.999%
( 33000, 50000 ] 1602 0.001% 100.000%
( 50000, 75000 ] 309 0.000% 100.000%
( 75000, 110000 ] 153 0.000% 100.000%
( 110000, 170000 ] 115 0.000% 100.000%
( 170000, 250000 ] 60 0.000% 100.000%
( 250000, 380000 ] 41 0.000% 100.000%
( 380000, 570000 ] 20 0.000% 100.000%
( 570000, 860000 ] 14 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
real 0m36.083s
user 10m54.995s
sys 0m8.641s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:08:25 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.161 micros/op 6211874 ops/sec; 95.3 MB/s (236648 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.0797 StdDev: 7.18
Min: 0 Median: 1.7598 Max: 1094053
Percentiles: P50: 1.76 P75: 3.70 P99: 9.88 P99.9: 43.98 P99.99: 24042.75
------------------------------------------------------
[ 0, 1 ] 55328663 28.817% 28.817% ######
( 1, 2 ] 53531439 27.881% 56.698% ######
( 2, 3 ] 21116919 10.998% 67.696% ##
( 3, 4 ] 20000803 10.417% 78.113% ##
( 4, 6 ] 32082393 16.710% 94.823% ###
( 6, 10 ] 8269991 4.307% 99.130% #
( 10, 15 ] 627107 0.327% 99.457%
( 15, 22 ] 270802 0.141% 99.598%
( 22, 34 ] 471845 0.246% 99.844%
( 34, 51 ] 184047 0.096% 99.940%
( 51, 76 ] 67260 0.035% 99.975%
( 76, 110 ] 6972 0.004% 99.978%
( 110, 170 ] 1522 0.001% 99.979%
( 170, 250 ] 767 0.000% 99.979%
( 250, 380 ] 380 0.000% 99.980%
( 380, 580 ] 169 0.000% 99.980%
( 580, 870 ] 124 0.000% 99.980%
( 870, 1300 ] 198 0.000% 99.980%
( 1300, 1900 ] 138 0.000% 99.980%
( 1900, 2900 ] 269 0.000% 99.980%
( 2900, 4400 ] 243 0.000% 99.980%
( 4400, 6600 ] 101 0.000% 99.980%
( 6600, 9900 ] 82 0.000% 99.980%
( 9900, 14000 ] 11816 0.006% 99.986%
( 14000, 22000 ] 2775 0.001% 99.988%
( 22000, 33000 ] 21405 0.011% 99.999%
( 33000, 50000 ] 1170 0.001% 100.000%
( 50000, 75000 ] 300 0.000% 100.000%
( 75000, 110000 ] 127 0.000% 100.000%
( 110000, 170000 ] 87 0.000% 100.000%
( 170000, 250000 ] 37 0.000% 100.000%
( 250000, 380000 ] 15 0.000% 100.000%
( 380000, 570000 ] 16 0.000% 100.000%
( 570000, 860000 ] 17 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
real 0m31.022s
user 9m47.280s
sys 0m7.423s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:08:56 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.174 micros/op 5758085 ops/sec; 88.9 MB/s (236009 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.7298 StdDev: 16.89
Min: 0 Median: 1.8821 Max: 675242
Percentiles: P50: 1.88 P75: 3.69 P99: 17.10 P99.9: 58.03 P99.99: 25367.89
------------------------------------------------------
[ 0, 1 ] 42626177 22.201% 22.201% ####
( 1, 2 ] 60507999 31.515% 53.716% ######
( 2, 3 ] 25636083 13.352% 67.068% ###
( 3, 4 ] 22003087 11.460% 78.528% ##
( 4, 6 ] 31222944 16.262% 94.790% ###
( 6, 10 ] 7350264 3.828% 98.618% #
( 10, 15 ] 621217 0.324% 98.942%
( 15, 22 ] 374866 0.195% 99.137%
( 22, 34 ] 951077 0.495% 99.632%
( 34, 51 ] 460821 0.240% 99.872%
( 51, 76 ] 190106 0.099% 99.971%
( 76, 110 ] 12180 0.006% 99.978%
( 110, 170 ] 941 0.000% 99.978%
( 170, 250 ] 605 0.000% 99.978%
( 250, 380 ] 380 0.000% 99.979%
( 380, 580 ] 238 0.000% 99.979%
( 580, 870 ] 159 0.000% 99.979%
( 870, 1300 ] 210 0.000% 99.979%
( 1300, 1900 ] 143 0.000% 99.979%
( 1900, 2900 ] 322 0.000% 99.979%
( 2900, 4400 ] 225 0.000% 99.979%
( 4400, 6600 ] 115 0.000% 99.979%
( 6600, 9900 ] 167 0.000% 99.979%
( 9900, 14000 ] 10488 0.005% 99.985%
( 14000, 22000 ] 2550 0.001% 99.986%
( 22000, 33000 ] 24287 0.013% 99.999%
( 33000, 50000 ] 1714 0.001% 100.000%
( 50000, 75000 ] 305 0.000% 100.000%
( 75000, 110000 ] 121 0.000% 100.000%
( 110000, 170000 ] 109 0.000% 100.000%
( 170000, 250000 ] 53 0.000% 100.000%
( 250000, 380000 ] 24 0.000% 100.000%
( 380000, 570000 ] 15 0.000% 100.000%
( 570000, 860000 ] 8 0.000% 100.000%
real 0m34.077s
user 10m37.917s
sys 0m11.744s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:09:30 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.183 micros/op 5472248 ops/sec; 96.3 MB/s (405259 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 8.1774 StdDev: 14.37
Min: 0 Median: 2.2012 Max: 1148052
Percentiles: P50: 2.20 P75: 3.81 P99: 18.28 P99.9: 50.37 P99.99: 25912.12
------------------------------------------------------
[ 0, 1 ] 33787103 17.597% 17.597% ####
( 1, 2 ] 56329429 29.338% 46.936% ######
( 2, 3 ] 29244865 15.232% 62.167% ###
( 3, 4 ] 30332330 15.798% 77.965% ###
( 4, 6 ] 34021546 17.720% 95.685% ####
( 6, 10 ] 5400128 2.813% 98.498% #
( 10, 15 ] 651060 0.339% 98.837%
( 15, 22 ] 669585 0.349% 99.185%
( 22, 34 ] 890673 0.464% 99.649%
( 34, 51 ] 499856 0.260% 99.910%
( 51, 76 ] 113180 0.059% 99.969%
( 76, 110 ] 14507 0.008% 99.976%
( 110, 170 ] 1107 0.001% 99.977%
( 170, 250 ] 500 0.000% 99.977%
( 250, 380 ] 328 0.000% 99.977%
( 380, 580 ] 248 0.000% 99.977%
( 580, 870 ] 128 0.000% 99.977%
( 870, 1300 ] 193 0.000% 99.977%
( 1300, 1900 ] 110 0.000% 99.978%
( 1900, 2900 ] 216 0.000% 99.978%
( 2900, 4400 ] 210 0.000% 99.978%
( 4400, 6600 ] 85 0.000% 99.978%
( 6600, 9900 ] 145 0.000% 99.978%
( 9900, 14000 ] 11728 0.006% 99.984%
( 14000, 22000 ] 2264 0.001% 99.985%
( 22000, 33000 ] 26082 0.014% 99.999%
( 33000, 50000 ] 1700 0.001% 100.000%
( 50000, 75000 ] 334 0.000% 100.000%
( 75000, 110000 ] 124 0.000% 100.000%
( 110000, 170000 ] 105 0.000% 100.000%
( 170000, 250000 ] 44 0.000% 100.000%
( 250000, 380000 ] 51 0.000% 100.000%
( 380000, 570000 ] 25 0.000% 100.000%
( 570000, 860000 ] 8 0.000% 100.000%
( 860000, 1200000 ] 3 0.000% 100.000%
real 0m35.183s
user 11m5.917s
sys 0m11.366s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:10:06 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.184 micros/op 5441056 ops/sec; 90.9 MB/s (398341 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.4882 StdDev: 10.83
Min: 0 Median: 1.9617 Max: 1371275
Percentiles: P50: 1.96 P75: 3.65 P99: 11.34 P99.9: 55.70 P99.99: 25217.38
------------------------------------------------------
[ 0, 1 ] 46630329 24.287% 24.287% #####
( 1, 2 ] 51337379 26.738% 51.025% #####
( 2, 3 ] 27228029 14.181% 65.206% ###
( 3, 4 ] 29083004 15.147% 80.354% ###
( 4, 6 ] 30949630 16.120% 96.473% ###
( 6, 10 ] 4691578 2.444% 98.917%
( 10, 15 ] 598477 0.312% 99.228%
( 15, 22 ] 254139 0.132% 99.361%
( 22, 34 ] 649810 0.338% 99.699%
( 34, 51 ] 357713 0.186% 99.885%
( 51, 76 ] 148582 0.077% 99.963%
( 76, 110 ] 28778 0.015% 99.978%
( 110, 170 ] 1718 0.001% 99.979%
( 170, 250 ] 526 0.000% 99.979%
( 250, 380 ] 370 0.000% 99.979%
( 380, 580 ] 230 0.000% 99.979%
( 580, 870 ] 176 0.000% 99.979%
( 870, 1300 ] 259 0.000% 99.980%
( 1300, 1900 ] 155 0.000% 99.980%
( 1900, 2900 ] 331 0.000% 99.980%
( 2900, 4400 ] 319 0.000% 99.980%
( 4400, 6600 ] 99 0.000% 99.980%
( 6600, 9900 ] 113 0.000% 99.980%
( 9900, 14000 ] 9288 0.005% 99.985%
( 14000, 22000 ] 2848 0.001% 99.986%
( 22000, 33000 ] 23659 0.012% 99.999%
( 33000, 50000 ] 1844 0.001% 100.000%
( 50000, 75000 ] 314 0.000% 100.000%
( 75000, 110000 ] 131 0.000% 100.000%
( 110000, 170000 ] 87 0.000% 100.000%
( 170000, 250000 ] 27 0.000% 100.000%
( 250000, 380000 ] 24 0.000% 100.000%
( 380000, 570000 ] 16 0.000% 100.000%
( 570000, 860000 ] 12 0.000% 100.000%
( 860000, 1200000 ] 5 0.000% 100.000%
( 1200000, 1900000 ] 1 0.000% 100.000%
real 0m35.671s
user 10m16.912s
sys 0m10.578s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:10:41 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.171 micros/op 5838680 ops/sec; 81.3 MB/s (372366 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 6.2618 StdDev: 12.97
Min: 0 Median: 1.5710 Max: 1241048
Percentiles: P50: 1.57 P75: 3.23 P99: 15.31 P99.9: 60.40 P99.99: 20779.12
------------------------------------------------------
[ 0, 1 ] 68568482 35.713% 35.713% #######
( 1, 2 ] 48039512 25.021% 60.733% #####
( 2, 3 ] 21875595 11.394% 72.127% ##
( 3, 4 ] 23668891 12.328% 84.454% ##
( 4, 6 ] 23859965 12.427% 96.881% ##
( 6, 10 ] 3603849 1.877% 98.758%
( 10, 15 ] 449284 0.234% 98.992%
( 15, 22 ] 325185 0.169% 99.162%
( 22, 34 ] 908220 0.473% 99.635%
( 34, 51 ] 429682 0.224% 99.859%
( 51, 76 ] 211039 0.110% 99.969%
( 76, 110 ] 25566 0.013% 99.982%
( 110, 170 ] 1001 0.001% 99.982%
( 170, 250 ] 486 0.000% 99.983%
( 250, 380 ] 305 0.000% 99.983%
( 380, 580 ] 164 0.000% 99.983%
( 580, 870 ] 129 0.000% 99.983%
( 870, 1300 ] 209 0.000% 99.983%
( 1300, 1900 ] 89 0.000% 99.983%
( 1900, 2900 ] 193 0.000% 99.983%
( 2900, 4400 ] 181 0.000% 99.983%
( 4400, 6600 ] 94 0.000% 99.983%
( 6600, 9900 ] 126 0.000% 99.983%
( 9900, 14000 ] 11076 0.006% 99.989%
( 14000, 22000 ] 1743 0.001% 99.990%
( 22000, 33000 ] 16958 0.009% 99.999%
( 33000, 50000 ] 1368 0.001% 100.000%
( 50000, 75000 ] 319 0.000% 100.000%
( 75000, 110000 ] 129 0.000% 100.000%
( 110000, 170000 ] 78 0.000% 100.000%
( 170000, 250000 ] 32 0.000% 100.000%
( 250000, 380000 ] 21 0.000% 100.000%
( 380000, 570000 ] 11 0.000% 100.000%
( 570000, 860000 ] 16 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
( 1200000, 1900000 ] 1 0.000% 100.000%
real 0m33.059s
user 9m14.845s
sys 0m12.213s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:11:14 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.179 micros/op 5588923 ops/sec; 101.7 MB/s (442752 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 8.0569 StdDev: 16.55
Min: 0 Median: 2.2087 Max: 522001
Percentiles: P50: 2.21 P75: 3.87 P99: 21.62 P99.9: 61.56 P99.99: 25621.74
------------------------------------------------------
[ 0, 1 ] 43029895 22.411% 22.411% ####
( 1, 2 ] 47765628 24.878% 47.289% #####
( 2, 3 ] 24941991 12.991% 60.280% ###
( 3, 4 ] 32373104 16.861% 77.141% ###
( 4, 6 ] 35673433 18.580% 95.721% ####
( 6, 10 ] 5279788 2.750% 98.471% #
( 10, 15 ] 639699 0.333% 98.804%
( 15, 22 ] 398090 0.207% 99.011%
( 22, 34 ] 1029535 0.536% 99.547%
( 34, 51 ] 578812 0.301% 99.849%
( 51, 76 ] 232054 0.121% 99.970%
( 76, 110 ] 14221 0.007% 99.977%
( 110, 170 ] 1031 0.001% 99.978%
( 170, 250 ] 560 0.000% 99.978%
( 250, 380 ] 399 0.000% 99.978%
( 380, 580 ] 266 0.000% 99.978%
( 580, 870 ] 190 0.000% 99.978%
( 870, 1300 ] 254 0.000% 99.979%
( 1300, 1900 ] 168 0.000% 99.979%
( 1900, 2900 ] 383 0.000% 99.979%
( 2900, 4400 ] 300 0.000% 99.979%
( 4400, 6600 ] 117 0.000% 99.979%
( 6600, 9900 ] 97 0.000% 99.979%
( 9900, 14000 ] 10778 0.006% 99.985%
( 14000, 22000 ] 2134 0.001% 99.986%
( 22000, 33000 ] 23912 0.012% 99.998%
( 33000, 50000 ] 2191 0.001% 99.999%
( 50000, 75000 ] 487 0.000% 100.000%
( 75000, 110000 ] 233 0.000% 100.000%
( 110000, 170000 ] 125 0.000% 100.000%
( 170000, 250000 ] 63 0.000% 100.000%
( 250000, 380000 ] 40 0.000% 100.000%
( 380000, 570000 ] 22 0.000% 100.000%
real 0m34.812s
user 11m7.765s
sys 0m12.254s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:11:49 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.137 micros/op 7312792 ops/sec; 106.8 MB/s (278486 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 6.5144 StdDev: 12.78
Min: 0 Median: 1.6673 Max: 759956
Percentiles: P50: 1.67 P75: 3.30 P99: 8.98 P99.9: 30.08 P99.99: 23877.45
------------------------------------------------------
[ 0, 1 ] 59173457 30.820% 30.820% ######
( 1, 2 ] 55184389 28.742% 59.561% ######
( 2, 3 ] 22209612 11.568% 71.129% ##
( 3, 4 ] 24731270 12.881% 84.010% ###
( 4, 6 ] 25844200 13.461% 97.470% ###
( 6, 10 ] 3935900 2.050% 99.520%
( 10, 15 ] 481266 0.251% 99.771%
( 15, 22 ] 98800 0.051% 99.822%
( 22, 34 ] 221575 0.115% 99.938%
( 34, 51 ] 69279 0.036% 99.974%
( 51, 76 ] 11590 0.006% 99.980%
( 76, 110 ] 1114 0.001% 99.980%
( 110, 170 ] 567 0.000% 99.981%
( 170, 250 ] 494 0.000% 99.981%
( 250, 380 ] 361 0.000% 99.981%
( 380, 580 ] 282 0.000% 99.981%
( 580, 870 ] 219 0.000% 99.981%
( 870, 1300 ] 326 0.000% 99.982%
( 1300, 1900 ] 163 0.000% 99.982%
( 1900, 2900 ] 437 0.000% 99.982%
( 2900, 4400 ] 342 0.000% 99.982%
( 4400, 6600 ] 115 0.000% 99.982%
( 6600, 9900 ] 76 0.000% 99.982%
( 9900, 14000 ] 9080 0.005% 99.987%
( 14000, 22000 ] 2304 0.001% 99.988%
( 22000, 33000 ] 20987 0.011% 99.999%
( 33000, 50000 ] 1228 0.001% 100.000%
( 50000, 75000 ] 259 0.000% 100.000%
( 75000, 110000 ] 147 0.000% 100.000%
( 110000, 170000 ] 92 0.000% 100.000%
( 170000, 250000 ] 30 0.000% 100.000%
( 250000, 380000 ] 10 0.000% 100.000%
( 380000, 570000 ] 17 0.000% 100.000%
( 570000, 860000 ] 12 0.000% 100.000%
real 0m26.415s
user 8m44.702s
sys 0m4.382s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:12:16 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.166 micros/op 6037612 ops/sec; 96.5 MB/s (544206 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.2016 StdDev: 7.63
Min: 0 Median: 1.8112 Max: 771030
Percentiles: P50: 1.81 P75: 3.46 P99: 12.24 P99.9: 53.74 P99.99: 24885.45
------------------------------------------------------
[ 0, 1 ] 48774186 25.403% 25.403% #####
( 1, 2 ] 58220537 30.323% 55.726% ######
( 2, 3 ] 24588838 12.807% 68.533% ###
( 3, 4 ] 27045184 14.086% 82.619% ###
( 4, 6 ] 27465697 14.305% 96.924% ###
( 6, 10 ] 3748326 1.952% 98.876%
( 10, 15 ] 529466 0.276% 99.152%
( 15, 22 ] 277352 0.144% 99.297%
( 22, 34 ] 774269 0.403% 99.700%
( 34, 51 ] 367820 0.192% 99.891%
( 51, 76 ] 148781 0.077% 99.969%
( 76, 110 ] 19601 0.010% 99.979%
( 110, 170 ] 718 0.000% 99.980%
( 170, 250 ] 379 0.000% 99.980%
( 250, 380 ] 307 0.000% 99.980%
( 380, 580 ] 169 0.000% 99.980%
( 580, 870 ] 141 0.000% 99.980%
( 870, 1300 ] 257 0.000% 99.980%
( 1300, 1900 ] 138 0.000% 99.980%
( 1900, 2900 ] 334 0.000% 99.980%
( 2900, 4400 ] 376 0.000% 99.981%
( 4400, 6600 ] 107 0.000% 99.981%
( 6600, 9900 ] 71 0.000% 99.981%
( 9900, 14000 ] 9674 0.005% 99.986%
( 14000, 22000 ] 2038 0.001% 99.987%
( 22000, 33000 ] 23003 0.012% 99.999%
( 33000, 50000 ] 1589 0.001% 100.000%
( 50000, 75000 ] 345 0.000% 100.000%
( 75000, 110000 ] 119 0.000% 100.000%
( 110000, 170000 ] 99 0.000% 100.000%
( 170000, 250000 ] 39 0.000% 100.000%
( 250000, 380000 ] 15 0.000% 100.000%
( 380000, 570000 ] 13 0.000% 100.000%
( 570000, 860000 ] 12 0.000% 100.000%
real 0m32.022s
user 9m52.880s
sys 0m9.904s
+ echo '#### Without cpu prio, strong zstd compression'
#### Without cpu prio, strong zstd compression
++ seq 1 10
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:12:48 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.236 micros/op 809130 ops/sec; 36.6 MB/s (434546 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 67.5931 StdDev: 19.71
Min: 0 Median: 2.0548 Max: 675333
Percentiles: P50: 2.05 P75: 33.16 P99: 203.75 P99.9: 13976.64 P99.99: 35818.82
------------------------------------------------------
[ 0, 1 ] 48954651 25.497% 25.497% #####
( 1, 2 ] 46280240 24.104% 49.602% #####
( 2, 3 ] 13950982 7.266% 56.868% #
( 3, 4 ] 9242307 4.814% 61.681% #
( 4, 6 ] 6916885 3.603% 65.284% #
( 6, 10 ] 2995737 1.560% 66.844%
( 10, 15 ] 519229 0.270% 67.115%
( 15, 22 ] 9253824 4.820% 71.934% #
( 22, 34 ] 6330477 3.297% 75.231% #
( 34, 51 ] 8881854 4.626% 79.857% #
( 51, 76 ] 11342492 5.908% 85.765% #
( 76, 110 ] 14759773 7.687% 93.452% ##
( 110, 170 ] 9951258 5.183% 98.635% #
( 170, 250 ] 1659762 0.864% 99.500%
( 250, 380 ] 147567 0.077% 99.577%
( 380, 580 ] 22080 0.011% 99.588%
( 580, 870 ] 26833 0.014% 99.602%
( 870, 1300 ] 35084 0.018% 99.620%
( 1300, 1900 ] 45085 0.023% 99.644%
( 1900, 2900 ] 65856 0.034% 99.678%
( 2900, 4400 ] 76974 0.040% 99.718%
( 4400, 6600 ] 88350 0.046% 99.764%
( 6600, 9900 ] 103492 0.054% 99.818%
( 9900, 14000 ] 158109 0.082% 99.900%
( 14000, 22000 ] 101945 0.053% 99.954%
( 22000, 33000 ] 66847 0.035% 99.988%
( 33000, 50000 ] 18738 0.010% 99.998%
( 50000, 75000 ] 3015 0.002% 100.000%
( 75000, 110000 ] 403 0.000% 100.000%
( 110000, 170000 ] 82 0.000% 100.000%
( 170000, 250000 ] 36 0.000% 100.000%
( 250000, 380000 ] 18 0.000% 100.000%
( 380000, 570000 ] 6 0.000% 100.000%
( 570000, 860000 ] 9 0.000% 100.000%
real 3m58.403s
user 79m43.664s
sys 8m36.122s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:16:46 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.098 micros/op 910619 ops/sec; 38.3 MB/s (1218872 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 56.4453 StdDev: 10.43
Min: 0 Median: 1.8916 Max: 804329
Percentiles: P50: 1.89 P75: 24.56 P99: 169.69 P99.9: 12194.30 P99.99: 31330.26
------------------------------------------------------
[ 0, 1 ] 50836859 26.478% 26.478% #####
( 1, 2 ] 50655084 26.383% 52.860% #####
( 2, 3 ] 14029923 7.307% 60.168% #
( 3, 4 ] 8462801 4.408% 64.575% #
( 4, 6 ] 6780355 3.531% 68.107% #
( 6, 10 ] 2716658 1.415% 69.522%
( 10, 15 ] 463645 0.241% 69.763%
( 15, 22 ] 8829671 4.599% 74.362% #
( 22, 34 ] 5747594 2.994% 77.356% #
( 34, 51 ] 8754186 4.559% 81.915% #
( 51, 76 ] 10657887 5.551% 87.466% #
( 76, 110 ] 14025096 7.305% 94.771% #
( 110, 170 ] 8162640 4.251% 99.022% #
( 170, 250 ] 1005350 0.524% 99.546%
( 250, 380 ] 88157 0.046% 99.592%
( 380, 580 ] 24874 0.013% 99.605%
( 580, 870 ] 32105 0.017% 99.621%
( 870, 1300 ] 42450 0.022% 99.643%
( 1300, 1900 ] 52299 0.027% 99.671%
( 1900, 2900 ] 75923 0.040% 99.710%
( 2900, 4400 ] 88954 0.046% 99.757%
( 4400, 6600 ] 96694 0.050% 99.807%
( 6600, 9900 ] 103635 0.054% 99.861%
( 9900, 14000 ] 134314 0.070% 99.931%
( 14000, 22000 ] 75319 0.039% 99.970%
( 22000, 33000 ] 45186 0.024% 99.994%
( 33000, 50000 ] 10572 0.006% 99.999%
( 50000, 75000 ] 1460 0.001% 100.000%
( 75000, 110000 ] 191 0.000% 100.000%
( 110000, 170000 ] 46 0.000% 100.000%
( 170000, 250000 ] 29 0.000% 100.000%
( 250000, 380000 ] 14 0.000% 100.000%
( 380000, 570000 ] 15 0.000% 100.000%
( 570000, 860000 ] 14 0.000% 100.000%
real 3m31.121s
user 71m9.396s
sys 7m37.956s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:20:17 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.054 micros/op 948412 ops/sec; 39.4 MB/s (1284213 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 50.3571 StdDev: 21.81
Min: 0 Median: 1.8805 Max: 607137
Percentiles: P50: 1.88 P75: 24.79 P99: 161.73 P99.9: 11154.23 P99.99: 29611.86
------------------------------------------------------
[ 0, 1 ] 60009404 31.255% 31.255% ######
( 1, 2 ] 40875675 21.289% 52.544% ####
( 2, 3 ] 13494096 7.028% 59.572% #
( 3, 4 ] 8809806 4.588% 64.161% #
( 4, 6 ] 7153504 3.726% 67.887% #
( 6, 10 ] 2523148 1.314% 69.201%
( 10, 15 ] 454893 0.237% 69.438%
( 15, 22 ] 9254343 4.820% 74.258% #
( 22, 34 ] 6128257 3.192% 77.450% #
( 34, 51 ] 9459570 4.927% 82.376% #
( 51, 76 ] 12270520 6.391% 88.767% #
( 76, 110 ] 13939522 7.260% 96.027% #
( 110, 170 ] 6619583 3.448% 99.475% #
( 170, 250 ] 264374 0.138% 99.613%
( 250, 380 ] 31140 0.016% 99.629%
( 380, 580 ] 23043 0.012% 99.641%
( 580, 870 ] 29939 0.016% 99.657%
( 870, 1300 ] 39577 0.021% 99.677%
( 1300, 1900 ] 48389 0.025% 99.702%
( 1900, 2900 ] 71610 0.037% 99.740%
( 2900, 4400 ] 83572 0.044% 99.783%
( 4400, 6600 ] 90380 0.047% 99.830%
( 6600, 9900 ] 95844 0.050% 99.880%
( 9900, 14000 ] 123602 0.064% 99.945%
( 14000, 22000 ] 61957 0.032% 99.977%
( 22000, 33000 ] 36203 0.019% 99.996%
( 33000, 50000 ] 6871 0.004% 99.999%
( 50000, 75000 ] 879 0.000% 100.000%
( 75000, 110000 ] 149 0.000% 100.000%
( 110000, 170000 ] 69 0.000% 100.000%
( 170000, 250000 ] 45 0.000% 100.000%
( 250000, 380000 ] 17 0.000% 100.000%
( 380000, 570000 ] 12 0.000% 100.000%
( 570000, 860000 ] 7 0.000% 100.000%
real 3m22.602s
user 67m0.795s
sys 7m13.243s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:23:40 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.922 micros/op 1084264 ops/sec; 37.5 MB/s (1147412 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 41.9180 StdDev: 14.70
Min: 0 Median: 1.6641 Max: 936003
Percentiles: P50: 1.66 P75: 15.10 P99: 166.75 P99.9: 10163.52 P99.99: 28422.95
------------------------------------------------------
[ 0, 1 ] 67624524 35.221% 35.221% #######
( 1, 2 ] 42728289 22.254% 57.475% ####
( 2, 3 ] 14658709 7.635% 65.110% ##
( 3, 4 ] 9295513 4.841% 69.952% #
( 4, 6 ] 6813351 3.549% 73.500% #
( 6, 10 ] 2316216 1.206% 74.707%
( 10, 15 ] 453993 0.236% 74.943%
( 15, 22 ] 7962664 4.147% 79.090% #
( 22, 34 ] 5039512 2.625% 81.715% #
( 34, 51 ] 7199473 3.750% 85.465% #
( 51, 76 ] 9555587 4.977% 90.442% #
( 76, 110 ] 11105208 5.784% 96.226% #
( 110, 170 ] 5632169 2.933% 99.159% #
( 170, 250 ] 915503 0.477% 99.636%
( 250, 380 ] 156553 0.082% 99.717%
( 380, 580 ] 16321 0.009% 99.726%
( 580, 870 ] 21193 0.011% 99.737%
( 870, 1300 ] 26956 0.014% 99.751%
( 1300, 1900 ] 33325 0.017% 99.768%
( 1900, 2900 ] 49415 0.026% 99.794%
( 2900, 4400 ] 59352 0.031% 99.825%
( 4400, 6600 ] 65153 0.034% 99.859%
( 6600, 9900 ] 71849 0.037% 99.896%
( 9900, 14000 ] 111586 0.058% 99.954%
( 14000, 22000 ] 50341 0.026% 99.981%
( 22000, 33000 ] 30904 0.016% 99.997%
( 33000, 50000 ] 5471 0.003% 100.000%
( 50000, 75000 ] 639 0.000% 100.000%
( 75000, 110000 ] 130 0.000% 100.000%
( 110000, 170000 ] 48 0.000% 100.000%
( 170000, 250000 ] 20 0.000% 100.000%
( 250000, 380000 ] 21 0.000% 100.000%
( 380000, 570000 ] 10 0.000% 100.000%
( 570000, 860000 ] 1 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
real 2m57.224s
user 58m16.611s
sys 6m6.395s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:26:37 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.645 micros/op 1550056 ops/sec; 33.2 MB/s (115161 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 19.0564 StdDev: 18.53
Min: 0 Median: 1.3737 Max: 892498
Percentiles: P50: 1.37 P75: 2.92 P99: 129.14 P99.9: 526.23 P99.99: 20604.76
------------------------------------------------------
[ 0, 1 ] 77912898 40.580% 40.580% ########
( 1, 2 ] 48399479 25.208% 65.788% #####
( 2, 3 ] 19308864 10.057% 75.844% ##
( 3, 4 ] 8835090 4.602% 80.446% #
( 4, 6 ] 6474775 3.372% 83.818% #
( 6, 10 ] 1793522 0.934% 84.752%
( 10, 15 ] 401490 0.209% 84.962%
( 15, 22 ] 5092902 2.653% 87.614% #
( 22, 34 ] 3863230 2.012% 89.626%
( 34, 51 ] 4689537 2.442% 92.069%
( 51, 76 ] 6213466 3.236% 95.305% #
( 76, 110 ] 6448966 3.359% 98.664% #
( 110, 170 ] 2023904 1.054% 99.718%
( 170, 250 ] 335383 0.175% 99.892%
( 250, 380 ] 9588 0.005% 99.897%
( 380, 580 ] 6710 0.003% 99.901%
( 580, 870 ] 8363 0.004% 99.905%
( 870, 1300 ] 10486 0.005% 99.911%
( 1300, 1900 ] 12399 0.006% 99.917%
( 1900, 2900 ] 18201 0.009% 99.927%
( 2900, 4400 ] 21398 0.011% 99.938%
( 4400, 6600 ] 22912 0.012% 99.950%
( 6600, 9900 ] 24079 0.013% 99.962%
( 9900, 14000 ] 43823 0.023% 99.985%
( 14000, 22000 ] 11307 0.006% 99.991%
( 22000, 33000 ] 15288 0.008% 99.999%
( 33000, 50000 ] 1480 0.001% 100.000%
( 50000, 75000 ] 252 0.000% 100.000%
( 75000, 110000 ] 82 0.000% 100.000%
( 110000, 170000 ] 65 0.000% 100.000%
( 170000, 250000 ] 28 0.000% 100.000%
( 250000, 380000 ] 10 0.000% 100.000%
( 380000, 570000 ] 10 0.000% 100.000%
( 570000, 860000 ] 10 0.000% 100.000%
( 860000, 1200000 ] 3 0.000% 100.000%
real 2m4.013s
user 34m36.544s
sys 3m20.995s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:28:41 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.788 micros/op 1269484 ops/sec; 41.6 MB/s (440801 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 39.1875 StdDev: 12.45
Min: 0 Median: 1.6353 Max: 668513
Percentiles: P50: 1.64 P75: 6.17 P99: 151.88 P99.9: 9631.86 P99.99: 29300.97
------------------------------------------------------
[ 0, 1 ] 61583693 32.075% 32.075% ######
( 1, 2 ] 54172425 28.215% 60.290% ######
( 2, 3 ] 14305170 7.451% 67.740% #
( 3, 4 ] 8180336 4.261% 72.001% #
( 4, 6 ] 5665794 2.951% 74.952% #
( 6, 10 ] 2135489 1.112% 76.064%
( 10, 15 ] 380557 0.198% 76.262%
( 15, 22 ] 8133198 4.236% 80.498% #
( 22, 34 ] 4825336 2.513% 83.011% #
( 34, 51 ] 7532728 3.923% 86.935% #
( 51, 76 ] 9250820 4.818% 91.753% #
( 76, 110 ] 11020970 5.740% 97.493% #
( 110, 170 ] 4145860 2.159% 99.652%
( 170, 250 ] 132055 0.069% 99.721%
( 250, 380 ] 26737 0.014% 99.735%
( 380, 580 ] 15072 0.008% 99.743%
( 580, 870 ] 19455 0.010% 99.753%
( 870, 1300 ] 25435 0.013% 99.766%
( 1300, 1900 ] 32010 0.017% 99.783%
( 1900, 2900 ] 46818 0.024% 99.807%
( 2900, 4400 ] 54988 0.029% 99.836%
( 4400, 6600 ] 60776 0.032% 99.868%
( 6600, 9900 ] 67786 0.035% 99.903%
( 9900, 14000 ] 94642 0.049% 99.952%
( 14000, 22000 ] 49636 0.026% 99.978%
( 22000, 33000 ] 34674 0.018% 99.996%
( 33000, 50000 ] 6367 0.003% 99.999%
( 50000, 75000 ] 893 0.000% 100.000%
( 75000, 110000 ] 137 0.000% 100.000%
( 110000, 170000 ] 68 0.000% 100.000%
( 170000, 250000 ] 32 0.000% 100.000%
( 250000, 380000 ] 24 0.000% 100.000%
( 380000, 570000 ] 12 0.000% 100.000%
( 570000, 860000 ] 7 0.000% 100.000%
real 2m31.504s
user 51m10.041s
sys 5m19.877s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:31:12 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.044 micros/op 957600 ops/sec; 40.4 MB/s (592856 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 56.7270 StdDev: 21.09
Min: 0 Median: 1.9415 Max: 638724
Percentiles: P50: 1.94 P75: 24.56 P99: 164.12 P99.9: 12556.60 P99.99: 31656.14
------------------------------------------------------
[ 0, 1 ] 45616690 23.759% 23.759% #####
( 1, 2 ] 53512967 27.871% 51.630% ######
( 2, 3 ] 15201723 7.918% 59.548% ##
( 3, 4 ] 9176757 4.780% 64.327% #
( 4, 6 ] 6971432 3.631% 67.958% #
( 6, 10 ] 2602200 1.355% 69.313%
( 10, 15 ] 477863 0.249% 69.562%
( 15, 22 ] 9211585 4.798% 74.360% #
( 22, 34 ] 5752260 2.996% 77.356% #
( 34, 51 ] 9122969 4.752% 82.108% #
( 51, 76 ] 11289194 5.880% 87.987% #
( 76, 110 ] 14303822 7.450% 95.437% #
( 110, 170 ] 7584177 3.950% 99.387% #
( 170, 250 ] 377118 0.196% 99.584%
( 250, 380 ] 43344 0.023% 99.606%
( 380, 580 ] 21655 0.011% 99.618%
( 580, 870 ] 28492 0.015% 99.632%
( 870, 1300 ] 37267 0.019% 99.652%
( 1300, 1900 ] 45988 0.024% 99.676%
( 1900, 2900 ] 66476 0.035% 99.710%
( 2900, 4400 ] 80469 0.042% 99.752%
( 4400, 6600 ] 91115 0.047% 99.800%
( 6600, 9900 ] 102410 0.053% 99.853%
( 9900, 14000 ] 138941 0.072% 99.925%
( 14000, 22000 ] 80206 0.042% 99.967%
( 22000, 33000 ] 49759 0.026% 99.993%
( 33000, 50000 ] 11291 0.006% 99.999%
( 50000, 75000 ] 1550 0.001% 100.000%
( 75000, 110000 ] 183 0.000% 100.000%
( 110000, 170000 ] 45 0.000% 100.000%
( 170000, 250000 ] 13 0.000% 100.000%
( 250000, 380000 ] 15 0.000% 100.000%
( 380000, 570000 ] 17 0.000% 100.000%
( 570000, 860000 ] 7 0.000% 100.000%
real 3m21.499s
user 68m54.497s
sys 7m18.733s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:34:34 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.768 micros/op 1302516 ops/sec; 40.3 MB/s (128910 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 35.6410 StdDev: 20.73
Min: 0 Median: 1.5880 Max: 777859
Percentiles: P50: 1.59 P75: 4.77 P99: 150.56 P99.9: 8570.30 P99.99: 28728.34
------------------------------------------------------
[ 0, 1 ] 65142196 33.928% 33.928% #######
( 1, 2 ] 52477791 27.332% 61.260% #####
( 2, 3 ] 15559792 8.104% 69.364% ##
( 3, 4 ] 8695057 4.529% 73.893% #
( 4, 6 ] 5527662 2.879% 76.772% #
( 6, 10 ] 1908979 0.994% 77.766%
( 10, 15 ] 387993 0.202% 77.968%
( 15, 22 ] 7399445 3.854% 81.822% #
( 22, 34 ] 4612213 2.402% 84.225%
( 34, 51 ] 6939419 3.614% 87.839% #
( 51, 76 ] 8700141 4.531% 92.370% #
( 76, 110 ] 10056729 5.238% 97.608% #
( 110, 170 ] 3953439 2.059% 99.667%
( 170, 250 ] 176254 0.092% 99.759%
( 250, 380 ] 18563 0.010% 99.769%
( 380, 580 ] 12226 0.006% 99.775%
( 580, 870 ] 16453 0.009% 99.784%
( 870, 1300 ] 21901 0.011% 99.795%
( 1300, 1900 ] 26331 0.014% 99.809%
( 1900, 2900 ] 39449 0.021% 99.829%
( 2900, 4400 ] 48410 0.025% 99.854%
( 4400, 6600 ] 52555 0.027% 99.882%
( 6600, 9900 ] 58624 0.031% 99.912%
( 9900, 14000 ] 87133 0.045% 99.958%
( 14000, 22000 ] 42909 0.022% 99.980%
( 22000, 33000 ] 31285 0.016% 99.996%
( 33000, 50000 ] 5943 0.003% 99.999%
( 50000, 75000 ] 834 0.000% 100.000%
( 75000, 110000 ] 144 0.000% 100.000%
( 110000, 170000 ] 62 0.000% 100.000%
( 170000, 250000 ] 32 0.000% 100.000%
( 250000, 380000 ] 15 0.000% 100.000%
( 380000, 570000 ] 10 0.000% 100.000%
( 570000, 860000 ] 11 0.000% 100.000%
real 2m27.639s
user 48m16.768s
sys 4m59.973s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:37:02 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 1.411 micros/op 708859 ops/sec; 35.9 MB/s (874581 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 80.6158 StdDev: 11.43
Min: 0 Median: 2.6110 Max: 671618
Percentiles: P50: 2.61 P75: 46.02 P99: 233.11 P99.9: 16277.64 P99.99: 38080.17
------------------------------------------------------
[ 0, 1 ] 40759517 21.229% 21.229% ####
( 1, 2 ] 46909533 24.432% 45.661% #####
( 2, 3 ] 13635983 7.102% 52.763% #
( 3, 4 ] 8251810 4.298% 57.061% #
( 4, 6 ] 6640040 3.458% 60.519% #
( 6, 10 ] 3375238 1.758% 62.277%
( 10, 15 ] 575885 0.300% 62.577%
( 15, 22 ] 9523922 4.960% 67.537% #
( 22, 34 ] 7301920 3.803% 71.341% #
( 34, 51 ] 9936995 5.176% 76.516% #
( 51, 76 ] 12547489 6.535% 83.051% #
( 76, 110 ] 16795551 8.748% 91.799% ##
( 110, 170 ] 11769172 6.130% 97.929% #
( 170, 250 ] 2607444 1.358% 99.287%
( 250, 380 ] 404893 0.211% 99.498%
( 380, 580 ] 24454 0.013% 99.510%
( 580, 870 ] 29781 0.016% 99.526%
( 870, 1300 ] 39457 0.021% 99.546%
( 1300, 1900 ] 48894 0.025% 99.572%
( 1900, 2900 ] 73595 0.038% 99.610%
( 2900, 4400 ] 88906 0.046% 99.656%
( 4400, 6600 ] 104046 0.054% 99.711%
( 6600, 9900 ] 123954 0.065% 99.775%
( 9900, 14000 ] 204242 0.106% 99.882%
( 14000, 22000 ] 123914 0.065% 99.946%
( 22000, 33000 ] 77657 0.040% 99.987%
( 33000, 50000 ] 21778 0.011% 99.998%
( 50000, 75000 ] 3429 0.002% 100.000%
( 75000, 110000 ] 386 0.000% 100.000%
( 110000, 170000 ] 58 0.000% 100.000%
( 170000, 250000 ] 25 0.000% 100.000%
( 250000, 380000 ] 18 0.000% 100.000%
( 380000, 570000 ] 9 0.000% 100.000%
( 570000, 860000 ] 5 0.000% 100.000%
real 4m31.904s
user 93m35.058s
sys 10m6.127s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13
RocksDB: version 5.13
Date: Mon Apr 23 09:41:34 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.916 micros/op 1091149 ops/sec; 39.2 MB/s (127951 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 43.7427 StdDev: 16.04
Min: 0 Median: 1.7461 Max: 1315416
Percentiles: P50: 1.75 P75: 16.90 P99: 159.04 P99.9: 10352.92 P99.99: 28925.49
------------------------------------------------------
[ 0, 1 ] 61666762 32.118% 32.118% ######
( 1, 2 ] 46014236 23.966% 56.084% #####
( 2, 3 ] 16124655 8.398% 64.482% ##
( 3, 4 ] 8869397 4.619% 69.102% #
( 4, 6 ] 6430655 3.349% 72.451% #
( 6, 10 ] 2284022 1.190% 73.640%
( 10, 15 ] 444933 0.232% 73.872%
( 15, 22 ] 7990716 4.162% 78.034% #
( 22, 34 ] 5267328 2.743% 80.777% #
( 34, 51 ] 8005359 4.169% 84.947% #
( 51, 76 ] 10000440 5.209% 90.155% #
( 76, 110 ] 12396996 6.457% 96.612% #
( 110, 170 ] 5609460 2.922% 99.534% #
( 170, 250 ] 250162 0.130% 99.664%
( 250, 380 ] 39980 0.021% 99.685%
( 380, 580 ] 19513 0.010% 99.695%
( 580, 870 ] 24982 0.013% 99.708%
( 870, 1300 ] 32892 0.017% 99.725%
( 1300, 1900 ] 40447 0.021% 99.746%
( 1900, 2900 ] 58690 0.031% 99.777%
( 2900, 4400 ] 68950 0.036% 99.813%
( 4400, 6600 ] 75302 0.039% 99.852%
( 6600, 9900 ] 80052 0.042% 99.894%
( 9900, 14000 ] 109271 0.057% 99.951%
( 14000, 22000 ] 54272 0.028% 99.979%
( 22000, 33000 ] 33876 0.018% 99.997%
( 33000, 50000 ] 5800 0.003% 100.000%
( 50000, 75000 ] 687 0.000% 100.000%
( 75000, 110000 ] 89 0.000% 100.000%
( 110000, 170000 ] 27 0.000% 100.000%
( 170000, 250000 ] 14 0.000% 100.000%
( 250000, 380000 ] 16 0.000% 100.000%
( 380000, 570000 ] 13 0.000% 100.000%
( 570000, 860000 ] 5 0.000% 100.000%
( 1200000, 1900000 ] 1 0.000% 100.000%
real 2m56.137s
user 58m23.085s
sys 6m10.379s
+ echo '#### With cpu prio, strong zstd compression'
#### With cpu prio, strong zstd compression
++ seq 1 10
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:44:30 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.178 micros/op 5605172 ops/sec; 78.7 MB/s (380656 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 6.7093 StdDev: 12.04
Min: 0 Median: 1.6177 Max: 855658
Percentiles: P50: 1.62 P75: 3.20 P99: 27.32 P99.9: 66.07 P99.99: 22511.49
------------------------------------------------------
[ 0, 1 ] 60017553 31.259% 31.259% ######
( 1, 2 ] 58253144 30.340% 61.599% ######
( 2, 3 ] 21733360 11.319% 72.919% ##
( 3, 4 ] 20421738 10.636% 83.555% ##
( 4, 6 ] 23097690 12.030% 95.585% ##
( 6, 10 ] 4927664 2.566% 98.152% #
( 10, 15 ] 527360 0.275% 98.426%
( 15, 22 ] 551525 0.287% 98.714%
( 22, 34 ] 1239451 0.646% 99.359%
( 34, 51 ] 852732 0.444% 99.803%
( 51, 76 ] 308144 0.160% 99.964%
( 76, 110 ] 33484 0.017% 99.981%
( 110, 170 ] 1544 0.001% 99.982%
( 170, 250 ] 538 0.000% 99.982%
( 250, 380 ] 417 0.000% 99.982%
( 380, 580 ] 280 0.000% 99.983%
( 580, 870 ] 213 0.000% 99.983%
( 870, 1300 ] 458 0.000% 99.983%
( 1300, 1900 ] 241 0.000% 99.983%
( 1900, 2900 ] 537 0.000% 99.983%
( 2900, 4400 ] 340 0.000% 99.984%
( 4400, 6600 ] 109 0.000% 99.984%
( 6600, 9900 ] 111 0.000% 99.984%
( 9900, 14000 ] 7978 0.004% 99.988%
( 14000, 22000 ] 3339 0.002% 99.990%
( 22000, 33000 ] 18280 0.010% 99.999%
( 33000, 50000 ] 1206 0.001% 100.000%
( 50000, 75000 ] 204 0.000% 100.000%
( 75000, 110000 ] 121 0.000% 100.000%
( 110000, 170000 ] 106 0.000% 100.000%
( 170000, 250000 ] 61 0.000% 100.000%
( 250000, 380000 ] 30 0.000% 100.000%
( 380000, 570000 ] 32 0.000% 100.000%
( 570000, 860000 ] 10 0.000% 100.000%
real 0m34.446s
user 10m4.159s
sys 0m16.603s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:45:04 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.222 micros/op 4502004 ops/sec; 64.9 MB/s (361862 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 6.4554 StdDev: 10.66
Min: 0 Median: 1.5914 Max: 1472760
Percentiles: P50: 1.59 P75: 3.26 P99: 24.70 P99.9: 70.62 P99.99: 17436.89
------------------------------------------------------
[ 0, 1 ] 64607328 33.650% 33.650% #######
( 1, 2 ] 53080331 27.646% 61.296% ######
( 2, 3 ] 20594282 10.726% 72.022% ##
( 3, 4 ] 21783977 11.346% 83.368% ##
( 4, 6 ] 24514142 12.768% 96.135% ###
( 6, 10 ] 4138365 2.155% 98.291%
( 10, 15 ] 503016 0.262% 98.553%
( 15, 22 ] 638199 0.332% 98.885%
( 22, 34 ] 979787 0.510% 99.396%
( 34, 51 ] 674852 0.351% 99.747%
( 51, 76 ] 374329 0.195% 99.942%
( 76, 110 ] 68617 0.036% 99.978%
( 110, 170 ] 8936 0.005% 99.982%
( 170, 250 ] 490 0.000% 99.983%
( 250, 380 ] 474 0.000% 99.983%
( 380, 580 ] 307 0.000% 99.983%
( 580, 870 ] 174 0.000% 99.983%
( 870, 1300 ] 319 0.000% 99.983%
( 1300, 1900 ] 110 0.000% 99.983%
( 1900, 2900 ] 377 0.000% 99.984%
( 2900, 4400 ] 282 0.000% 99.984%
( 4400, 6600 ] 125 0.000% 99.984%
( 6600, 9900 ] 118 0.000% 99.984%
( 9900, 14000 ] 10682 0.006% 99.989%
( 14000, 22000 ] 2749 0.001% 99.991%
( 22000, 33000 ] 15531 0.008% 99.999%
( 33000, 50000 ] 1390 0.001% 100.000%
( 50000, 75000 ] 387 0.000% 100.000%
( 75000, 110000 ] 116 0.000% 100.000%
( 110000, 170000 ] 80 0.000% 100.000%
( 170000, 250000 ] 54 0.000% 100.000%
( 250000, 380000 ] 47 0.000% 100.000%
( 380000, 570000 ] 18 0.000% 100.000%
( 570000, 860000 ] 7 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
( 1200000, 1900000 ] 1 0.000% 100.000%
real 0m43.359s
user 10m5.539s
sys 0m19.707s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:45:47 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.184 micros/op 5439647 ops/sec; 85.0 MB/s (294626 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.1416 StdDev: 6.09
Min: 0 Median: 1.8019 Max: 742445
Percentiles: P50: 1.80 P75: 3.53 P99: 17.47 P99.9: 61.90 P99.99: 24029.99
------------------------------------------------------
[ 0, 1 ] 54440081 28.354% 28.354% ######
( 1, 2 ] 51826735 26.993% 55.347% #####
( 2, 3 ] 23843425 12.418% 67.766% ##
( 3, 4 ] 26283130 13.689% 81.455% ###
( 4, 6 ] 28264804 14.721% 96.176% ###
( 6, 10 ] 4630607 2.412% 98.588%
( 10, 15 ] 564657 0.294% 98.882%
( 15, 22 ] 641645 0.334% 99.216%
( 22, 34 ] 751567 0.391% 99.608%
( 34, 51 ] 478212 0.249% 99.857%
( 51, 76 ] 190596 0.099% 99.956%
( 76, 110 ] 43170 0.022% 99.978%
( 110, 170 ] 2454 0.001% 99.980%
( 170, 250 ] 569 0.000% 99.980%
( 250, 380 ] 419 0.000% 99.980%
( 380, 580 ] 322 0.000% 99.980%
( 580, 870 ] 255 0.000% 99.981%
( 870, 1300 ] 252 0.000% 99.981%
( 1300, 1900 ] 150 0.000% 99.981%
( 1900, 2900 ] 322 0.000% 99.981%
( 2900, 4400 ] 244 0.000% 99.981%
( 4400, 6600 ] 125 0.000% 99.981%
( 6600, 9900 ] 110 0.000% 99.981%
( 9900, 14000 ] 9717 0.005% 99.986%
( 14000, 22000 ] 3466 0.002% 99.988%
( 22000, 33000 ] 20407 0.011% 99.999%
( 33000, 50000 ] 1926 0.001% 100.000%
( 50000, 75000 ] 364 0.000% 100.000%
( 75000, 110000 ] 94 0.000% 100.000%
( 110000, 170000 ] 93 0.000% 100.000%
( 170000, 250000 ] 37 0.000% 100.000%
( 250000, 380000 ] 28 0.000% 100.000%
( 380000, 570000 ] 15 0.000% 100.000%
( 570000, 860000 ] 2 0.000% 100.000%
real 0m35.458s
user 10m6.692s
sys 0m12.617s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:46:23 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.143 micros/op 6999221 ops/sec; 99.1 MB/s (431548 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 6.1065 StdDev: 18.61
Min: 0 Median: 1.6470 Max: 903053
Percentiles: P50: 1.65 P75: 3.27 P99: 9.02 P99.9: 31.65 P99.99: 17240.06
------------------------------------------------------
[ 0, 1 ] 62863965 32.742% 32.742% #######
( 1, 2 ] 51218655 26.676% 59.418% #####
( 2, 3 ] 23402806 12.189% 71.607% ##
( 3, 4 ] 24463492 12.741% 84.348% ###
( 4, 6 ] 25268554 13.161% 97.509% ###
( 6, 10 ] 3787637 1.973% 99.482%
( 10, 15 ] 523908 0.273% 99.755%
( 15, 22 ] 93082 0.048% 99.803%
( 22, 34 ] 231090 0.120% 99.924%
( 34, 51 ] 82219 0.043% 99.966%
( 51, 76 ] 26321 0.014% 99.980%
( 76, 110 ] 2893 0.002% 99.982%
( 110, 170 ] 667 0.000% 99.982%
( 170, 250 ] 454 0.000% 99.982%
( 250, 380 ] 284 0.000% 99.982%
( 380, 580 ] 161 0.000% 99.982%
( 580, 870 ] 123 0.000% 99.982%
( 870, 1300 ] 259 0.000% 99.983%
( 1300, 1900 ] 116 0.000% 99.983%
( 1900, 2900 ] 240 0.000% 99.983%
( 2900, 4400 ] 296 0.000% 99.983%
( 4400, 6600 ] 87 0.000% 99.983%
( 6600, 9900 ] 87 0.000% 99.983%
( 9900, 14000 ] 12304 0.006% 99.989%
( 14000, 22000 ] 2716 0.001% 99.991%
( 22000, 33000 ] 15822 0.008% 99.999%
( 33000, 50000 ] 1190 0.001% 100.000%
( 50000, 75000 ] 236 0.000% 100.000%
( 75000, 110000 ] 130 0.000% 100.000%
( 110000, 170000 ] 102 0.000% 100.000%
( 170000, 250000 ] 45 0.000% 100.000%
( 250000, 380000 ] 31 0.000% 100.000%
( 380000, 570000 ] 13 0.000% 100.000%
( 570000, 860000 ] 14 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
real 0m27.585s
user 8m35.232s
sys 0m5.580s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:46:50 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Cover must have at least one input file
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.165 micros/op 6043715 ops/sec; 94.3 MB/s (348698 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.1225 StdDev: 20.94
Min: 0 Median: 1.7615 Max: 797587
Percentiles: P50: 1.76 P75: 3.46 P99: 14.96 P99.9: 50.74 P99.99: 24076.41
------------------------------------------------------
[ 0, 1 ] 52563100 27.377% 27.377% #####
( 1, 2 ] 57042816 29.710% 57.086% ######
( 2, 3 ] 22946610 11.951% 69.038% ##
( 3, 4 ] 24737370 12.884% 81.922% ###
( 4, 6 ] 27475789 14.310% 96.232% ###
( 6, 10 ] 4791406 2.496% 98.728%
( 10, 15 ] 527369 0.275% 99.002%
( 15, 22 ] 390505 0.203% 99.206%
( 22, 34 ] 964073 0.502% 99.708%
( 34, 51 ] 374693 0.195% 99.903%
( 51, 76 ] 125650 0.065% 99.968%
( 76, 110 ] 20195 0.011% 99.979%
( 110, 170 ] 1452 0.001% 99.980%
( 170, 250 ] 415 0.000% 99.980%
( 250, 380 ] 302 0.000% 99.980%
( 380, 580 ] 196 0.000% 99.980%
( 580, 870 ] 126 0.000% 99.980%
( 870, 1300 ] 188 0.000% 99.980%
( 1300, 1900 ] 105 0.000% 99.980%
( 1900, 2900 ] 200 0.000% 99.981%
( 2900, 4400 ] 230 0.000% 99.981%
( 4400, 6600 ] 83 0.000% 99.981%
( 6600, 9900 ] 96 0.000% 99.981%
( 9900, 14000 ] 11516 0.006% 99.987%
( 14000, 22000 ] 2387 0.001% 99.988%
( 22000, 33000 ] 20809 0.011% 99.999%
( 33000, 50000 ] 1654 0.001% 100.000%
( 50000, 75000 ] 335 0.000% 100.000%
( 75000, 110000 ] 140 0.000% 100.000%
( 110000, 170000 ] 108 0.000% 100.000%
( 170000, 250000 ] 41 0.000% 100.000%
( 250000, 380000 ] 16 0.000% 100.000%
( 380000, 570000 ] 10 0.000% 100.000%
( 570000, 860000 ] 15 0.000% 100.000%
real 0m32.267s
user 9m57.023s
sys 0m10.652s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:47:23 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.169 micros/op 5927855 ops/sec; 101.9 MB/s (468693 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.6741 StdDev: 7.21
Min: 0 Median: 1.9238 Max: 650610
Percentiles: P50: 1.92 P75: 3.82 P99: 13.01 P99.9: 45.78 P99.99: 25479.57
------------------------------------------------------
[ 0, 1 ] 48723744 25.377% 25.377% #####
( 1, 2 ] 51176993 26.655% 52.032% #####
( 2, 3 ] 22199653 11.562% 63.594% ##
( 3, 4 ] 26602549 13.855% 77.449% ###
( 4, 6 ] 34079616 17.750% 95.199% ####
( 6, 10 ] 6895714 3.592% 98.791% #
( 10, 15 ] 668186 0.348% 99.139%
( 15, 22 ] 457451 0.238% 99.377%
( 22, 34 ] 816634 0.425% 99.802%
( 34, 51 ] 270615 0.141% 99.943%
( 51, 76 ] 59253 0.031% 99.974%
( 76, 110 ] 5930 0.003% 99.977%
( 110, 170 ] 1037 0.001% 99.978%
( 170, 250 ] 641 0.000% 99.978%
( 250, 380 ] 509 0.000% 99.978%
( 380, 580 ] 334 0.000% 99.979%
( 580, 870 ] 245 0.000% 99.979%
( 870, 1300 ] 266 0.000% 99.979%
( 1300, 1900 ] 194 0.000% 99.979%
( 1900, 2900 ] 345 0.000% 99.979%
( 2900, 4400 ] 219 0.000% 99.979%
( 4400, 6600 ] 102 0.000% 99.979%
( 6600, 9900 ] 119 0.000% 99.979%
( 9900, 14000 ] 10503 0.005% 99.985%
( 14000, 22000 ] 2230 0.001% 99.986%
( 22000, 33000 ] 24399 0.013% 99.999%
( 33000, 50000 ] 1887 0.001% 100.000%
( 50000, 75000 ] 314 0.000% 100.000%
( 75000, 110000 ] 116 0.000% 100.000%
( 110000, 170000 ] 96 0.000% 100.000%
( 170000, 250000 ] 51 0.000% 100.000%
( 250000, 380000 ] 32 0.000% 100.000%
( 380000, 570000 ] 13 0.000% 100.000%
( 570000, 860000 ] 10 0.000% 100.000%
real 0m32.509s
user 10m25.471s
sys 0m8.780s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:47:55 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.171 micros/op 5836131 ops/sec; 94.8 MB/s (376322 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.7691 StdDev: 9.14
Min: 0 Median: 1.9681 Max: 652925
Percentiles: P50: 1.97 P75: 3.90 P99: 9.83 P99.9: 40.28 P99.99: 25389.39
------------------------------------------------------
[ 0, 1 ] 49909593 25.995% 25.995% #####
( 1, 2 ] 47608989 24.796% 50.791% #####
( 2, 3 ] 24788930 12.911% 63.702% ###
( 3, 4 ] 23980010 12.490% 76.191% ##
( 4, 6 ] 34878829 18.166% 94.357% ####
( 6, 10 ] 9315322 4.852% 99.209% #
( 10, 15 ] 694606 0.362% 99.571%
( 15, 22 ] 205196 0.107% 99.678%
( 22, 34 ] 375514 0.196% 99.873%
( 34, 51 ] 138102 0.072% 99.945%
( 51, 76 ] 52836 0.028% 99.973%
( 76, 110 ] 7212 0.004% 99.977%
( 110, 170 ] 1109 0.001% 99.977%
( 170, 250 ] 632 0.000% 99.978%
( 250, 380 ] 542 0.000% 99.978%
( 380, 580 ] 420 0.000% 99.978%
( 580, 870 ] 372 0.000% 99.978%
( 870, 1300 ] 406 0.000% 99.978%
( 1300, 1900 ] 224 0.000% 99.979%
( 1900, 2900 ] 379 0.000% 99.979%
( 2900, 4400 ] 311 0.000% 99.979%
( 4400, 6600 ] 164 0.000% 99.979%
( 6600, 9900 ] 175 0.000% 99.979%
( 9900, 14000 ] 10950 0.006% 99.985%
( 14000, 22000 ] 2765 0.001% 99.986%
( 22000, 33000 ] 23406 0.012% 99.998%
( 33000, 50000 ] 2118 0.001% 100.000%
( 50000, 75000 ] 479 0.000% 100.000%
( 75000, 110000 ] 156 0.000% 100.000%
( 110000, 170000 ] 148 0.000% 100.000%
( 170000, 250000 ] 51 0.000% 100.000%
( 250000, 380000 ] 31 0.000% 100.000%
( 380000, 570000 ] 15 0.000% 100.000%
( 570000, 860000 ] 8 0.000% 100.000%
real 0m33.017s
user 10m16.408s
sys 0m6.806s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:48:28 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.135 micros/op 7383206 ops/sec; 116.1 MB/s (256818 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.5869 StdDev: 5.31
Min: 0 Median: 1.9311 Max: 1543768
Percentiles: P50: 1.93 P75: 3.64 P99: 9.32 P99.9: 14.87 P99.99: 25587.66
------------------------------------------------------
[ 0, 1 ] 39204011 20.419% 20.419% ####
( 1, 2 ] 60996858 31.769% 52.188% ######
( 2, 3 ] 27871011 14.516% 66.704% ###
( 3, 4 ] 25059711 13.052% 79.756% ###
( 4, 6 ] 31529881 16.422% 96.178% ###
( 6, 10 ] 6536893 3.405% 99.582% #
( 10, 15 ] 625297 0.326% 99.908%
( 15, 22 ] 75975 0.040% 99.948%
( 22, 34 ] 42435 0.022% 99.970%
( 34, 51 ] 9797 0.005% 99.975%
( 51, 76 ] 3367 0.002% 99.977%
( 76, 110 ] 1003 0.001% 99.977%
( 110, 170 ] 721 0.000% 99.978%
( 170, 250 ] 542 0.000% 99.978%
( 250, 380 ] 408 0.000% 99.978%
( 380, 580 ] 243 0.000% 99.978%
( 580, 870 ] 173 0.000% 99.978%
( 870, 1300 ] 303 0.000% 99.978%
( 1300, 1900 ] 145 0.000% 99.979%
( 1900, 2900 ] 320 0.000% 99.979%
( 2900, 4400 ] 275 0.000% 99.979%
( 4400, 6600 ] 137 0.000% 99.979%
( 6600, 9900 ] 132 0.000% 99.979%
( 9900, 14000 ] 9712 0.005% 99.984%
( 14000, 22000 ] 3276 0.002% 99.986%
( 22000, 33000 ] 25062 0.013% 99.999%
( 33000, 50000 ] 1736 0.001% 100.000%
( 50000, 75000 ] 291 0.000% 100.000%
( 75000, 110000 ] 88 0.000% 100.000%
( 110000, 170000 ] 87 0.000% 100.000%
( 170000, 250000 ] 57 0.000% 100.000%
( 250000, 380000 ] 20 0.000% 100.000%
( 380000, 570000 ] 23 0.000% 100.000%
( 570000, 860000 ] 7 0.000% 100.000%
( 860000, 1200000 ] 1 0.000% 100.000%
( 1200000, 1900000 ] 2 0.000% 100.000%
real 0m26.106s
user 9m39.044s
sys 0m2.813s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:48:54 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.154 micros/op 6492411 ops/sec; 102.2 MB/s (490212 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 7.5985 StdDev: 12.62
Min: 0 Median: 1.8317 Max: 1991932
Percentiles: P50: 1.83 P75: 3.70 P99: 9.69 P99.9: 33.34 P99.99: 25508.35
------------------------------------------------------
[ 0, 1 ] 47047418 24.504% 24.504% #####
( 1, 2 ] 58860336 30.656% 55.160% ######
( 2, 3 ] 22594468 11.768% 66.928% ##
( 3, 4 ] 22258890 11.593% 78.521% ##
( 4, 6 ] 31453089 16.382% 94.903% ###
( 6, 10 ] 8518701 4.437% 99.340% #
( 10, 15 ] 622359 0.324% 99.664%
( 15, 22 ] 165246 0.086% 99.750%
( 22, 34 ] 304209 0.158% 99.909%
( 34, 51 ] 112126 0.058% 99.967%
( 51, 76 ] 18964 0.010% 99.977%
( 76, 110 ] 1337 0.001% 99.978%
( 110, 170 ] 503 0.000% 99.978%
( 170, 250 ] 406 0.000% 99.978%
( 250, 380 ] 274 0.000% 99.978%
( 380, 580 ] 213 0.000% 99.978%
( 580, 870 ] 140 0.000% 99.978%
( 870, 1300 ] 229 0.000% 99.979%
( 1300, 1900 ] 132 0.000% 99.979%
( 1900, 2900 ] 365 0.000% 99.979%
( 2900, 4400 ] 400 0.000% 99.979%
( 4400, 6600 ] 98 0.000% 99.979%
( 6600, 9900 ] 74 0.000% 99.979%
( 9900, 14000 ] 10055 0.005% 99.984%
( 14000, 22000 ] 2864 0.001% 99.986%
( 22000, 33000 ] 24782 0.013% 99.999%
( 33000, 50000 ] 1665 0.001% 100.000%
( 50000, 75000 ] 268 0.000% 100.000%
( 75000, 110000 ] 153 0.000% 100.000%
( 110000, 170000 ] 131 0.000% 100.000%
( 170000, 250000 ] 52 0.000% 100.000%
( 250000, 380000 ] 18 0.000% 100.000%
( 380000, 570000 ] 20 0.000% 100.000%
( 570000, 860000 ] 9 0.000% 100.000%
( 860000, 1200000 ] 4 0.000% 100.000%
( 1200000, 1900000 ] 1 0.000% 100.000%
( 1900000, 2900000 ] 1 0.000% 100.000%
real 0m29.799s
user 9m49.221s
sys 0m5.391s
+ for i in '`seq 1 10`'
+ ./db_bench --compression_type=zstd --key_size 24 --max_background_jobs 16 --benchmarks readwhilewriting --num 3000000 --writes 300000 --threads 64 --histogram=1 --stats_interval=100000000 --enable_io_prio --compression_level=6 --compression_max_dict_bytes=8 --compression_zstd_max_train_bytes=13 --enable_cpu_prio
RocksDB: version 5.13
Date: Mon Apr 23 09:49:24 2018
CPU: 24 * Intel Core Processor (Skylake)
CPUCache: 16384 KB
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Keys: 24 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 3000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 354.8 MB (estimated)
FileSize: 211.7 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: ZSTD
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
DB path: [/tmp/rocksdbtest-143626/dbbench]
readwhilewriting : 0.189 micros/op 5278329 ops/sec; 95.6 MB/s (439269 of 3000000 found)
Microseconds per read:
Count: 192000000 Average: 8.5929 StdDev: 22.29
Min: 0 Median: 2.4861 Max: 1585023
Percentiles: P50: 2.49 P75: 4.47 P99: 9.95 P99.9: 43.21 P99.99: 26209.01
------------------------------------------------------
[ 0, 1 ] 43757109 22.790% 22.790% #####
( 1, 2 ] 40916650 21.311% 44.101% ####
( 2, 3 ] 23299390 12.135% 56.236% ##
( 3, 4 ] 26199029 13.645% 69.881% ###
( 4, 6 ] 41543425 21.637% 91.519% ####
( 6, 10 ] 14528215 7.567% 99.085% ##
( 10, 15 ] 888434 0.463% 99.548%
( 15, 22 ] 254084 0.132% 99.680%
( 22, 34 ] 329286 0.172% 99.852%
( 34, 51 ] 170519 0.089% 99.941%
( 51, 76 ] 58161 0.030% 99.971%
( 76, 110 ] 7283 0.004% 99.975%
( 110, 170 ] 1082 0.001% 99.975%
( 170, 250 ] 725 0.000% 99.976%
( 250, 380 ] 480 0.000% 99.976%
( 380, 580 ] 300 0.000% 99.976%
( 580, 870 ] 254 0.000% 99.976%
( 870, 1300 ] 340 0.000% 99.976%
( 1300, 1900 ] 192 0.000% 99.977%
( 1900, 2900 ] 518 0.000% 99.977%
( 2900, 4400 ] 325 0.000% 99.977%
( 4400, 6600 ] 109 0.000% 99.977%
( 6600, 9900 ] 107 0.000% 99.977%
( 9900, 14000 ] 11642 0.006% 99.983%
( 14000, 22000 ] 2814 0.001% 99.985%
( 22000, 33000 ] 26989 0.014% 99.999%
( 33000, 50000 ] 1817 0.001% 100.000%
( 50000, 75000 ] 283 0.000% 100.000%
( 75000, 110000 ] 144 0.000% 100.000%
( 110000, 170000 ] 124 0.000% 100.000%
( 170000, 250000 ] 54 0.000% 100.000%
( 250000, 380000 ] 52 0.000% 100.000%
( 380000, 570000 ] 14 0.000% 100.000%
( 570000, 860000 ] 42 0.000% 100.000%
( 860000, 1200000 ] 4 0.000% 100.000%
( 1200000, 1900000 ] 4 0.000% 100.000%
real 0m36.497s
user 11m23.375s
sys 0m6.937s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment