jay-zhuang

$ ~/ws/tmp% TEST_TMPDIR=/tmp/dbbench4 ./db_bench_main --benchmarks=filluniquerandom,readrandom -compression_type=none -max_background_jobs=12 -num=10000000
Set seed to 1659416156463325 because --seed was 0
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
Integrated BlobDB: blob cache disabled
RocksDB:    version 7.6.0
Date:       Tue Aug  2 04:55:56 2022
CPU:        96 * Intel(R) Xeon(R) Platinum 8275CL CPU @ 3.00GHz
CPUCache:   36608 KB
Keys:       16 bytes each (+ 0 bytes user-defined timestamp)

jay-zhuang

$ ./db_basic_bench --benchmark_filter=DBGet/*
The number of inputs is very large. DBGet will be repeated at least 192 times.
The number of inputs is very large. DBGet will be repeated at least 192 times.
2022-08-02T00:13:48+00:00
Running ./db_basic_bench
Run on (96 X 1321.11 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x48)
  L1 Instruction 32 KiB (x48)
  L2 Unified 1024 KiB (x48)

jay-zhuang

$ ./db_basic_bench_main --benchmark_filter=DBGet/*
The number of inputs is very large. DBGet will be repeated at least 192 times.
The number of inputs is very large. DBGet will be repeated at least 192 times.
2022-08-01T20:35:44+00:00
Running ./db_basic_bench_main
Run on (96 X 1799.36 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x48)
  L1 Instruction 32 KiB (x48)
  L2 Unified 1024 KiB (x48)

jay-zhuang

Comparing ./db_basic_bench_main to ./db_basic_bench_new
Benchmark                                                                                                                                                          Time             CPU      Time Old      Time New       CPU Old       CPU New
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ManualCompaction/comp_style:0/max_data:33554432/per_key_size:256/enable_statistics:0/iterations:1                                                               +0.0014         +0.0162     104328093     104470603      83025631      84374645
ManualCompaction/comp_style:0/max_data:33554432/per_key_size:256/enable_statistics:1/iterations:1                                                               +0.0613         +0.0488     103397520     109737940      83940460      88033800
ManualCo

jay-zhuang

main branch: /data/out/7.5.0/report.tsv
new code:  : /data/out/7.5.1/report.tsv

ops_sec mb_sec  lsm_sz  blob_sz c_wgb   w_amp   c_mbps  c_wsecs c_csecs b_rgb   b_wgb   usec_op p50 p99 p99.9   p99.99  pmax    uptime  stall%  Nstall  u_cpu   s_cpu   rss test    date    version job_id
1678781 672.4                                       0.6 0.5 2   4   20  3296                0.0 0.0 0.0 fillseq.wal_disabled.v400   2022-06-28T21:52:44 7.5
1684885 674.9                                       0.6 0.5 2   4   20  3206                0.0 0.0 0.0 fillseq.wal_disabled.v400   2022-06-28T22:00:43 7.5

ops_sec mb_sec  lsm_sz  blob_sz c_wgb   w_amp   c_mbps  c_wsecs c_csecs b_rgb   b_wgb   usec_op p50 p99 p99.9   p99.99  pmax    uptime  stall%  Nstall  u_cpu   s_cpu   rss test    date    version job_id
5149708 2062.7  225MB   0.0GB,  0.0     0.0 0   0   0   0   3.1 2.5 6   10  16  4570    60  0.0 0   1.0 0.0 0.4 readrandom.t16  2022-06-28T21:52:46 7.5
5164374 2068.6  225MB   0.0GB,  0.0     0.0 0   0   0   0   3.1 2.5 6   

jay-zhuang

#!/usr/bin/env python3

import json
import logging
import sys
from datetime import datetime
from rfe.scubadata.scubadata_py3 import ScubaData, Sample

logging.basicConfig(stream=sys.stdout,
                    format="%(levelname)s %(asctime)s - %(message)s",

jay-zhuang

2021-01-25T10:03:40-08:00
Running ./filter_bench
Run on (24 X 2394.39 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x24)
  L1 Instruction 32 KiB (x24)
  L2 Unified 4096 KiB (x24)
  L3 Unified 16384 KiB (x24)
Load Average: 6.12, 9.77, 8.64
------------------------------------------------------------------------------------------

jay-zhuang

DEBUG [PerDiskMemtableFlushWriter_0:1] 2018-03-29 21:28:03,470 Memtable.java:485 - Completed flushing /Users/zjay/.ccm/tt2/node1/data0/stresscql/blogposts-b16d9e2033d211e88ba695f00ded30b8/na-10-big-Data.db (34.163MiB) for commitlog position CommitLogPosition(segmentId=1522384055952, position=20714675)
DEBUG [MemtableFlushWriter:1] 2018-03-29 21:28:03,502 ColumnFamilyStore.java:1182 - Flushed to [BigTableReader(path='/Users/zjay/.ccm/tt2/node1/data0/stresscql/blogposts-b16d9e2033d211e88ba695f00ded30b8/na-10-big-Data.db')] (1 sstables, 34.754MiB), biggest 34.754MiB, smallest 34.754MiB
DEBUG [MemtablePostFlush:1] 2018-03-29 21:28:03,505 CommitLog.java:329 - Commit log segment CommitLogSegment(/Users/zjay/.ccm/tt2/node1/commitlogs/CommitLog-7-1522384055951.log) is unused
DEBUG [MemtablePostFlush:1] 2018-03-29 21:28:03,505 AbstractCommitLogSegmentManager.java:324 - Segment CommitLogSegment(/Users/zjay/.ccm/tt2/node1/commitlogs/CommitLog-7-1522384055951.log) is no longer active and will be deleted now
DEBUG [SlabPo

jay-zhuang

                                         Processing response from /ip1         |           5497 |                  SharedPool-Worker-318
                                  Sending read-repair-mutation to /ip1         |           5628 |                  SharedPool-Worker-380
                                   Sending READ_REPAIR message to /ip1         |           5681 | MessagingService-Outgoing-/ip1
                                READ_REPAIR message received from /ip1         |           5809 | MessagingService-Incoming-/ip1
Timed out while read-repairing after receiving all 6 data and digest responses |        2005779 |                  SharedPool-Worker-380

jay-zhuang

.
|-- prj1
|-- prj2
|-- prj3
|-- prj4
`-- tags