Skip to content

Instantly share code, notes, and snippets.

💭
for advice ask https://www.percona.com/

Mark Callaghan mdcallag

Block or report user

Report or block mdcallag

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
View gist:327b1aad05d3373b6eb1
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
---- original with
View gist:0de29d331870f27db40c
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
---- original with
View gist:eb5e4d08b09c01ac2cd6
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
---- original with
View gist:0a61c6a18dd467224c11
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
----- original wit
View gist:db43a58bd5ac624f01e1
Example command line where I change many of the default parameters. This is to be run for 1, 4 and 16 threads
nk=$(( 128 * 1024 * 1024 )) \
DO_SETUP=1 \
SAVE_SETUP=1 \
VAL_SIZE=400 \
CACHE_BYTES=$(( 80 * 1024 * 1024 * 1024 )) \
NSECONDS=3600 \
NKEYS=$nk \
NWRITESPERSEC=10000 \
View gist:2bd64d18be1b93adc494
Cumulative writes: 123731968 writes, 123731968 keys, 123731968 batches, 1.0 writes per batch, ingest: 50.24 GB, 62.47 MB/s, stall time: 00:00:0.000 H:M:S, 0.0 percent
Cumulative WAL: 123731968 writes, 123731968 syncs, 1.00 writes per sync, written: 50.24 GB, 62.47 MB/s
Interval writes: 1048576 writes, 1048576 keys, 1048576 batches, 1.0 writes per batch, ingest: 436.00 MB, 62.11 MB/s, stall time: 00:00:0.000 H:M:S, 0.0 percent
Interval WAL: 1048576 writes, 1048576 syncs, 1.00 writes per sync, written: 0.43 MB, 62.11 MB/s
View gist:d5885b4cc1a8569323a5
** DB Stats **
Uptime(secs): 16.7 total, 0.6 interval
Cumulative writes: 2000K writes, 2000K keys, 2000K batches, 1.0 writes per batch, ingest: 0.24 GB, 14.95 MB/s
Cumulative WAL: 2000K writes, 2000K syncs, 1.00 writes per sync, written: 0.24 GB, 14.95 MB/s
Cumulative stall: 00:00:7.745 H:M:S time, 46.3 percent
Interval writes: 100K writes, 100K keys, 100K batches, 1.0 writes per batch, ingest: 12.49 MB, 20.43 MB/s
Interval WAL: 100K writes, 100K syncs, 1.00 writes per sync, written: 0.01 MB, 20.43 MB/s
Interval stall: 00:00:0.116 H:M:S time, 19.0 percent
View gist:2275413c55b67728f6ac
** DB Stats **
Uptime(secs): 17.2 total, 0.7 interval
Cumulative writes: 2000K writes, 2000K keys, 2000K batches, 1.0 writes per batch, ingest: 0.24 GB, 14.54 MB/s
Cumulative WAL: 2000K writes, 2000K syncs, 1.00 writes per sync, written: 0.24 GB, 14.54 MB/s
Cumulative stall: 00:00:8.279 H:M:S, 48.2 percent
Interval writes: 100K writes, 100K keys, 100K batches, 1.0 writes per batch, ingest: 12.49 MB, 18.57 MB/s
Interval WAL: 100K writes, 100K syncs, 1.00 writes per sync, written: 0.01 MB, 18.57 MB/s
Interval stall: 00:00:0.178 H:M:S, 26.5 percent
View gist:19a8abdfe5d9c99a241e
mongo.conf for WiredTiger
processManagement:
fork: true
systemLog:
destination: file
path: /data/mysql/mongo.30/log
logAppend: true
storage:
syncPeriodSecs: 60
View gist:297ff4316a25cb2988f7
bulkload
ops/sec mb/sec L0_GB Sum_GB W-Amp W-MB/s usec/op p50 p75 p99 p99.9 p99.99 Uptime Stall-time Stall% Test
154876 5.9 0.0 0 6.5 5.5 6.9 14 24 35 10 00:00:0.000 0.0 bulkload
fillseq
ops/sec mb/sec L0_GB Sum_GB W-Amp W-MB/s usec/op p50 p75 p99 p99.9 p99.99 Uptime Stall-time Stall% Test
316284 12.1 0.0 0 3.2 2.5 2.8 7 15 20 5 00:00:0.000 0.0 fillseq
overwrite sync=0
ops/sec mb/sec L0_GB Sum_GB W-Amp W-MB/s usec/op p50 p75 p99 p99.9 p99.99 Uptime Stall-time Stall% Test
162082 6.2 0.1 0.1 1.0 7.8 6.2 5.4 6.4 14 26 38 13 00:00:0.000 0.0 overwrite.t1.s0
163532 6.2 0.1 0.1 1.0 4.0 6.1 5.3 6.3 13 22 32 25 00:00:0.000 0.0 overwrite.t1.s0
You can’t perform that action at this time.