Skip to content

Instantly share code, notes, and snippets.

View mdcallag's full-sized avatar
🎯
Focusing

Mark Callaghan mdcallag

🎯
Focusing
216 followers · 0 following
View GitHub Profile
@mdcallag
mdcallag / gist:327b1aad05d3373b6eb1
Created March 15, 2015 15:40
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
---- original with
@mdcallag
mdcallag / gist:0de29d331870f27db40c
Created March 15, 2015 15:58
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
---- original with
@mdcallag
mdcallag / gist:eb5e4d08b09c01ac2cd6
Created March 15, 2015 16:00
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
---- original with
@mdcallag
mdcallag / gist:0a61c6a18dd467224c11
Created March 15, 2015 16:03
----- original
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) Stall(cnt) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 5 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 14.6 1 7 0.125 0 0 0
L1 4/0 7 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 0
Sum 7/0 13 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 1 7 0.125 0 0 0
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.5 0 3 0.126 0 0 0
----- original wit
@mdcallag
mdcallag / gist:db43a58bd5ac624f01e1
Last active August 29, 2015 14:17
Example command line where I change many of the default parameters. This is to be run for 1, 4 and 16 threads
nk=$(( 128 * 1024 * 1024 )) \
DO_SETUP=1 \
SAVE_SETUP=1 \
VAL_SIZE=400 \
CACHE_BYTES=$(( 80 * 1024 * 1024 * 1024 )) \
NSECONDS=3600 \
NKEYS=$nk \
NWRITESPERSEC=10000 \
@mdcallag
mdcallag / gist:2bd64d18be1b93adc494
Created March 27, 2015 21:43
Cumulative writes: 123731968 writes, 123731968 keys, 123731968 batches, 1.0 writes per batch, ingest: 50.24 GB, 62.47 MB/s, stall time: 00:00:0.000 H:M:S, 0.0 percent
Cumulative WAL: 123731968 writes, 123731968 syncs, 1.00 writes per sync, written: 50.24 GB, 62.47 MB/s
Interval writes: 1048576 writes, 1048576 keys, 1048576 batches, 1.0 writes per batch, ingest: 436.00 MB, 62.11 MB/s, stall time: 00:00:0.000 H:M:S, 0.0 percent
Interval WAL: 1048576 writes, 1048576 syncs, 1.00 writes per sync, written: 0.43 MB, 62.11 MB/s
@mdcallag
mdcallag / gist:d5885b4cc1a8569323a5
Created March 30, 2015 17:46
** DB Stats **
Uptime(secs): 16.7 total, 0.6 interval
Cumulative writes: 2000K writes, 2000K keys, 2000K batches, 1.0 writes per batch, ingest: 0.24 GB, 14.95 MB/s
Cumulative WAL: 2000K writes, 2000K syncs, 1.00 writes per sync, written: 0.24 GB, 14.95 MB/s
Cumulative stall: 00:00:7.745 H:M:S time, 46.3 percent
Interval writes: 100K writes, 100K keys, 100K batches, 1.0 writes per batch, ingest: 12.49 MB, 20.43 MB/s
Interval WAL: 100K writes, 100K syncs, 1.00 writes per sync, written: 0.01 MB, 20.43 MB/s
Interval stall: 00:00:0.116 H:M:S time, 19.0 percent
@mdcallag
mdcallag / gist:2275413c55b67728f6ac
Created March 30, 2015 17:48
** DB Stats **
Uptime(secs): 17.2 total, 0.7 interval
Cumulative writes: 2000K writes, 2000K keys, 2000K batches, 1.0 writes per batch, ingest: 0.24 GB, 14.54 MB/s
Cumulative WAL: 2000K writes, 2000K syncs, 1.00 writes per sync, written: 0.24 GB, 14.54 MB/s
Cumulative stall: 00:00:8.279 H:M:S, 48.2 percent
Interval writes: 100K writes, 100K keys, 100K batches, 1.0 writes per batch, ingest: 12.49 MB, 18.57 MB/s
Interval WAL: 100K writes, 100K syncs, 1.00 writes per sync, written: 0.01 MB, 18.57 MB/s
Interval stall: 00:00:0.178 H:M:S, 26.5 percent
@mdcallag
mdcallag / gist:19a8abdfe5d9c99a241e
Created April 1, 2015 21:01
mongo.conf for WiredTiger
processManagement:
fork: true
systemLog:
destination: file
path: /data/mysql/mongo.30/log
logAppend: true
storage:
syncPeriodSecs: 60
@mdcallag
mdcallag / gist:297ff4316a25cb2988f7
Created April 6, 2015 16:45
bulkload
ops/sec mb/sec L0_GB Sum_GB W-Amp W-MB/s usec/op p50 p75 p99 p99.9 p99.99 Uptime Stall-time Stall% Test
154876 5.9 0.0 0 6.5 5.5 6.9 14 24 35 10 00:00:0.000 0.0 bulkload
fillseq
ops/sec mb/sec L0_GB Sum_GB W-Amp W-MB/s usec/op p50 p75 p99 p99.9 p99.99 Uptime Stall-time Stall% Test
316284 12.1 0.0 0 3.2 2.5 2.8 7 15 20 5 00:00:0.000 0.0 fillseq
overwrite sync=0
ops/sec mb/sec L0_GB Sum_GB W-Amp W-MB/s usec/op p50 p75 p99 p99.9 p99.99 Uptime Stall-time Stall% Test
162082 6.2 0.1 0.1 1.0 7.8 6.2 5.4 6.4 14 26 38 13 00:00:0.000 0.0 overwrite.t1.s0
163532 6.2 0.1 0.1 1.0 4.0 6.1 5.3 6.3 13 22 32 25 00:00:0.000 0.0 overwrite.t1.s0