Skip to content

Instantly share code, notes, and snippets.

View mdcallag's full-sized avatar
🎯
Focusing

Mark Callaghan mdcallag

🎯
Focusing
220 followers · 0 following
View GitHub Profile
@mdcallag
mdcallag / gist:299a7a65b9eb31589336886249aa4a60
Created October 20, 2020 22:44
Ratio of ips or qps for rx80.cx6a / rx56.cx6a. A value less than zero means that rx80 is slower.
* rx56 is MyRocks from MySQL 5.6.35
* rx80 is MyRocks from MySQL 8.0.17
* cx6a names the my.cnf I used
l.i0 l.x l.i1 q100.2 q200.2 q400.2 q600.2 q800.2 q1000.2
.79 .99 .87 .89 .89 .89 .88 .88 .88
l.i0
ips qps rps rkbps wkbps rpq rkbpq wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag
@mdcallag
mdcallag / gist:c613ef708df8e064631913fbf0000eea
Created October 19, 2020 18:52
l.i0
ips qps rps rkbps wkbps rpq rkbpq wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag
104602 0 0 0 14278 0.000 0.000 0.136 10984 45.9 0.105 18 16.4 16.8 0.5 0.128 106382 91203 rx56.cx3
85940 0 0 0 13297 0.000 0.000 0.155 9373 42.2 0.109 20 24.4 24.9 0.9 0.254 86406 71222 rx80.cx3
l.x
ips qps rps rkbps wkbps rpq rkbpq wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag
96377 0 52 21467 14643 0.001 0.223 0.152 844 24.7 0.009 10 33.7 34.1 11.5 0.005 NA NA rx56.cx3
101853 0 88 27770 18126 0.001 0.273 0.178 1184 24.7 0.012 10 54.0 54.5 11.3 0.007 NA NA rx80.cx3
@mdcallag
mdcallag / gist:f94e3b384c5806901a428ff377242fad
Created October 19, 2020 18:52
l.i0
ips qps rps rkbps wkbps rpq rkbpq wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag
105374 0 0 0 14412 0.000 0.000 0.137 10933 45.7 0.104 17 3.3 4.5 0.3 0.138 107521 90600 rx56.cx3
85034 0 0 0 13165 0.000 0.000 0.155 9215 42.0 0.108 20 4.8 6.3 0.7 0.248 85706 70425 rx80.cx3
l.x
ips qps rps rkbps wkbps rpq rkbpq wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag
104162 0 6 1465 16256 0.000 0.014 0.156 843 24.4 0.008 9 7.0 8.3 5.6 0.006 NA NA rx56.cx3
107173 0 20 4907 19480 0.000 0.046 0.182 1089 24.7 0.010 9 11.1 12.5 6.1 0.007 NA NA rx80.cx3
@mdcallag
mdcallag / gist:3f12c7471a59b70cd3a8dd7e61800383
Created October 19, 2020 18:48
l.i0
ips qps rps rkbps wkbps rpq rkbpq wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag
104712 0 0 0 14274 0.000 0.000 0.136 10864 46.1 0.104 18 0.6 1.7 0.2 0.115 107681 87207 rx56.cx3
84034 0 0 0 12949 0.000 0.000 0.154 9056 42.0 0.108 20 0.9 2.1 0.6 0.202 85816 65752 rx80.cx3
l.x
ips qps rps rkbps wkbps rpq rkbpq wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag
104145 0 0 23 16639 0.000 0.000 0.160 927 24.9 0.009 10 1.4 2.4 1.3 0.004 NA NA rx56.cx3
108649 0 0 35 20036 0.000 0.000 0.184 1141 25.2 0.011 9 2.3 3.5 1.7 0.009 NA NA rx80.cx3
@mdcallag
mdcallag / gist:53663c53174eecdd0d6ae511d8a12a35
Last active August 20, 2020 20:46
Ubuntu 16.04
Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await r_await w_await svctm %util
Ubuntu 18.04
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
Ubuntu 20.04
Device r/s rkB/s rrqm/s %rrqm r_await rareq-sz w/s wkB/s wrqm/s %wrqm w_await wareq-sz d/s dkB/s drqm/s %drqm d_await dareq-sz aqu-sz %util
@mdcallag
mdcallag / gist:734e17f3bd01af3bd8185b42c8a0a4f6
Created August 16, 2020 23:43
** Compaction Stats [cf_link_pk] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 0/0 0.00 KB 0.0 0.0 0.0 0.0 149.7 149.7 0.0 1.0 0.0 160.2 956.88 939.74 1896 0.505 0 0
L3 5/0 327.03 MB 0.6 157.7 93.5 64.2 157.7 93.5 0.0 1.7 118.2 118.2 1366.81 1333.13 296 4.618 2419M 39K
L4 21/0 1.29 GB 1.0 165.4 97.7 67.7 165.4 97.7 46.0 1.7 119.0 119.0 1423.56 1400.33 306 4.652 2541M 0
L5 220/0 13.29 GB 1.0 112.4 82.3 30.1 112.4 82.2 65.2 1.4 113.9 113.8 1011.02
@mdcallag
mdcallag / gist:689f6ba73d56c883feb514a5cd27a2da
Created August 13, 2020 17:11
explain select /*+ SKIP_SCAN(t) */ x,y,z from t where x=1 and z=1\G'
*************************** 1. row ***************************
id: 1
select_type: SIMPLE
table: t
partitions: NULL
type: range
possible_keys: x1
key: x1
@mdcallag
mdcallag / gist:6e7a8ab51fd779ff3d2e6c592c1e1a2b
Created August 8, 2020 00:52
drop table if exists t;
create table t (x int not null, y int not null, z int not null, val int not null, bloat char(200) not null);
create index x1 on t(x, y, z);
drop table if exists t2;
create table t2 (x int, y int, z int, val int, bloat char(200));
insert into t2 (x,y,z,val,bloat) values (1,1,1,1,"a1"), (1,2,2,2,"a2"), (1,3,3,3,"a3"), (1,4,4,4,"a4"), (1,5,5,5,"a5"), (1,6,6,6,"a6"), (1,7,7,7,"a7"), (1,8,8,8,"a8"), (1,9,9,9,"a9"), (1,10,10,10,"a10");
insert into t (x,y,z,val,bloat) select 1, y, z, val, bloat from t2;
@mdcallag
mdcallag / gist:2b7d58c7e6b5c909ca4a66dcfd93693c
Created July 1, 2020 15:08
--- c10b40
innodb_flush_log_at_trx_commit=2
innodb_file_per_table=1
innodb_doublewrite=1
innodb_data_home_dir=/data/m/my/data
innodb_data_file_path=ibdata1:512M:autoextend
innodb_log_group_home_dir=/data/m/my/txlogs
innodb_fast_shutdown=1
innodb_dedicated_server=ON
@mdcallag
mdcallag / gist:eb2debf9dd3a4352a0828f7fee835a77
Created July 1, 2020 14:48
--- load
ips qps rps rkbps wkbps rpq rkbpq wkbpq csps cpups cspq cpupq ccpupq dbgb vsz rss maxop p50 p90 tag
299625 0 0 0 101310 0.000 0.000 0.338 75008 71.5 0.250 38 2 39 45.1 8.9 0.396 41453 32763 my8018.c10b40
301887 0 0 0 101311 0.000 0.000 0.336 74251 71.8 0.246 38 2 39 45.1 8.9 0.395 41373 33460 my8018.c10b40a
299625 0 0 0 101044 0.000 0.000 0.337 74947 71.9 0.250 38 2 39 45.1 8.9 0.392 41652 34257 my8018.c10b40b
-
295203 0 0 0 97993 0.000 0.000 0.332 44019 71.3 0.149 39 2 39 45.1 8.9 0.361 40854 33861 my8020.c10b40
296296 0 0 0 97999 0.000 0.000 0.331 44618 71.4 0.151 39 2 39 45.1 8.9 0.363 40754 32760 my8020.c10b40a
299625 0 0