Skip to content

Instantly share code, notes, and snippets.

@mdcallag

mdcallag/i0.txt Secret

Last active January 4, 2024 01:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mdcallag/9df131055d380dfdc98b88f5474ba782 to your computer and use it in GitHub Desktop.
Save mdcallag/9df131055d380dfdc98b88f5474ba782 to your computer and use it in GitHub Desktop.
--- 8-core, small tx, l.i0 (initial load)
1 processes, 10000000 rows-per-process, 15638 seconds, 639.4 rows-per-second, 639.4 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
1 processes, 10000000 rows-per-process, 14389 seconds, 694.9 rows-per-second, 694.9 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=OFF
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
3126 0.0 0.0 350.7 1.1 0.000 0.000 0.548 1.831 639.4 LWT=ON
2875 0.0 0.0 317.5 1.1 0.000 0.000 0.457 1.653 694.9 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
3275 7688 2.0 12.024 0.003140 LWT=ON
3012 2800 1.9 4.029 0.002746 LWT=OFF
--- 8-core, large tx, l.i0 (intial load)
1 processes, 10000000 rows-per-process, 2531 seconds, 3951.0 rows-per-second, 3951.0 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
505 0.0 0.0 383.1 2.0 0.000 0.000 0.097 0.513 3951.0 LWT=ON
321 0.0 0.0 394.4 2.6 0.000 0.000 0.063 0.424 6211.1 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
530 6976 2.9 1.766 0.000733 LWT=ON
337 2609 3.4 0.420 0.000548 LWT=OFF
--- 32-core, small tx, l.i0 (initial load)
12 processes, 5000000 rows-per-process, 13922 seconds, 4309.7 rows-per-second, 359.1 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
12 processes, 5000000 rows-per-process, 10736 seconds, 5588.6 rows-per-second, 465.7 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=OFF
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
2784 0.0 0.0 494.9 4.3 0.000 0.000 0.115 1.010 4309.7 LWT=ON
2147 0.0 0.0 537.2 4.6 0.000 0.000 0.096 0.835 5588.6 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
2917 15531 1.0 3.604 0.000225 LWT=ON
2250 12318 1.2 2.204 0.000223 LWT=OFF
- at end of l.i0
873 OS file reads, 5250194 OS file writes, 2158185 OS fsyncs -> LWT=ON
869 OS file reads, 4011887 OS file writes, 1280630 OS fsyncs -> LWT=OFF
LWT=ON does ~1.7X more OS fsyncs
--- 32-core, large tx, l.i0 (initial load)
12 processes, 5000000 rows-per-process, 5234 seconds, 11463.5 rows-per-second, 955.2 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
12 processes, 5000000 rows-per-process, 1081 seconds, 55504.1 rows-per-second, 4625.3 rows-per-second-per-user, 0 queries,
0 queries-per-second, no deletes -> LWT=OFF
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
1047 0.0 0.0 441.2 4.9 0.000 0.000 0.038 0.437 11463.5 LWT=ON
216 0.0 0.0 613.3 11.6 0.000 0.000 0.011 0.215 55504.1 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
1097 10382 0.9 0.906 0.000083 LWT=ON
227 12711 5.0 0.229 0.000091 LWT=OFF
- at end of l.i0
870 OS file reads, 2325807 OS file writes, 978146 OS fsyncs -> LWT=ON
868 OS file reads, 2172991 OS file writes, 127104 OS fsyncs -> LWT=OFF
LWT=ON does ~8X more OS fsyncs
--- 40-core, small tx, l.i0 (initial load), 24 clients
24 processes, 20000000 rows-per-process, 1934 seconds, 248190.2 rows-per-second, 10341.2 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
24 processes, 20000000 rows-per-process, 1741 seconds, 275703.6 rows-per-second, 11487.6 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=OFF
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
387 0.0 0.0 34150.2 197.8 0.000 0.000 0.138 0.816 248190.2 LWT=ON
348 0.0 0.0 25848.5 174.9 0.000 0.000 0.094 0.650 275703.6 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
406 593852 30.0 2.393 0.000121 LWT=ON
365 513256 26.6 1.862 0.000096 LWT=OFF
- at end of l.i0
872 OS file reads, 158097061 OS file writes, 30108652 OS fsyncs -> LWT=ON
869 OS file reads, 27823275 OS file writes, 8533986 OS fsyncs -> LWT=OFF
So LWT=ON does ~3.5X more OS fsyncs from InnoDB
--- 40-core, large tx, l.i0 (initial load), 24 clients
24 processes, 20000000 rows-per-process, 589 seconds, 814940.5 rows-per-second, 33955.8 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
24 processes, 20000000 rows-per-process, 575 seconds, 834782.6 rows-per-second, 34782.6 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=OFF
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
118 0.0 0.0 43259.3 354.8 0.000 0.000 0.053 0.446 814940.5 LWT=ON
115 0.0 0.0 23221.5 303.9 0.000 0.000 0.028 0.373 834782.6 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
124 460262 47.0 0.565 0.000058 LWT=ON
121 217999 44.8 0.261 0.000054 LWT=OFF
- at end of l.i0
871 OS file reads, 44423363 OS file writes, 7459109 OS fsyncs -> LWT=ON
871 OS file reads, 17576768 OS file writes, 2296423 OS fsyncs -> LWT=OFF
So LWT=ON does ~3.2X more OS fsyncs from InnoDB
--- 40-core, small tx, l.i0 (initial load), 40 clients
40 processes, 20000000 rows-per-process, 2683 seconds, 298173.6 rows-per-second, 7454.3 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
40 processes, 20000000 rows-per-process, 2347 seconds, 340860.6 rows-per-second, 8521.5 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=OFF
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
537 0.1 0.0 31866.4 209.0 0.000 0.000 0.107 0.718 298173.6 LWT=ON
470 0.0 0.0 21940.0 187.0 0.000 0.000 0.064 0.562 340860.6 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
563 683612 40.6 2.293 0.000136 LWT=ON
493 635013 40.3 1.863 0.000118 LWT=OFF
- at end of l.i0
869 OS file reads, 266837306 OS file writes, 38662044 OS fsyncs -> LWT=ON
874 OS file reads, 40378227 OS file writes, 9285051 OS fsyncs -> LWT=OFF
So LWT=ON does ~4.2X more OS fsyncs from InnoDB
--- 40-core, large tx, l.i0 (initial load), 40 clients
40 processes, 20000000 rows-per-process, 892 seconds, 896860.9 rows-per-second, 22421.5 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=ON
40 processes, 20000000 rows-per-process, 840 seconds, 952380.9 rows-per-second, 23809.5 rows-per-second-per-user, 0 queries, 0 queries-per-second, no deletes -> LWT=OFF
iostat, vmstat normalized by insert rate
nsamp r/s rMB/s w/s wMB/s r/i rKB/i w/i wKB/i ips
179 0.0 0.0 26827.9 338.0 0.000 0.000 0.030 0.386 896860.9 LWT=ON
168 0.1 0.0 14276.8 303.1 0.000 0.000 0.015 0.326 952380.9 LWT=OFF
nsamp cs/s cpu/s cs/q cpu/q
188 363948 59.5 0.406 0.000066 LWT=ON
177 206969 59.1 0.217 0.000062 LWT=OFF
- at end of l.i0
876 OS file reads, 72479431 OS file writes, 8489735 OS fsyncs -> LWT=ON
877 OS file reads, 29484452 OS file writes, 1696910 OS fsyncs -> LWT=OFF
So LWT=ON does ~5X more OS fsyncs from InnoDB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment