Skip to content

Instantly share code, notes, and snippets.

@jasonbking
Last active Feb 22, 2021
Embed
What would you like to do?
L2ARC ZFS Test Output
ASSERTION: Off/onlining an L2ARC device restores all written blocks , vdev present.
l2arc_noprefetch: 0x1 = 0x0
SUCCESS: set_tunable32 l2arc_noprefetch 0
SUCCESS: truncate -s 1200M /var/tmp/testdir/disk.persist_l2arc/b
SUCCESS: zpool create -f testpool /var/tmp/testdir/disk.persist_l2arc/a cache /var/tmp/testdir/disk.persist_l2arc/b
Starting 4 threads
job: Laying out IO file (1 file / 100MiB)
job: Laying out IO file (1 file / 100MiB)
job: Laying out IO file (1 file / 100MiB)
job: Laying out IO file (1 file / 100MiB)
job: (groupid=0, jobs=4): err= 0: pid=3: Mon Feb 22 12:55:10 2021
write: IOPS=128, BW=128MiB/s (134MB/s)(400MiB/3119msec); 0 zone resets
clat (usec): min=420, max=248824, avg=28537.23, stdev=66217.70
lat (usec): min=420, max=248825, avg=28538.18, stdev=66217.68
clat percentiles (usec):
| 1.00th=[ 429], 5.00th=[ 453], 10.00th=[ 594], 20.00th=[ 717],
| 30.00th=[ 979], 40.00th=[ 1012], 50.00th=[ 1045], 60.00th=[ 1123],
| 70.00th=[ 1450], 80.00th=[ 1729], 90.00th=[168821], 95.00th=[196084],
| 99.00th=[233833], 99.50th=[233833], 99.90th=[248513], 99.95th=[248513],
| 99.99th=[248513]
bw ( KiB/s): min=104349, max=194358, per=100.00%, avg=146958.20, stdev=8836.05, samples=20
iops : min= 100, max= 188, avg=142.40, stdev= 8.65, samples=20
lat (usec) : 500=7.25%, 750=13.50%, 1000=14.25%
lat (msec) : 2=47.00%, 4=2.50%, 10=0.50%, 250=15.00%
cpu : usr=5.16%, sys=15.86%, ctx=1936, majf=0, minf=0
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,400,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
WRITE: bw=128MiB/s (134MB/s), 128MiB/s-128MiB/s (134MB/s-134MB/s), io=400MiB (419MB), run=3119-3119msec
SUCCESS: fio /opt/zfs-tests/tests/perf/fio/mkfiles.fio
Starting 4 threads
job: (groupid=0, jobs=4): err= 0: pid=3: Mon Feb 22 12:55:40 2021
read: IOPS=139k, BW=16.0GiB/s (18.2GB/s)(509GiB/30002msec)
clat (usec): min=13, max=18468, avg=27.97, stdev=33.89
lat (usec): min=13, max=18468, avg=28.04, stdev=33.91
clat percentiles (usec):
| 1.00th=[ 24], 5.00th=[ 24], 10.00th=[ 25], 20.00th=[ 25],
| 30.00th=[ 26], 40.00th=[ 26], 50.00th=[ 26], 60.00th=[ 26],
| 70.00th=[ 27], 80.00th=[ 27], 90.00th=[ 28], 95.00th=[ 42],
| 99.00th=[ 67], 99.50th=[ 92], 99.90th=[ 139], 99.95th=[ 215],
| 99.99th=[ 627]
bw ( MiB/s): min=10388, max=18590, per=100.00%, avg=17377.64, stdev=371.55, samples=236
iops : min=83110, max=148726, avg=139020.56, stdev=2972.38, samples=236
lat (usec) : 20=0.03%, 50=97.31%, 100=2.42%, 250=0.20%, 500=0.02%
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%
cpu : usr=29.74%, sys=370.85%, ctx=36627, majf=0, minf=0
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=4167735,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=16.0GiB/s (18.2GB/s), 16.0GiB/s-16.0GiB/s (18.2GB/s-18.2GB/s), io=509GiB (546GB), run=30002-30002msec
SUCCESS: fio /opt/zfs-tests/tests/perf/fio/random_reads.fio
SUCCESS: zpool offline testpool /var/tmp/testdir/disk.persist_l2arc/b
SUCCESS: zpool online testpool /var/tmp/testdir/disk.persist_l2arc/b
SUCCESS: test 9 -eq 9
SUCCESS: test 9 -gt 0
Starting 4 threads
job: (groupid=0, jobs=4): err= 0: pid=3: Mon Feb 22 12:55:52 2021
write: IOPS=83, BW=83.0MiB/s (87.1MB/s)(400MiB/4818msec); 0 zone resets
clat (usec): min=427, max=360310, avg=46802.59, stdev=83084.71
lat (usec): min=427, max=360311, avg=46803.70, stdev=83084.54
clat percentiles (usec):
| 1.00th=[ 465], 5.00th=[ 523], 10.00th=[ 857], 20.00th=[ 1045],
| 30.00th=[ 1106], 40.00th=[ 1139], 50.00th=[ 1188], 60.00th=[ 1254],
| 70.00th=[ 1614], 80.00th=[156238], 90.00th=[183501], 95.00th=[193987],
| 99.00th=[263193], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613],
| 99.99th=[358613]
bw ( KiB/s): min=32751, max=120758, per=98.87%, avg=84058.44, stdev=6228.03, samples=35
iops : min= 31, max= 117, avg=79.79, stdev= 6.03, samples=35
lat (usec) : 500=2.50%, 750=6.25%, 1000=5.00%
lat (msec) : 2=61.50%, 4=0.25%, 250=22.50%, 500=2.00%
cpu : usr=3.21%, sys=10.65%, ctx=2755, majf=0, minf=0
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,400,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
WRITE: bw=83.0MiB/s (87.1MB/s), 83.0MiB/s-83.0MiB/s (87.1MB/s-87.1MB/s), io=400MiB (419MB), run=4818-4818msec
SUCCESS: fio /opt/zfs-tests/tests/perf/fio/mkfiles.fio
Starting 4 threads
job: (groupid=0, jobs=4): err= 0: pid=3: Mon Feb 22 12:56:23 2021
read: IOPS=141k, BW=17.3GiB/s (18.5GB/s)(518GiB/30001msec)
clat (usec): min=13, max=37809, avg=27.49, stdev=31.31
lat (usec): min=13, max=37809, avg=27.56, stdev=31.32
clat percentiles (usec):
| 1.00th=[ 24], 5.00th=[ 25], 10.00th=[ 25], 20.00th=[ 25],
| 30.00th=[ 26], 40.00th=[ 26], 50.00th=[ 26], 60.00th=[ 26],
| 70.00th=[ 27], 80.00th=[ 27], 90.00th=[ 28], 95.00th=[ 42],
| 99.00th=[ 59], 99.50th=[ 90], 99.90th=[ 129], 99.95th=[ 176],
| 99.99th=[ 486]
bw ( MiB/s): min=10589, max=18489, per=100.00%, avg=17697.64, stdev=288.41, samples=236
iops : min=84712, max=147918, avg=141580.20, stdev=2307.28, samples=236
lat (usec) : 20=0.03%, 50=98.19%, 100=1.59%, 250=0.17%, 500=0.02%
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
cpu : usr=29.31%, sys=371.07%, ctx=36281, majf=0, minf=0
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=4242592,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=17.3GiB/s (18.5GB/s), 17.3GiB/s-17.3GiB/s (18.5GB/s-18.5GB/s), io=518GiB (556GB), run=30001-30001msec
SUCCESS: fio /opt/zfs-tests/tests/perf/fio/random_reads.fio
SUCCESS: zpool offline testpool /var/tmp/testdir/disk.persist_l2arc/b
SUCCESS: zpool online testpool /var/tmp/testdir/disk.persist_l2arc/b
SUCCESS: test 18 -eq 18
SUCCESS: test 18 -gt 9
SUCCESS: zpool export testpool
SUCCESS: zpool import -d /var/tmp/testdir/disk.persist_l2arc testpool
SUCCESS: test 19 -eq 19
SUCCESS: test 19 -gt 0
SUCCESS: zdb -lq /var/tmp/testdir/disk.persist_l2arc/b
SUCCESS: zpool destroy -f testpool
NOTE: Performing local cleanup via log_onexit (cleanup)
l2arc_noprefetch: 0 = 0x1
SUCCESS: set_tunable32 l2arc_noprefetch 1
Off/onlining an L2ARC device restores all written blocks, vdev present.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment