# SEQ READ
fio --name=test --rw=read --direct=1 --ioengine=libaio --bs=64k --iodepth=32 --size=10G --group_reporting
# SEQ WRITE
fio --name=test --rw=write --direct=1 --ioengine=libaio --bs=64k --iodepth=16 --size=10G --group_reporting
# RAND READ
fio --name=test --rw=randread --direct=1 --ioengine=libaio --bs=8k --iodepth=32 --size=10G --group_reporting
# RAND WRITE
fio --name=test --rw=randwrite --direct=1 --ioengine=libaio --bs=8k --iodepth=32 --size=10G --group_reporting
test: (groupid=0, jobs=1): err= 0: pid=3414: Wed Mar 3 16:29:51 2021
read: IOPS=14.9k, BW=932MiB/s (977MB/s)(10.0GiB/10986msec)
slat (usec): min=5, max=488, avg=12.56, stdev= 5.45
clat (usec): min=760, max=4957, avg=2131.45, stdev=251.00
lat (usec): min=772, max=4971, avg=2144.24, stdev=250.84
clat percentiles (usec):
| 1.00th=[ 1582], 5.00th=[ 1778], 10.00th=[ 1844], 20.00th=[ 1926],
| 30.00th=[ 1991], 40.00th=[ 2057], 50.00th=[ 2114], 60.00th=[ 2180],
| 70.00th=[ 2245], 80.00th=[ 2311], 90.00th=[ 2442], 95.00th=[ 2573],
| 99.00th=[ 2835], 99.50th=[ 2933], 99.90th=[ 3392], 99.95th=[ 3654],
| 99.99th=[ 4359]
bw ( KiB/s): min=953856, max=959488, per=100.00%, avg=956187.95, stdev=1441.30, samples=21
iops : min=14904, max=14992, avg=14940.43, stdev=22.52, samples=21
lat (usec) : 1000=0.01%
lat (msec) : 2=30.40%, 4=69.57%, 10=0.02%
cpu : usr=6.06%, sys=18.63%, ctx=131608, majf=0, minf=527
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=163840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=932MiB/s (977MB/s), 932MiB/s-932MiB/s (977MB/s-977MB/s), io=10.0GiB (10.7GB), run=10986-10986msec
Disk stats (read/write):
sdb: ios=162797/0, merge=1/0, ticks=346868/0, in_queue=346868, util=99.25%
test: (groupid=0, jobs=1): err= 0: pid=3900: Wed Mar 3 16:37:45 2021
write: IOPS=14.3k, BW=896MiB/s (940MB/s)(10.0GiB/11423msec); 0 zone resets
slat (usec): min=9, max=564, avg=16.67, stdev= 6.59
clat (usec): min=160, max=8351, avg=1096.65, stdev=525.20
lat (usec): min=179, max=8365, avg=1113.66, stdev=525.07
clat percentiles (usec):
| 1.00th=[ 379], 5.00th=[ 445], 10.00th=[ 529], 20.00th=[ 660],
| 30.00th=[ 742], 40.00th=[ 816], 50.00th=[ 1074], 60.00th=[ 1336],
| 70.00th=[ 1434], 80.00th=[ 1516], 90.00th=[ 1631], 95.00th=[ 1729],
| 99.00th=[ 1844], 99.50th=[ 1975], 99.90th=[ 7111], 99.95th=[ 7504],
| 99.99th=[ 8094]
bw ( KiB/s): min=904448, max=934656, per=100.00%, avg=919013.73, stdev=9795.17, samples=22
iops : min=14132, max=14604, avg=14359.55, stdev=153.07, samples=22
lat (usec) : 250=0.19%, 500=6.88%, 750=23.30%, 1000=18.23%
lat (msec) : 2=50.94%, 4=0.21%, 10=0.26%
cpu : usr=10.64%, sys=22.82%, ctx=146879, majf=0, minf=13
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,163840,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=896MiB/s (940MB/s), 896MiB/s-896MiB/s (940MB/s-940MB/s), io=10.0GiB (10.7GB), run=11423-11423msec
Disk stats (read/write):
sdb: ios=0/163739, merge=0/1, ticks=0/178476, in_queue=178476, util=99.28%
test: (groupid=0, jobs=1): err= 0: pid=3977: Wed Mar 3 16:39:53 2021
read: IOPS=85.5k, BW=668MiB/s (700MB/s)(10.0GiB/15334msec)
slat (usec): min=3, max=482, avg= 6.26, stdev= 3.72
clat (usec): min=94, max=1727, avg=366.98, stdev=118.98
lat (usec): min=114, max=1732, avg=373.46, stdev=119.04
clat percentiles (usec):
| 1.00th=[ 151], 5.00th=[ 194], 10.00th=[ 223], 20.00th=[ 265],
| 30.00th=[ 297], 40.00th=[ 326], 50.00th=[ 359], 60.00th=[ 388],
| 70.00th=[ 420], 80.00th=[ 465], 90.00th=[ 523], 95.00th=[ 578],
| 99.00th=[ 693], 99.50th=[ 742], 99.90th=[ 857], 99.95th=[ 906],
| 99.99th=[ 1020]
bw ( KiB/s): min=661360, max=690352, per=100.00%, avg=685270.67, stdev=6627.25, samples=30
iops : min=82670, max=86294, avg=85658.77, stdev=828.40, samples=30
lat (usec) : 100=0.01%, 250=16.61%, 500=70.08%, 750=12.87%, 1000=0.42%
lat (msec) : 2=0.01%
cpu : usr=19.08%, sys=48.41%, ctx=269293, majf=0, minf=80
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=1310720,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=668MiB/s (700MB/s), 668MiB/s-668MiB/s (700MB/s-700MB/s), io=10.0GiB (10.7GB), run=15334-15334msec
Disk stats (read/write):
sdb: ios=1297142/0, merge=1/0, ticks=460553/0, in_queue=460553, util=99.50%
test: (groupid=0, jobs=1): err= 0: pid=4052: Wed Mar 3 16:42:10 2021
write: IOPS=61.2k, BW=478MiB/s (501MB/s)(10.0GiB/21432msec); 0 zone resets
slat (usec): min=4, max=597, avg=10.83, stdev= 5.82
clat (usec): min=49, max=6984, avg=510.42, stdev=124.05
lat (usec): min=61, max=6992, avg=521.52, stdev=124.15
clat percentiles (usec):
| 1.00th=[ 392], 5.00th=[ 433], 10.00th=[ 449], 20.00th=[ 469],
| 30.00th=[ 482], 40.00th=[ 494], 50.00th=[ 502], 60.00th=[ 515],
| 70.00th=[ 529], 80.00th=[ 545], 90.00th=[ 570], 95.00th=[ 594],
| 99.00th=[ 660], 99.50th=[ 865], 99.90th=[ 1045], 99.95th=[ 3785],
| 99.99th=[ 6652]
bw ( KiB/s): min=479104, max=497056, per=100.00%, avg=490040.36, stdev=4554.66, samples=42
iops : min=59888, max=62132, avg=61255.02, stdev=569.32, samples=42
lat (usec) : 50=0.01%, 100=0.02%, 250=0.07%, 500=46.65%, 750=52.70%
lat (usec) : 1000=0.40%
lat (msec) : 2=0.10%, 4=0.01%, 10=0.04%
cpu : usr=21.73%, sys=56.73%, ctx=52393, majf=0, minf=280
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=0,1310720,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=478MiB/s (501MB/s), 478MiB/s-478MiB/s (501MB/s-501MB/s), io=10.0GiB (10.7GB), run=21432-21432msec
Disk stats (read/write):
sdb: ios=0/1295512, merge=0/1, ticks=0/146527, in_queue=146526, util=99.72%
test: (groupid=0, jobs=1): err= 0: pid=4295: Wed Mar 3 16:51:05 2021
read: IOPS=10.2k, BW=640MiB/s (671MB/s)(10.0GiB/15993msec)
slat (usec): min=7, max=522, avg=20.95, stdev= 7.28
clat (usec): min=1503, max=5671, avg=3100.56, stdev=216.40
lat (usec): min=1544, max=5699, avg=3121.73, stdev=216.44
clat percentiles (usec):
| 1.00th=[ 2671], 5.00th=[ 2835], 10.00th=[ 2900], 20.00th=[ 2966],
| 30.00th=[ 3032], 40.00th=[ 3064], 50.00th=[ 3097], 60.00th=[ 3130],
| 70.00th=[ 3163], 80.00th=[ 3195], 90.00th=[ 3261], 95.00th=[ 3392],
| 99.00th=[ 4146], 99.50th=[ 4359], 99.90th=[ 4686], 99.95th=[ 4817],
| 99.99th=[ 5145]
bw ( KiB/s): min=639744, max=695738, per=100.00%, avg=656121.61, stdev=13426.26, samples=31
iops : min= 9996, max=10870, avg=10251.87, stdev=209.72, samples=31
lat (msec) : 2=0.01%, 4=98.65%, 10=1.34%
cpu : usr=4.89%, sys=25.17%, ctx=161732, majf=0, minf=1057
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=163840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=640MiB/s (671MB/s), 640MiB/s-640MiB/s (671MB/s-671MB/s), io=10.0GiB (10.7GB), run=15993-15993msec
test: (groupid=0, jobs=1): err= 0: pid=4369: Wed Mar 3 16:51:58 2021
write: IOPS=8785, BW=549MiB/s (576MB/s)(10.0GiB/18648msec); 0 zone resets
slat (usec): min=12, max=585, avg=25.29, stdev=10.41
clat (usec): min=563, max=10260, avg=1793.99, stdev=378.93
lat (usec): min=707, max=10286, avg=1819.57, stdev=378.49
clat percentiles (usec):
| 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1401], 20.00th=[ 1516],
| 30.00th=[ 1631], 40.00th=[ 1729], 50.00th=[ 1811], 60.00th=[ 1876],
| 70.00th=[ 1942], 80.00th=[ 2008], 90.00th=[ 2114], 95.00th=[ 2245],
| 99.00th=[ 2540], 99.50th=[ 2704], 99.90th=[ 6783], 99.95th=[ 7963],
| 99.99th=[ 9765]
bw ( KiB/s): min=543616, max=584576, per=100.00%, avg=563070.64, stdev=8648.80, samples=36
iops : min= 8494, max= 9134, avg=8797.89, stdev=135.16, samples=36
lat (usec) : 750=0.01%, 1000=0.07%
lat (msec) : 2=78.21%, 4=21.50%, 10=0.21%, 20=0.01%
cpu : usr=7.25%, sys=22.49%, ctx=84728, majf=0, minf=562
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,163840,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=549MiB/s (576MB/s), 549MiB/s-549MiB/s (576MB/s-576MB/s), io=10.0GiB (10.7GB), run=18648-18648msec
test: (groupid=0, jobs=1): err= 0: pid=4442: Wed Mar 3 16:53:26 2021
read: IOPS=21.5k, BW=168MiB/s (176MB/s)(10.0GiB/60916msec)
slat (usec): min=3, max=673, avg=10.64, stdev= 4.50
clat (usec): min=402, max=2791, avg=1475.16, stdev=118.94
lat (usec): min=416, max=2801, avg=1486.00, stdev=119.02
clat percentiles (usec):
| 1.00th=[ 1270], 5.00th=[ 1303], 10.00th=[ 1336], 20.00th=[ 1385],
| 30.00th=[ 1401], 40.00th=[ 1434], 50.00th=[ 1467], 60.00th=[ 1500],
| 70.00th=[ 1532], 80.00th=[ 1565], 90.00th=[ 1614], 95.00th=[ 1680],
| 99.00th=[ 1860], 99.50th=[ 1958], 99.90th=[ 2114], 99.95th=[ 2147],
| 99.99th=[ 2245]
bw ( KiB/s): min=156768, max=183361, per=100.00%, avg=172304.77, stdev=6452.03, samples=121
iops : min=19596, max=22920, avg=21538.07, stdev=806.52, samples=121
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=99.66%, 4=0.34%
cpu : usr=9.27%, sys=28.38%, ctx=998976, majf=0, minf=1119
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=1310720,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=168MiB/s (176MB/s), 168MiB/s-168MiB/s (176MB/s-176MB/s), io=10.0GiB (10.7GB), run=60916-60916msec
test: (groupid=0, jobs=1): err= 0: pid=4513: Wed Mar 3 16:55:11 2021
write: IOPS=17.6k, BW=137MiB/s (144MB/s)(10.0GiB/74651msec); 0 zone resets
slat (usec): min=3, max=533, avg=12.22, stdev= 5.19
clat (usec): min=578, max=4092, avg=1808.78, stdev=173.22
lat (usec): min=618, max=4105, avg=1821.20, stdev=173.16
clat percentiles (usec):
| 1.00th=[ 1467], 5.00th=[ 1565], 10.00th=[ 1614], 20.00th=[ 1680],
| 30.00th=[ 1729], 40.00th=[ 1762], 50.00th=[ 1795], 60.00th=[ 1827],
| 70.00th=[ 1876], 80.00th=[ 1909], 90.00th=[ 1991], 95.00th=[ 2114],
| 99.00th=[ 2409], 99.50th=[ 2474], 99.90th=[ 2704], 99.95th=[ 2835],
| 99.99th=[ 3621]
bw ( KiB/s): min=114656, max=146919, per=100.00%, avg=140617.92, stdev=4811.85, samples=148
iops : min=14332, max=18364, avg=17577.20, stdev=601.46, samples=148
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=90.50%, 4=9.50%, 10=0.01%
cpu : usr=8.90%, sys=24.29%, ctx=877407, majf=0, minf=829
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=0,1310720,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=137MiB/s (144MB/s), 137MiB/s-137MiB/s (144MB/s-144MB/s), io=10.0GiB (10.7GB), run=74651-74651msec
test: (groupid=0, jobs=1): err= 0: pid=4866: Wed Mar 3 17:03:20 2021
read: IOPS=7943, BW=496MiB/s (521MB/s)(10.0GiB/20625msec)
slat (usec): min=10, max=414, avg=15.97, stdev= 6.08
clat (usec): min=1106, max=13023, avg=4010.43, stdev=1844.71
lat (usec): min=1121, max=13066, avg=4026.69, stdev=1845.90
clat percentiles (usec):
| 1.00th=[ 1729], 5.00th=[ 2147], 10.00th=[ 2376], 20.00th=[ 2638],
| 30.00th=[ 2802], 40.00th=[ 2933], 50.00th=[ 3097], 60.00th=[ 3359],
| 70.00th=[ 4490], 80.00th=[ 6390], 90.00th=[ 6980], 95.00th=[ 7242],
| 99.00th=[ 8029], 99.50th=[ 8455], 99.90th=[10552], 99.95th=[10945],
| 99.99th=[11863]
bw ( KiB/s): min=449382, max=561152, per=100.00%, avg=509580.15, stdev=15024.95, samples=40
iops : min= 7021, max= 8768, avg=7962.18, stdev=234.83, samples=40
lat (msec) : 2=3.11%, 4=65.89%, 10=30.82%, 20=0.18%
cpu : usr=3.94%, sys=16.33%, ctx=160201, majf=0, minf=529
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=163840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=496MiB/s (521MB/s), 496MiB/s-496MiB/s (521MB/s-521MB/s), io=10.0GiB (10.7GB), run=20625-20625msec
Disk stats (read/write):
sdd: ios=162260/1, merge=2/0, ticks=651076/2, in_queue=651079, util=99.66%
test: (groupid=0, jobs=1): err= 0: pid=4934: Wed Mar 3 17:03:54 2021
write: IOPS=13.9k, BW=872MiB/s (914MB/s)(10.0GiB/11745msec); 0 zone resets
slat (usec): min=10, max=437, avg=17.90, stdev=10.34
clat (usec): min=270, max=8233, avg=1127.36, stdev=360.99
lat (usec): min=287, max=8248, avg=1145.53, stdev=359.66
clat percentiles (usec):
| 1.00th=[ 578], 5.00th=[ 717], 10.00th=[ 807], 20.00th=[ 930],
| 30.00th=[ 996], 40.00th=[ 1057], 50.00th=[ 1106], 60.00th=[ 1156],
| 70.00th=[ 1221], 80.00th=[ 1303], 90.00th=[ 1434], 95.00th=[ 1532],
| 99.00th=[ 1762], 99.50th=[ 1893], 99.90th=[ 6783], 99.95th=[ 7373],
| 99.99th=[ 7963]
bw ( KiB/s): min=845568, max=919424, per=100.00%, avg=893996.65, stdev=18431.58, samples=23
iops : min=13212, max=14366, avg=13968.61, stdev=287.89, samples=23
lat (usec) : 500=0.41%, 750=6.15%, 1000=24.00%
lat (msec) : 2=69.05%, 4=0.15%, 10=0.23%
cpu : usr=11.36%, sys=24.56%, ctx=36595, majf=0, minf=17
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,163840,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=872MiB/s (914MB/s), 872MiB/s-872MiB/s (914MB/s-914MB/s), io=10.0GiB (10.7GB), run=11745-11745msec
Disk stats (read/write):
sdd: ios=0/162714, merge=0/1, ticks=0/145979, in_queue=145979, util=99.29%
test: (groupid=0, jobs=1): err= 0: pid=5002: Wed Mar 3 17:05:24 2021
read: IOPS=23.5k, BW=183MiB/s (192MB/s)(10.0GiB/55894msec)
slat (usec): min=4, max=454, avg= 9.87, stdev= 3.20
clat (usec): min=473, max=7371, avg=1353.23, stdev=164.22
lat (usec): min=491, max=7381, avg=1363.30, stdev=164.29
clat percentiles (usec):
| 1.00th=[ 971], 5.00th=[ 1106], 10.00th=[ 1172], 20.00th=[ 1237],
| 30.00th=[ 1270], 40.00th=[ 1303], 50.00th=[ 1336], 60.00th=[ 1385],
| 70.00th=[ 1418], 80.00th=[ 1467], 90.00th=[ 1549], 95.00th=[ 1614],
| 99.00th=[ 1827], 99.50th=[ 1942], 99.90th=[ 2376], 99.95th=[ 2540],
| 99.99th=[ 2802]
bw ( KiB/s): min=169010, max=190480, per=100.00%, avg=187948.63, stdev=2491.86, samples=111
iops : min=21126, max=23810, avg=23493.56, stdev=311.50, samples=111
lat (usec) : 500=0.01%, 750=0.01%, 1000=1.67%
lat (msec) : 2=97.95%, 4=0.38%, 10=0.01%
cpu : usr=10.86%, sys=30.29%, ctx=1303964, majf=0, minf=81
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=1310720,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=183MiB/s (192MB/s), 183MiB/s-183MiB/s (192MB/s-192MB/s), io=10.0GiB (10.7GB), run=55894-55894msec
Disk stats (read/write):
sdd: ios=1307065/2, merge=1/0, ticks=1770008/3, in_queue=1770011, util=99.98%
test: (groupid=0, jobs=1): err= 0: pid=5070: Wed Mar 3 17:06:53 2021
write: IOPS=22.2k, BW=173MiB/s (182MB/s)(10.0GiB/59047msec); 0 zone resets
slat (usec): min=3, max=499, avg=10.06, stdev= 7.44
clat (usec): min=191, max=7152, avg=1430.03, stdev=376.68
lat (usec): min=215, max=7220, avg=1440.30, stdev=376.53
clat percentiles (usec):
| 1.00th=[ 330], 5.00th=[ 660], 10.00th=[ 938], 20.00th=[ 1303],
| 30.00th=[ 1385], 40.00th=[ 1418], 50.00th=[ 1450], 60.00th=[ 1483],
| 70.00th=[ 1532], 80.00th=[ 1598], 90.00th=[ 1795], 95.00th=[ 2073],
| 99.00th=[ 2474], 99.50th=[ 2573], 99.90th=[ 2835], 99.95th=[ 2933],
| 99.99th=[ 3195]
bw ( KiB/s): min=160576, max=185584, per=100.00%, avg=177854.14, stdev=4554.16, samples=117
iops : min=20072, max=23198, avg=22231.78, stdev=569.26, samples=117
lat (usec) : 250=0.01%, 500=2.94%, 750=3.51%, 1000=4.78%
lat (msec) : 2=82.71%, 4=6.05%, 10=0.01%
cpu : usr=10.52%, sys=23.98%, ctx=152041, majf=0, minf=281
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=0,1310720,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=173MiB/s (182MB/s), 173MiB/s-173MiB/s (182MB/s-182MB/s), io=10.0GiB (10.7GB), run=59047-59047msec
Disk stats (read/write):
sdd: ios=0/1309520, merge=0/1, ticks=0/942315, in_queue=942315, util=99.99%
