gistfile1.txt

$ fio --name TEST --eta-newline=5s --filename=fio-tempfile.dat --rw=randread --size=500m --io_size=10g --blocksize=4k --ioengine=libaio --fsync=1 --iodepth=1 --direct=1 --numjobs=1 --runtime=60 --group_reporting
TEST: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.12
Starting 1 process
TEST: Laying out IO file (1 file / 500MiB)
Jobs: 1 (f=1): [r(1)][13.1%][r=928KiB/s][r=232 IOPS][eta 00m:53s]
Jobs: 1 (f=1): [r(1)][23.0%][r=928KiB/s][r=232 IOPS][eta 00m:47s] 
Jobs: 1 (f=1): [r(1)][32.8%][r=900KiB/s][r=225 IOPS][eta 00m:41s] 
Jobs: 1 (f=1): [r(1)][42.6%][r=852KiB/s][r=213 IOPS][eta 00m:35s] 
Jobs: 1 (f=1): [r(1)][52.5%][r=864KiB/s][r=216 IOPS][eta 00m:29s]  
Jobs: 1 (f=1): [r(1)][62.3%][r=932KiB/s][r=233 IOPS][eta 00m:23s]  
Jobs: 1 (f=1): [r(1)][72.1%][r=948KiB/s][r=237 IOPS][eta 00m:17s] 
Jobs: 1 (f=1): [r(1)][82.0%][r=888KiB/s][r=222 IOPS][eta 00m:11s]  
Jobs: 1 (f=1): [r(1)][91.8%][r=976KiB/s][r=244 IOPS][eta 00m:05s] 
Jobs: 1 (f=1): [r(1)][100.0%][r=952KiB/s][r=238 IOPS][eta 00m:00s]
TEST: (groupid=0, jobs=1): err= 0: pid=21040: Tue Sep 24 16:40:44 2019
  read: IOPS=224, BW=899KiB/s (921kB/s)(52.7MiB/60004msec)
    slat (nsec): min=3240, max=71181, avg=13146.50, stdev=8761.44
    clat (usec): min=36, max=50662, avg=4434.13, stdev=4557.01
     lat (usec): min=51, max=50674, avg=4447.50, stdev=4556.97
    clat percentiles (usec):
     |  1.00th=[   58],  5.00th=[   68], 10.00th=[   74], 20.00th=[   83],
     | 30.00th=[   97], 40.00th=[ 1549], 50.00th=[ 3523], 60.00th=[ 5342],
     | 70.00th=[ 7111], 80.00th=[ 8979], 90.00th=[10814], 95.00th=[11731],
     | 99.00th=[13042], 99.50th=[17433], 99.90th=[36439], 99.95th=[40109],
     | 99.99th=[45876]
   bw (  KiB/s): min=  536, max= 1120, per=99.99%, avg=898.88, stdev=116.62, samples=120
   iops        : min=  134, max=  280, avg=224.69, stdev=29.17, samples=120
  lat (usec)   : 50=0.07%, 100=31.66%, 250=6.60%, 500=0.20%, 750=0.10%
  lat (usec)   : 1000=0.10%
  lat (msec)   : 2=3.19%, 4=10.85%, 10=32.90%, 20=13.98%, 50=0.34%
  lat (msec)   : 100=0.01%
  cpu          : usr=0.13%, sys=0.49%, ctx=13491, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=13486,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
   READ: bw=899KiB/s (921kB/s), 899KiB/s-899KiB/s (921kB/s-921kB/s), io=52.7MiB (55.2MB), run=60004-60004msec

Disk stats (read/write):
    md0: ios=13482/12, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=2253/25, aggrmerge=5/5, aggrticks=10042/509, aggrin_queue=7568, aggrutil=20.87%
  sdg: ios=2228/27, merge=5/5, ticks=9766/484, in_queue=7180, util=19.81%
  sdf: ios=2132/22, merge=10/0, ticks=9538/524, in_queue=7428, util=18.72%
  sde: ios=2282/23, merge=9/2, ticks=9925/450, in_queue=7300, util=20.32%
  sdd: ios=2258/25, merge=5/5, ticks=10298/501, in_queue=8020, util=19.94%
  sdc: ios=2321/28, merge=1/10, ticks=10463/511, in_queue=7724, util=20.87%
  sdb: ios=2299/25, merge=3/8, ticks=10265/585, in_queue=7756, util=20.20%