ZFS (mmap) 50:50 randrw RAID10 fio config

raid10-zfs-rw5050.txt

rw5050: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=mmap, iodepth=32
...
fio-2.1.9
Starting 4 processes
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)

rw5050: (groupid=0, jobs=4): err= 0: pid=59426: Wed Jun 18 05:44:45 2014
  Description  : ["random 50/50"]
  read : io=4650.8MB, bw=7937.3KB/s, iops=1984, runt=600002msec
    clat (usec): min=6, max=819309, avg=857.14, stdev=2002.87
     lat (usec): min=6, max=819309, avg=857.34, stdev=2002.87
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   16], 10.00th=[  370], 20.00th=[  414],
     | 30.00th=[  450], 40.00th=[  506], 50.00th=[  556], 60.00th=[  604],
     | 70.00th=[  668], 80.00th=[  860], 90.00th=[ 2160], 95.00th=[ 2864],
     | 99.00th=[ 3408], 99.50th=[ 5280], 99.90th=[15040], 99.95th=[15168],
     | 99.99th=[15552]
    bw (KB  /s): min=    0, max= 5048, per=25.14%, avg=1995.31, stdev=742.85
  write: io=4652.4MB, bw=7939.2KB/s, iops=1984, runt=600002msec
    clat (usec): min=6, max=804161, avg=1153.09, stdev=5118.44
     lat (usec): min=6, max=804162, avg=1153.34, stdev=5118.44
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   18], 10.00th=[  374], 20.00th=[  418],
     | 30.00th=[  454], 40.00th=[  510], 50.00th=[  564], 60.00th=[  604],
     | 70.00th=[  668], 80.00th=[  900], 90.00th=[ 2256], 95.00th=[ 2896],
     | 99.00th=[ 4768], 99.50th=[15296], 99.90th=[73216], 99.95th=[95744],
     | 99.99th=[199680]
    bw (KB  /s): min=   25, max= 5216, per=25.16%, avg=1997.64, stdev=732.69
    lat (usec) : 10=0.80%, 20=4.86%, 50=1.32%, 100=0.09%, 250=0.02%
    lat (usec) : 500=31.55%, 750=37.81%, 1000=5.09%
    lat (msec) : 2=7.40%, 4=10.21%, 10=0.21%, 20=0.41%, 50=0.11%
    lat (msec) : 100=0.10%, 250=0.02%, 1000=0.01%
  cpu          : usr=0.41%, sys=3.94%, ctx=2454661, majf=2427346, minf=96
  IO depths    : 1=101.9%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1190584/w=1191002/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=4650.8MB, aggrb=7937KB/s, minb=7937KB/s, maxb=7937KB/s, mint=600002msec, maxt=600002msec
  WRITE: io=4652.4MB, aggrb=7939KB/s, minb=7939KB/s, maxb=7939KB/s, mint=600002msec, maxt=600002msec