ext4 raid10 fio rw5050

mdraid10-ext4-rw5050.txt

rw5050: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=32
...
fio-2.1.9
Starting 4 processes
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)
rw5050: Laying out IO file(s) (1 file(s) / 25600MB)

rw5050: (groupid=0, jobs=4): err= 0: pid=58385: Wed Jun 18 03:45:04 2014
  Description  : ["random 50/50"]
  read : io=70171MB, bw=119758KB/s, iops=29939, runt=600004msec
    slat (usec): min=34, max=67223, avg=84.87, stdev=443.68
    clat (usec): min=0, max=795128, avg=1843.95, stdev=2520.37
     lat (usec): min=109, max=795197, avg=1923.07, stdev=2525.51
    clat percentiles (usec):
     |  1.00th=[  161],  5.00th=[  233], 10.00th=[  322], 20.00th=[  502],
     | 30.00th=[  708], 40.00th=[  980], 50.00th=[ 1336], 60.00th=[ 1784],
     | 70.00th=[ 2320], 80.00th=[ 2864], 90.00th=[ 3824], 95.00th=[ 4768],
     | 99.00th=[ 8032], 99.50th=[11712], 99.90th=[19328], 99.95th=[21632],
     | 99.99th=[39680]
    bw (KB  /s): min=    3, max=38480, per=25.03%, avg=29970.78, stdev=2820.78
  write: io=70136MB, bw=119698KB/s, iops=29924, runt=600004msec
    slat (usec): min=35, max=67223, avg=87.26, stdev=454.87
    clat (usec): min=0, max=803004, avg=2255.48, stdev=2939.51
     lat (usec): min=77, max=803045, avg=2336.68, stdev=2944.13
    clat percentiles (usec):
     |  1.00th=[  157],  5.00th=[  278], 10.00th=[  418], 20.00th=[  676],
     | 30.00th=[ 1004], 40.00th=[ 1400], 50.00th=[ 1848], 60.00th=[ 2320],
     | 70.00th=[ 2768], 80.00th=[ 3376], 90.00th=[ 4384], 95.00th=[ 5280],
     | 99.00th=[ 9664], 99.50th=[14144], 99.90th=[20864], 99.95th=[23168],
     | 99.99th=[47872]
    bw (KB  /s): min=    3, max=37936, per=25.03%, avg=29955.78, stdev=2781.99
    lat (usec) : 2=0.01%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (usec) : 100=0.09%, 250=4.84%, 500=11.58%, 750=10.49%, 1000=8.18%
    lat (msec) : 2=23.44%, 4=30.37%, 10=10.18%, 20=0.69%, 50=0.10%
    lat (msec) : 100=0.01%, 750=0.01%, 1000=0.01%
  cpu          : usr=1.14%, sys=9.49%, ctx=26524921, majf=0, minf=48834
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.1%, 32=100.1%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=17963751/w=17954761/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=70171MB, aggrb=119757KB/s, minb=119757KB/s, maxb=119757KB/s, mint=600004msec, maxt=600004msec
  WRITE: io=70136MB, aggrb=119698KB/s, minb=119698KB/s, maxb=119698KB/s, mint=600004msec, maxt=600004msec

Disk stats (read/write):
    md0: ios=17989491/17988095, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=4497365/8994984, aggrmerge=7/151, aggrticks=5656795/9638391, aggrin_queue=15295530, aggrutil=86.08%
  sdi: ios=4701396/8993652, merge=7/162, ticks=6238640/11338867, in_queue=17578390, util=84.68%
  sdj: ios=4293165/8993652, merge=7/162, ticks=5451804/10449144, in_queue=15901443, util=82.97%
  sdk: ios=5035615/8996315, merge=9/144, ticks=6875166/11990340, in_queue=18866644, util=86.08%
  sdl: ios=3959286/8996320, merge=6/139, ticks=4061570/4775214, in_queue=8835644, util=74.67%