fio output from thrash.fio

thrash.txt

atobey@zorak ~/src/disk-latency-benchmarking/fio-configs $ sudo fio thrash.fio
/dev/disk/by-path/pci-0000:03:00.0-sas-0x5000c5000d7f96d9-lun-0: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=1
/dev/disk/by-id/wwn-0x5000c500151229dd: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=1
/dev/disk/by-id/ata-Samsung_SSD_840_PRO_Series_S1ANNSADB05219A: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=1
/dev/disk/by-id/md-uuid-6bb71ed6:e4410fc9:b27af0b7:0afe758d: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=1
/fio: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=1
fio-2.1.6.1
Starting 5 processes
fio: pid=72056, err=21/file:filesetup.c:586, func=open(/fio), error=Is a directory
Jobs: 4 (f=4): [mmmmX] [100.0% done] [42164KB/0KB/0KB /s] [10.6K/0/0 iops] [eta 00m:00s]
/dev/disk/by-path/pci-0000:03:00.0-sas-0x5000c5000d7f96d9-lun-0: (groupid=0, jobs=1): err= 0: pid=72048: Thu Apr  3 01:54:10 2014
  mixed: io=93168KB, bw=318000B/s, iops=77, runt=300012msec
    slat (usec): min=5, max=68, avg=26.21, stdev= 5.97
    clat (msec): min=2, max=62, avg=13.15, stdev= 3.15
     lat (msec): min=2, max=62, avg=13.17, stdev= 3.15
    clat percentiles (usec):
     |  1.00th=[ 3952],  5.00th=[ 5792], 10.00th=[ 7200], 20.00th=[ 8896],
     | 30.00th=[10304], 40.00th=[11456], 50.00th=[12608], 60.00th=[13760],
     | 70.00th=[15168], 80.00th=[16768], 90.00th=[18816], 95.00th=[20608],
     | 99.00th=[23424], 99.50th=[24192], 99.90th=[26752], 99.95th=[28032],
     | 99.99th=[30080]
    bw (KB  /s): min=   71, max=  251, per=0.36%, avg=154.84, stdev=18.29
    lat (msec) : 4=1.07%, 10=27.04%, 20=65.43%, 50=6.46%, 100=0.01%
  cpu          : usr=0.13%, sys=0.39%, ctx=24273, majf=0, minf=19
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=23292/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=1
/dev/disk/by-id/wwn-0x5000c500151229dd: (groupid=0, jobs=1): err= 0: pid=72053: Thu Apr  3 01:54:10 2014
  mixed: io=106792KB, bw=364506B/s, iops=88, runt=300008msec
    slat (usec): min=5, max=63, avg=25.86, stdev= 6.12
    clat (usec): min=397, max=122496, avg=837.99, stdev=356.78
     lat (usec): min=421, max=122529, avg=864.35, stdev=356.79
    clat percentiles (usec):
     |  1.00th=[  478],  5.00th=[  516], 10.00th=[  548], 20.00th=[  596],
     | 30.00th=[  692], 40.00th=[  868], 50.00th=[ 4080], 60.00th=[11072],
     | 70.00th=[15168], 80.00th=[20352], 90.00th=[29568], 95.00th=[39168],
     | 99.00th=[63232], 99.50th=[71168], 99.90th=[93696], 99.95th=[99840],
     | 99.99th=[117248]
    bw (KB  /s): min=   78, max=  319, per=0.42%, avg=177.41, stdev=25.78
    lat (usec) : 500=2.72%, 750=31.39%, 1000=7.60%
    lat (msec) : 2=4.77%, 4=3.51%, 10=7.46%, 20=21.80%, 50=18.10%
    lat (msec) : 100=2.60%, 250=0.04%
  cpu          : usr=0.15%, sys=0.44%, ctx=27644, majf=0, minf=19
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26698/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=1
  ev/disk/by-id/ata-Samsung_SSD_840_PRO_Series_S1ANNSADB05219A: (groupid=0, jobs=1): err= 0: pid=72054: Thu Apr  3 01:54:10 201�
  mixed: io=12220MB, bw=41712KB/s, iops=10427, runt=300000msec
    slat (usec): min=3, max=269, avg= 9.78, stdev= 2.85
    clat (usec): min=1, max=8469, avg=77.33, stdev= 4.81
     lat (usec): min=69, max=8476, avg=87.35, stdev= 6.17
    clat percentiles (usec):
     |  1.00th=[   70],  5.00th=[   73], 10.00th=[   74], 20.00th=[   76],
     | 30.00th=[   77], 40.00th=[   78], 50.00th=[   79], 60.00th=[   81],
     | 70.00th=[   83], 80.00th=[   86], 90.00th=[   90], 95.00th=[  100],
     | 99.00th=[  155], 99.50th=[  159], 99.90th=[  346], 99.95th=[  908],
     | 99.99th=[ 1592]
    bw (KB  /s): min=19360, max=23048, per=48.91%, avg=20860.47, stdev=315.61
    lat (usec) : 2=0.01%, 50=0.01%, 100=94.92%, 250=4.96%, 500=0.03%
    lat (usec) : 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.04%, 4=0.01%, 10=0.01%
  cpu          : usr=4.14%, sys=13.83%, ctx=3130241, majf=0, minf=18
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=3128388/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=1
/dev/disk/by-id/md-uuid-6bb71ed6:e4410fc9:b27af0b7:0afe758d: (groupid=0, jobs=1): err= 0: pid=72055: Thu Apr  3 01:54:10 2014
  mixed: io=83164KB, bw=283858B/s, iops=69, runt=300008msec
    slat (usec): min=6, max=66, avg=27.74, stdev= 6.12
    clat (msec): min=1, max=272, avg=14.88, stdev= 4.48
     lat (msec): min=1, max=272, avg=14.90, stdev= 4.48
    clat percentiles (usec):
     |  1.00th=[ 4192],  5.00th=[ 6240], 10.00th=[ 7648], 20.00th=[ 9536],
     | 30.00th=[10944], 40.00th=[12352], 50.00th=[13632], 60.00th=[15168],
     | 70.00th=[16768], 80.00th=[18816], 90.00th=[21888], 95.00th=[24704],
     | 99.00th=[31104], 99.50th=[33536], 99.90th=[38656], 99.95th=[41728],
     | 99.99th=[46848]
    bw (KB  /s): min=   54, max=  244, per=0.32%, avg=137.96, stdev=18.15
    lat (msec) : 2=0.02%, 4=0.80%, 10=22.39%, 20=61.45%, 50=15.33%
    lat (msec) : 500=0.01%
  cpu          : usr=0.12%, sys=0.35%, ctx=21581, majf=0, minf=18
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=20791/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  MIXED: io=12497MB, aggrb=42653KB/s, minb=277KB/s, maxb=41711KB/s, mint=300000msec, maxt=300012msec