Skip to content

Instantly share code, notes, and snippets.

@sithu

sithu/lab_output

Last active August 29, 2015 14:22
Show Gist options
  • Save sithu/e32ecd2fb02a6ec0302d to your computer and use it in GitHub Desktop.
Save sithu/e32ecd2fb02a6ec0302d to your computer and use it in GitHub Desktop.
Download ZIP
LAB: IO Pattern & Strategies
Raw
lab_output
### Test 1 Output
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio rread-latency.cfg
rread-latency-test: (g=0): rw=randread, bs=16K-16K/16K-16K, ioengine=libaio, iodepth=1
fio 1.59
Starting 1 process
rread-latency-test: Laying out IO file(s) (1 file(s) / 10240MB)
Jobs: 1 (f=1): [r] [100.0% done] [28397K/0K /s] [1733 /0 iops] [eta 00m:00s]
rread-latency-test: (groupid=0, jobs=1): err= 0: pid=1813
read : io=2044.1MB, bw=34900KB/s, iops=2181 , runt= 60001msec
slat (usec): min=14 , max=2010 , avg=18.95, stdev= 7.17
clat (usec): min=4 , max=36556 , avg=433.51, stdev=424.06
lat (usec): min=319 , max=36578 , avg=454.02, stdev=424.22
bw (KB/s) : min=25632, max=39936, per=100.16%, avg=34955.91, stdev=3599.10
cpu : usr=2.98%, sys=5.47%, ctx=131272, majf=0, minf=23
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=130878/0/0, short=0/0/0
lat (usec): 10=0.01%, 50=0.01%, 250=0.01%, 500=97.56%, 750=1.65%
lat (usec): 1000=0.21%
lat (msec): 2=0.10%, 4=0.02%, 10=0.45%, 50=0.01%
Run status group 0 (all jobs):
READ: io=2044.1MB, aggrb=34900KB/s, minb=35737KB/s, maxb=35737KB/s, mint=60001msec, maxt=60001msec
Disk stats (read/write):
xvdc: ios=130521/16, merge=0/70, ticks=58424/8, in_queue=58432, util=97.60%
#######
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio rwrite-latency.cfg
rwrite-latency-test: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=libaio, iodepth=1
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [w] [100.0% done] [0K/12455K /s] [0 /760 iops] [eta 00m:00s]
rwrite-latency-test: (groupid=0, jobs=1): err= 0: pid=1833
write: io=570304KB, bw=9504.1KB/s, iops=594 , runt= 60001msec
slat (usec): min=18 , max=427 , avg=26.04, stdev= 8.10
clat (usec): min=529 , max=48454 , avg=1650.46, stdev=1409.99
lat (usec): min=656 , max=48482 , avg=1678.15, stdev=1410.39
bw (KB/s) : min= 4525, max=15680, per=100.02%, avg=9505.90, stdev=2514.18
cpu : usr=0.53%, sys=2.43%, ctx=35820, majf=0, minf=20
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/35644/0, short=0/0/0
lat (usec): 750=12.99%, 1000=29.90%
lat (msec): 2=34.08%, 4=18.26%, 10=4.72%, 20=0.02%, 50=0.04%
Run status group 0 (all jobs):
WRITE: io=570304KB, aggrb=9504KB/s, minb=9733KB/s, maxb=9733KB/s, mint=60001msec, maxt=60001msec
Disk stats (read/write):
xvdc: ios=0/35637, merge=0/11, ticks=0/59756, in_queue=59740, util=99.57%
###########################################################
### Test 2 : IOPS Ramdon IO Tests
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio rread-iops.cfg
rread-iops-test: (g=0): rw=randread, bs=16K-16K/16K-16K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [r] [100.0% done] [35697K/0K /s] [2178 /0 iops] [eta 00m:00s]
rread-iops-test: (groupid=0, jobs=1): err= 0: pid=1839
read : io=2114.7MB, bw=36073KB/s, iops=2254 , runt= 60028msec
slat (usec): min=12 , max=24090 , avg=19.79, stdev=65.73
clat (usec): min=193 , max=108845 , avg=3522.57, stdev=11983.44
lat (usec): min=388 , max=108864 , avg=3543.95, stdev=11983.43
bw (KB/s) : min=29410, max=58496, per=100.50%, avg=36252.51, stdev=5901.92
cpu : usr=1.29%, sys=7.08%, ctx=108000, majf=0, minf=53
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=135337/0/0, short=0/0/0
lat (usec): 250=0.01%, 500=0.14%, 750=19.32%, 1000=47.27%
lat (msec): 2=9.52%, 4=20.08%, 10=0.05%, 20=0.01%, 50=0.02%
lat (msec): 100=3.58%, 250=0.02%
Run status group 0 (all jobs):
READ: io=2114.7MB, aggrb=36073KB/s, minb=36938KB/s, maxb=36938KB/s, mint=60028msec, maxt=60028msec
Disk stats (read/write):
xvdc: ios=135329/0, merge=0/0, ticks=477600/0, in_queue=477692, util=99.95%
####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio rwrite-iops.cfg
write-iops-test: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [w] [100.0% done] [0K/36859K /s] [0 /2249 iops] [eta 00m:00s]
write-iops-test: (groupid=0, jobs=1): err= 0: pid=1842
write: io=2212.6MB, bw=37757KB/s, iops=2359 , runt= 60004msec
slat (usec): min=15 , max=48528 , avg=24.58, stdev=195.49
clat (usec): min=667 , max=51916 , avg=3359.33, stdev=1286.57
lat (usec): min=714 , max=51943 , avg=3385.53, stdev=1299.12
bw (KB/s) : min=35872, max=58464, per=100.09%, avg=37790.12, stdev=4651.03
cpu : usr=1.53%, sys=8.99%, ctx=140561, majf=0, minf=19
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/141600/0, short=0/0/0
lat (usec): 750=0.01%, 1000=0.56%
lat (msec): 2=2.14%, 4=96.01%, 10=1.12%, 20=0.03%, 50=0.12%
lat (msec): 100=0.01%
Run status group 0 (all jobs):
WRITE: io=2212.6MB, aggrb=37757KB/s, minb=38663KB/s, maxb=38663KB/s, mint=60004msec, maxt=60004msec
Disk stats (read/write):
xvdc: ios=0/141138, merge=0/11, ticks=0/476560, in_queue=476572, util=99.93%
####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio rw-iops.cfg
rread-latency-test: (g=0): rw=randrw, bs=16K-16K/16K-16K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [m] [100.0% done] [35026K/15123K /s] [2137 /923 iops] [eta 00m:00s]
rread-latency-test: (groupid=0, jobs=1): err= 0: pid=1846
read : io=2008.2MB, bw=34270KB/s, iops=2141 , runt= 60003msec
slat (usec): min=12 , max=24114 , avg=20.00, stdev=67.41
clat (usec): min=326 , max=38541 , avg=2490.49, stdev=502.41
lat (usec): min=378 , max=38559 , avg=2512.07, stdev=505.75
bw (KB/s) : min=31937, max=40800, per=100.07%, avg=34293.97, stdev=904.67
write: io=885856KB, bw=14764KB/s, iops=922 , runt= 60003msec
slat (usec): min=15 , max=24085 , avg=26.44, stdev=102.53
clat (usec): min=214 , max=37553 , avg=2795.20, stdev=471.53
lat (usec): min=785 , max=37579 , avg=2823.30, stdev=479.75
bw (KB/s) : min=13280, max=17696, per=100.08%, avg=14774.53, stdev=690.80
cpu : usr=2.91%, sys=9.73%, ctx=167712, majf=0, minf=19
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=128519/55366/0, short=0/0/0
lat (usec): 250=0.01%, 500=0.01%, 750=0.16%, 1000=0.33%
lat (msec): 2=0.54%, 4=98.85%, 10=0.07%, 20=0.01%, 50=0.03%
Run status group 0 (all jobs):
READ: io=2008.2MB, aggrb=34270KB/s, minb=35092KB/s, maxb=35092KB/s, mint=60003msec, maxt=60003msec
WRITE: io=885856KB, aggrb=14763KB/s, minb=15117KB/s, maxb=15117KB/s, mint=60003msec, maxt=60003msec
Disk stats (read/write):
xvdc: ios=128451/55348, merge=0/11, ticks=322092/155564, in_queue=477656, util=99.93%
######################################
### Test 3: Sequential IO Transfer Rate Tests
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio seqread-bw.cfg
seqread-bw-test: (g=0): rw=read, bs=256K-256K/256K-256K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [R] [100.0% done] [37449K/0K /s] [142 /0 iops] [eta 00m:00s]
seqread-bw-test: (groupid=0, jobs=1): err= 0: pid=1853
read : io=2227.6MB, bw=37979KB/s, iops=148 , runt= 60059msec
slat (usec): min=30 , max=383 , avg=43.27, stdev=16.68
clat (msec): min=2 , max=110 , avg=53.87, stdev=25.71
lat (msec): min=3 , max=110 , avg=53.92, stdev=25.70
bw (KB/s) : min=32116, max=159744, per=100.71%, avg=38248.58, stdev=16473.71
cpu : usr=0.21%, sys=0.86%, ctx=8957, majf=0, minf=535
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=99.9%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=8910/0/0, short=0/0/0
lat (msec): 4=0.01%, 10=17.32%, 20=7.97%, 100=73.98%, 250=0.72%
Run status group 0 (all jobs):
READ: io=2227.6MB, aggrb=37978KB/s, minb=38890KB/s, maxb=38890KB/s, mint=60059msec, maxt=60059msec
Disk stats (read/write):
xvdc: ios=53359/0, merge=0/0, ticks=2732728/0, in_queue=2734132, util=99.94%
#######
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio seqwrite-bw.cfg
seqwrite-bw-test: (g=0): rw=write, bs=256K-256K/256K-256K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [W] [100.0% done] [0K/37187K /s] [0 /141 iops] [eta 00m:00s]
seqwrite-bw-test: (groupid=0, jobs=1): err= 0: pid=1881
write: io=2233.3MB, bw=38081KB/s, iops=148 , runt= 60052msec
slat (usec): min=48 , max=51207 , avg=175.78, stdev=1745.54
clat (msec): min=4 , max=100 , avg=53.59, stdev=11.13
lat (msec): min=4 , max=100 , avg=53.77, stdev=11.01
bw (KB/s) : min=33597, max=145117, per=100.13%, avg=38129.80, stdev=14004.56
cpu : usr=0.35%, sys=1.85%, ctx=9021, majf=0, minf=21
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=99.9%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/8933/0, short=0/0/0
lat (msec): 10=0.17%, 20=6.44%, 50=0.82%, 100=92.57%, 250=0.01%
Run status group 0 (all jobs):
WRITE: io=2233.3MB, aggrb=38081KB/s, minb=38995KB/s, maxb=38995KB/s, mint=60052msec, maxt=60052msec
Disk stats (read/write):
xvdc: ios=0/53559, merge=0/11, ticks=0/2710436, in_queue=2711632, util=99.94%
####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio seqrw-bw.cfg
seqrw-bw-test: (g=0): rw=rw, bs=256K-256K/256K-256K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [M] [100.0% done] [36401K/14141K /s] [138 /53 iops] [eta 00m:00s]
seqrw-bw-test: (groupid=0, jobs=1): err= 0: pid=1886
read : io=2185.0MB, bw=37262KB/s, iops=145 , runt= 60046msec
slat (usec): min=28 , max=511 , avg=47.73, stdev=19.09
clat (msec): min=3 , max=117 , avg=37.88, stdev=30.92
lat (msec): min=3 , max=117 , avg=37.93, stdev=30.92
bw (KB/s) : min=31242, max=107174, per=100.38%, avg=37403.50, stdev=12257.43
write: io=949760KB, bw=15817KB/s, iops=61 , runt= 60046msec
slat (usec): min=45 , max=64506 , avg=135.54, stdev=1081.79
clat (msec): min=2 , max=142 , avg=39.95, stdev=31.31
lat (msec): min=4 , max=143 , avg=40.09, stdev=31.29
bw (KB/s) : min= 0, max=52224, per=99.00%, avg=15658.42, stdev=6195.59
cpu : usr=0.35%, sys=1.65%, ctx=11911, majf=0, minf=21
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=99.9%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=8740/3710/0, short=0/0/0
lat (msec): 4=0.06%, 10=31.23%, 20=21.98%, 50=0.80%, 100=45.22%
lat (msec): 250=0.71%
Run status group 0 (all jobs):
READ: io=2185.0MB, aggrb=37262KB/s, minb=38156KB/s, maxb=38156KB/s, mint=60046msec, maxt=60046msec
WRITE: io=949760KB, aggrb=15817KB/s, minb=16196KB/s, maxb=16196KB/s, mint=60046msec, maxt=60046msec
Disk stats (read/write):
xvdc: ios=52350/22250, merge=0/11, ticks=1841880/814584, in_queue=2658936, util=99.94%
###############################################
## Test 4: fsync Test
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio randomw-fsync.cfg
fsync-randw: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [w] [100.0% done] [0K/33651K /s] [0 /2053 iops] [eta 00m:00s]
fsync-randw: (groupid=0, jobs=1): err= 0: pid=1900
write: io=2034.2MB, bw=34715KB/s, iops=2169 , runt= 60002msec
slat (usec): min=18 , max=24186 , avg=25.93, stdev=71.10
clat (usec): min=195 , max=38965 , avg=3228.99, stdev=1568.62
lat (usec): min=227 , max=38988 , avg=3256.29, stdev=1567.98
bw (KB/s) : min=31367, max=43712, per=100.12%, avg=34755.79, stdev=3501.29
cpu : usr=1.17%, sys=11.91%, ctx=144895, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/130184/0, short=0/0/0
lat (usec): 250=11.35%, 500=0.93%, 750=0.19%, 1000=0.02%
lat (msec): 2=2.26%, 4=67.52%, 10=17.59%, 20=0.02%, 50=0.12%
Run status group 0 (all jobs):
WRITE: io=2034.2MB, aggrb=34714KB/s, minb=35547KB/s, maxb=35547KB/s, mint=60002msec, maxt=60002msec
Disk stats (read/write):
xvdc: ios=0/159321, merge=0/14585, ticks=0/166976, in_queue=166948, util=89.25%
####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio seqw-fsync.cfg
fsync-seqw: (g=0): rw=write, bs=256K-256K/256K-256K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [W] [21.5% done] [0K/37711K /s] [0 /143 iops] [eta 03m:43s]
fsync-seqw: (groupid=0, jobs=1): err= 0: pid=1913
write: io=2196.0MB, bw=37453KB/s, iops=146 , runt= 60041msec
slat (usec): min=200 , max=24420 , avg=295.96, stdev=280.02
clat (msec): min=1 , max=80 , avg=47.31, stdev=19.41
lat (msec): min=1 , max=81 , avg=47.61, stdev=19.40
bw (KB/s) : min= 379, max=108000, per=100.28%, avg=37556.14, stdev=11460.64
cpu : usr=1.16%, sys=6.10%, ctx=30891, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=99.9%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/8784/0, short=0/0/0
lat (msec): 2=7.18%, 4=5.31%, 20=6.08%, 50=0.44%, 100=80.99%
Run status group 0 (all jobs):
WRITE: io=2196.0MB, aggrb=37452KB/s, minb=38351KB/s, maxb=38351KB/s, mint=60041msec, maxt=60041msec
Disk stats (read/write):
xvdc: ios=0/53784, merge=0/1097, ticks=0/1309124, in_queue=1309572, util=94.12%
###############################################
### Test 5: Synchronous IO Test
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio randomw-SYNC.cfg
randomw-SYNC: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [w] [100.0% done] [0K/8265K /s] [0 /504 iops] [eta 00m:00s]
randomw-SYNC: (groupid=0, jobs=1): err= 0: pid=1917
write: io=455584KB, bw=7592.1KB/s, iops=474 , runt= 60001msec
slat (usec): min=701 , max=50831 , avg=2076.93, stdev=1667.45
clat (usec): min=10 , max=71531 , avg=14615.34, stdev=4717.67
lat (msec): min=2 , max=74 , avg=16.69, stdev= 5.11
bw (KB/s) : min= 27, max=11264, per=100.19%, avg=7606.05, stdev=1288.50
cpu : usr=0.06%, sys=4.91%, ctx=40481, majf=0, minf=19
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/28474/0, short=0/0/0
lat (usec): 20=0.01%
lat (msec): 4=0.01%, 10=12.09%, 20=76.81%, 50=10.91%, 100=0.19%
Run status group 0 (all jobs):
WRITE: io=455584KB, aggrb=7592KB/s, minb=7775KB/s, maxb=7775KB/s, mint=60001msec, maxt=60001msec
Disk stats (read/write):
xvdc: ios=0/51887, merge=0/11764, ticks=0/58488, in_queue=58488, util=97.82%
######
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio seqw-SYNC.cfg
seqw-SYNC: (g=0): rw=write, bs=256K-256K/256K-256K, ioengine=libaio, iodepth=8
fio 1.59
Starting 1 process
Jobs: 1 (f=1): [W] [100.0% done] [0K/35354K /s] [0 /134 iops] [eta 00m:00s]
seqw-SYNC: (groupid=0, jobs=1): err= 0: pid=1920
write: io=2118.8MB, bw=36159KB/s, iops=141 , runt= 60001msec
slat (msec): min=4 , max=56 , avg= 7.04, stdev= 2.05
clat (usec): min=10 , max=102291 , avg=49375.03, stdev=7116.31
lat (msec): min=7 , max=108 , avg=56.42, stdev= 7.93
bw (KB/s) : min=26112, max=52015, per=100.02%, avg=36165.45, stdev=4960.01
cpu : usr=0.67%, sys=5.49%, ctx=34671, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=99.9%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/8475/0, short=0/0/0
lat (usec): 20=0.01%
lat (msec): 10=0.01%, 20=0.01%, 50=23.93%, 100=76.00%, 250=0.04%
Run status group 0 (all jobs):
WRITE: io=2118.8MB, aggrb=36159KB/s, minb=37027KB/s, maxb=37027KB/s, mint=60001msec, maxt=60001msec
Disk stats (read/write):
xvdc: ios=0/67554, merge=0/8442, ticks=0/200572, in_queue=200588, util=95.43%
############################################
## Test 6:
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio mmap-rread-iops.cfg
mmap-rread-iops-single-file: (g=0): rw=randread, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
mmap-rread-iops-single-file: (g=0): rw=randread, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
Jobs: 8 (f=8): [rrrrrrrr] [100.0% done] [13388K/0K /s] [817 /0 iops] [eta 00m:00s]
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2709
read : io=94544KB, bw=1575.7KB/s, iops=98 , runt= 60005msec
clat (usec): min=24 , max=32945 , avg=10097.12, stdev=1914.77
lat (usec): min=25 , max=32946 , avg=10098.33, stdev=1914.74
bw (KB/s) : min= 918, max= 1756, per=12.52%, avg=1576.95, stdev=80.73
cpu : usr=0.59%, sys=11.22%, ctx=189430, majf=182980, minf=6195
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5909/0/0, short=0/0/0
lat (usec): 50=3.16%, 100=0.05%
lat (msec): 4=0.25%, 10=0.22%, 20=96.29%, 50=0.02%
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2710
read : io=94512KB, bw=1575.7KB/s, iops=98 , runt= 60005msec
clat (usec): min=23 , max=29562 , avg=10100.23, stdev=1904.98
lat (usec): min=24 , max=29564 , avg=10101.50, stdev=1904.95
bw (KB/s) : min= 885, max= 1784, per=12.52%, avg=1576.58, stdev=83.19
cpu : usr=0.59%, sys=11.21%, ctx=189434, majf=182986, minf=6191
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5907/0/0, short=0/0/0
lat (usec): 50=3.11%, 100=0.08%, 250=0.02%
lat (msec): 4=0.24%, 10=0.24%, 20=96.28%, 50=0.03%
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2711
read : io=94352KB, bw=1572.5KB/s, iops=98 , runt= 60004msec
clat (usec): min=23 , max=32152 , avg=10118.29, stdev=1851.03
lat (usec): min=24 , max=32154 , avg=10119.53, stdev=1851.04
bw (KB/s) : min= 943, max= 1724, per=12.50%, avg=1574.02, stdev=73.02
cpu : usr=0.59%, sys=11.21%, ctx=189442, majf=182996, minf=6189
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5897/0/0, short=0/0/0
lat (usec): 50=2.93%, 100=0.07%
lat (msec): 4=0.25%, 10=0.32%, 20=96.40%, 50=0.02%
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2712
read : io=94608KB, bw=1576.8KB/s, iops=98 , runt= 60004msec
clat (usec): min=23 , max=33231 , avg=10091.66, stdev=1927.83
lat (usec): min=24 , max=33232 , avg=10092.87, stdev=1927.83
bw (KB/s) : min= 952, max= 1788, per=12.53%, avg=1578.08, stdev=77.14
cpu : usr=0.59%, sys=11.20%, ctx=189450, majf=183007, minf=6187
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5913/0/0, short=0/0/0
lat (usec): 50=3.21%, 100=0.05%
lat (msec): 4=0.27%, 10=0.24%, 20=96.21%, 50=0.02%
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2713
read : io=94576KB, bw=1576.2KB/s, iops=98 , runt= 60003msec
clat (usec): min=22 , max=28684 , avg=10095.21, stdev=1908.66
lat (usec): min=23 , max=28685 , avg=10096.45, stdev=1908.65
bw (KB/s) : min= 946, max= 1724, per=12.52%, avg=1577.54, stdev=76.96
cpu : usr=0.59%, sys=11.19%, ctx=189460, majf=183018, minf=6185
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5911/0/0, short=0/0/0
lat (usec): 50=3.21%, 100=0.02%
lat (msec): 4=0.25%, 10=0.36%, 20=96.14%, 50=0.02%
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2714
read : io=94480KB, bw=1574.7KB/s, iops=98 , runt= 60001msec
clat (usec): min=24 , max=31931 , avg=10106.13, stdev=1881.82
lat (usec): min=25 , max=31932 , avg=10107.34, stdev=1881.82
bw (KB/s) : min= 976, max= 1752, per=12.51%, avg=1576.22, stdev=73.73
cpu : usr=0.59%, sys=11.19%, ctx=189464, majf=183024, minf=6183
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5905/0/0, short=0/0/0
lat (usec): 50=3.10%, 100=0.02%
lat (msec): 4=0.25%, 10=0.25%, 20=96.36%, 50=0.02%
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2715
read : io=94560KB, bw=1575.1KB/s, iops=98 , runt= 60002msec
clat (usec): min=23 , max=33513 , avg=10098.51, stdev=1909.44
lat (usec): min=24 , max=33514 , avg=10099.72, stdev=1909.44
bw (KB/s) : min= 986, max= 1724, per=12.52%, avg=1577.39, stdev=72.43
cpu : usr=0.59%, sys=11.18%, ctx=189477, majf=183040, minf=6181
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5910/0/0, short=0/0/0
lat (usec): 50=3.13%, 100=0.03%
lat (msec): 4=0.30%, 10=0.29%, 20=96.23%, 50=0.02%
mmap-rread-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2716
read : io=94208KB, bw=1570.2KB/s, iops=98 , runt= 60001msec
clat (usec): min=23 , max=26573 , avg=10136.93, stdev=1792.16
lat (usec): min=25 , max=26574 , avg=10138.17, stdev=1792.14
bw (KB/s) : min= 948, max= 1724, per=12.47%, avg=1570.13, stdev=72.61
cpu : usr=0.59%, sys=11.17%, ctx=189489, majf=183056, minf=6179
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5888/0/0, short=0/0/0
lat (usec): 50=2.77%, 100=0.02%
lat (msec): 2=0.07%, 4=0.25%, 10=0.25%, 20=96.62%, 50=0.02%
Run status group 0 (all jobs):
READ: io=755840KB, aggrb=12596KB/s, minb=1607KB/s, maxb=1614KB/s, mint=60001msec, maxt=60005msec
Disk stats (read/write):
xvdc: ios=182921/0, merge=0/0, ticks=475612/0, in_queue=475604, util=99.44%
###
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio mmap-rwrite-iops.cfg
mmap-rwrite-iops-single-file: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
mmap-rwrite-iops-single-file: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
fio: pid=2687, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
fio: pid=2688, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
fio: pid=2689, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
fio: pid=2690, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
fio: pid=2691, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
fio: pid=2692, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
fio: pid=2693, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
fio: pid=2694, err=13/file:fio.c:914, func=fopen iosched, error=Permission denied
Run status group 0 (all jobs):
Disk stats (read/write):
xvdc: ios=0/0, merge=0/0, ticks=0/0, in_queue=0, util=-nan%
####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio mmap-rw-iops.cfg
mmap-rw-iops-single-file: (g=0): rw=randrw, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
mmap-rw-iops-single-file: (g=0): rw=randrw, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
Jobs: 8 (f=8): [mmmmmmmm] [100.0% done] [9247K/4059K /s] [564 /247 iops] [eta 00m:00s]
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2698
read : io=62896KB, bw=1048.3KB/s, iops=65 , runt= 60001msec
clat (usec): min=21 , max=58172 , avg=10450.42, stdev=4071.25
lat (usec): min=23 , max=58173 , avg=10451.64, stdev=4071.26
bw (KB/s) : min= 117, max= 1312, per=12.44%, avg=1052.04, stdev=220.96
write: io=27664KB, bw=472124 B/s, iops=28 , runt= 60001msec
clat (usec): min=31 , max=58429 , avg=10700.66, stdev=5507.18
lat (usec): min=33 , max=58431 , avg=10702.56, stdev=5507.19
bw (KB/s) : min= 115, max= 704, per=12.86%, avg=464.78, stdev=114.22
cpu : usr=0.69%, sys=10.97%, ctx=182142, majf=175685, minf=5697
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3931/1729/0, short=0/0/0
lat (usec): 50=2.67%, 100=0.32%, 250=0.02%
lat (msec): 4=0.35%, 10=0.57%, 20=95.04%, 50=0.14%, 100=0.90%
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2699
read : io=63184KB, bw=1052.2KB/s, iops=65 , runt= 60005msec
clat (usec): min=23 , max=58150 , avg=10481.35, stdev=4607.90
lat (usec): min=24 , max=58151 , avg=10482.59, stdev=4607.95
bw (KB/s) : min= 153, max= 1373, per=12.46%, avg=1054.39, stdev=216.89
write: io=27440KB, bw=468270 B/s, iops=28 , runt= 60005msec
clat (usec): min=33 , max=60433 , avg=10607.06, stdev=4543.27
lat (usec): min=35 , max=60435 , avg=10608.93, stdev=4543.28
bw (KB/s) : min= 44, max= 702, per=12.80%, avg=462.59, stdev=123.55
cpu : usr=0.69%, sys=10.98%, ctx=182144, majf=175687, minf=5697
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3949/1715/0, short=0/0/0
lat (usec): 50=2.84%, 100=0.23%
lat (msec): 4=0.34%, 10=0.72%, 20=94.83%, 50=0.11%, 100=0.94%
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2700
read : io=63264KB, bw=1054.4KB/s, iops=65 , runt= 60001msec
clat (usec): min=22 , max=58814 , avg=10473.17, stdev=4171.08
lat (usec): min=23 , max=58815 , avg=10474.40, stdev=4171.09
bw (KB/s) : min= 88, max= 1341, per=12.51%, avg=1058.50, stdev=227.76
write: io=27120KB, bw=462840 B/s, iops=28 , runt= 60001msec
clat (usec): min=29 , max=58815 , avg=10715.95, stdev=5354.70
lat (usec): min=31 , max=58816 , avg=10717.80, stdev=5354.78
bw (KB/s) : min= 50, max= 750, per=12.58%, avg=454.79, stdev=127.05
cpu : usr=0.69%, sys=10.99%, ctx=182120, majf=175661, minf=5698
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3954/1695/0, short=0/0/0
lat (usec): 50=2.64%, 100=0.18%
lat (msec): 4=0.42%, 10=0.50%, 20=95.22%, 50=0.11%, 100=0.94%
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2701
read : io=63440KB, bw=1057.4KB/s, iops=66 , runt= 60001msec
clat (usec): min=23 , max=58793 , avg=10465.67, stdev=4432.22
lat (usec): min=24 , max=58794 , avg=10466.89, stdev=4432.25
bw (KB/s) : min= 119, max= 1312, per=12.56%, avg=1062.63, stdev=214.01
write: io=27296KB, bw=465843 B/s, iops=28 , runt= 60001msec
clat (usec): min=29 , max=87976 , avg=10594.76, stdev=5137.14
lat (usec): min=30 , max=87978 , avg=10596.61, stdev=5137.14
bw (KB/s) : min= 60, max= 766, per=12.64%, avg=456.95, stdev=121.54
cpu : usr=0.69%, sys=10.99%, ctx=182113, majf=175651, minf=5699
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3965/1706/0, short=0/0/0
lat (usec): 50=2.93%, 100=0.30%
lat (msec): 4=0.37%, 10=0.53%, 20=94.87%, 50=0.09%, 100=0.92%
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2702
read : io=63664KB, bw=1060.1KB/s, iops=66 , runt= 60006msec
clat (usec): min=22 , max=57837 , avg=10497.94, stdev=4589.51
lat (usec): min=23 , max=57838 , avg=10499.15, stdev=4589.52
bw (KB/s) : min= 162, max= 1341, per=12.62%, avg=1067.79, stdev=209.68
write: io=27040KB, bw=461436 B/s, iops=28 , runt= 60006msec
clat (usec): min=29 , max=57909 , avg=10533.30, stdev=4573.32
lat (usec): min=31 , max=57911 , avg=10535.20, stdev=4573.31
bw (KB/s) : min= 82, max= 718, per=12.55%, avg=453.73, stdev=123.50
cpu : usr=0.69%, sys=11.00%, ctx=182116, majf=175654, minf=5700
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3979/1690/0, short=0/0/0
lat (usec): 50=2.95%, 100=0.19%
lat (msec): 4=0.39%, 10=0.64%, 20=94.80%, 50=0.11%, 100=0.93%
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2703
read : io=63936KB, bw=1065.6KB/s, iops=66 , runt= 60005msec
clat (usec): min=24 , max=58543 , avg=10523.67, stdev=4468.09
lat (usec): min=25 , max=58544 , avg=10524.88, stdev=4468.09
bw (KB/s) : min= 136, max= 1437, per=12.64%, avg=1069.70, stdev=218.11
write: io=26608KB, bw=454072 B/s, iops=27 , runt= 60005msec
clat (usec): min=29 , max=74215 , avg=10532.44, stdev=4901.83
lat (usec): min=31 , max=74217 , avg=10534.31, stdev=4901.86
bw (KB/s) : min= 72, max= 718, per=12.40%, avg=448.21, stdev=112.91
cpu : usr=0.61%, sys=11.01%, ctx=182105, majf=175640, minf=5698
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3996/1663/0, short=0/0/0
lat (usec): 50=2.74%, 100=0.25%
lat (msec): 4=0.39%, 10=0.57%, 20=95.03%, 50=0.11%, 100=0.92%
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2704
read : io=64512KB, bw=1075.2KB/s, iops=67 , runt= 60001msec
clat (usec): min=23 , max=58184 , avg=10413.93, stdev=4230.33
lat (usec): min=25 , max=58185 , avg=10415.12, stdev=4230.34
bw (KB/s) : min= 136, max= 1469, per=12.77%, avg=1080.58, stdev=226.04
write: io=26192KB, bw=447002 B/s, iops=27 , runt= 60001msec
clat (usec): min=29 , max=58497 , avg=10749.99, stdev=5374.31
lat (usec): min=31 , max=58499 , avg=10751.84, stdev=5374.32
bw (KB/s) : min= 89, max= 702, per=12.11%, avg=437.60, stdev=118.16
cpu : usr=0.69%, sys=10.97%, ctx=182152, majf=175697, minf=5696
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=4032/1637/0, short=0/0/0
lat (usec): 50=2.88%, 100=0.23%
lat (msec): 4=0.37%, 10=0.64%, 20=94.87%, 50=0.12%, 100=0.90%
mmap-rw-iops-single-file: (groupid=0, jobs=1): err= 0: pid=2705
read : io=62800KB, bw=1046.7KB/s, iops=65 , runt= 60001msec
clat (usec): min=23 , max=58814 , avg=10458.22, stdev=4167.80
lat (usec): min=24 , max=58816 , avg=10459.43, stdev=4167.81
bw (KB/s) : min= 128, max= 1351, per=12.39%, avg=1047.92, stdev=229.90
write: io=27568KB, bw=470486 B/s, iops=28 , runt= 60001msec
clat (usec): min=30 , max=90354 , avg=10763.38, stdev=5528.00
lat (usec): min=32 , max=90356 , avg=10765.24, stdev=5528.02
bw (KB/s) : min= 118, max= 750, per=12.77%, avg=461.66, stdev=130.51
cpu : usr=0.69%, sys=10.96%, ctx=182163, majf=175712, minf=5695
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3925/1723/0, short=0/0/0
lat (usec): 50=2.55%, 100=0.14%
lat (msec): 2=0.05%, 4=0.44%, 10=0.60%, 20=95.18%, 50=0.11%
lat (msec): 100=0.92%
Run status group 0 (all jobs):
READ: io=507696KB, aggrb=8460KB/s, minb=1071KB/s, maxb=1100KB/s, mint=60001msec, maxt=60006msec
WRITE: io=216928KB, aggrb=3615KB/s, minb=447KB/s, maxb=472KB/s, mint=60001msec, maxt=60006msec
Disk stats (read/write):
xvdc: ios=175370/6978, merge=0/46, ticks=474328/391200, in_queue=865536, util=99.18%
###############################
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio multi-mmap-rread-iops.cfg
multi-mmap-rread-iops-sep-files: (g=0): rw=randread, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
multi-mmap-rread-iops-sep-files: (g=0): rw=randread, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rread-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 8 (f=8): [rrrrrrrr] [100.0% done] [12553K/0K /s] [766 /0 iops] [eta 00m:00s]
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2722
read : io=91984KB, bw=1532.1KB/s, iops=95 , runt= 60007msec
clat (usec): min=2123 , max=38364 , avg=10431.55, stdev=813.90
lat (usec): min=2124 , max=38365 , avg=10432.77, stdev=813.89
bw (KB/s) : min= 1529, max= 1823, per=12.52%, avg=1534.39, stdev=26.74
cpu : usr=0.49%, sys=9.65%, ctx=190337, majf=183911, minf=286
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5749/0/0, short=0/0/0
lat (msec): 4=0.42%, 10=0.26%, 20=99.25%, 50=0.07%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2723
read : io=91952KB, bw=1532.4KB/s, iops=95 , runt= 60006msec
clat (usec): min=2184 , max=42378 , avg=10435.22, stdev=787.94
lat (usec): min=2186 , max=42379 , avg=10436.43, stdev=787.93
bw (KB/s) : min= 1520, max= 1830, per=12.51%, avg=1533.76, stdev=27.46
cpu : usr=0.49%, sys=9.65%, ctx=190335, majf=183909, minf=281
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5747/0/0, short=0/0/0
lat (msec): 4=0.37%, 10=0.24%, 20=99.32%, 50=0.07%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2724
read : io=91952KB, bw=1532.5KB/s, iops=95 , runt= 60003msec
clat (usec): min=2258 , max=43205 , avg=10434.45, stdev=834.85
lat (usec): min=2259 , max=43206 , avg=10435.68, stdev=834.85
bw (KB/s) : min= 1526, max= 1826, per=12.51%, avg=1534.10, stdev=27.01
cpu : usr=0.49%, sys=9.65%, ctx=190327, majf=183898, minf=279
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5747/0/0, short=0/0/0
lat (msec): 4=0.40%, 10=0.21%, 20=99.32%, 50=0.07%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2725
read : io=91968KB, bw=1532.7KB/s, iops=95 , runt= 60005msec
clat (usec): min=2154 , max=44148 , avg=10433.08, stdev=835.04
lat (usec): min=2155 , max=44150 , avg=10434.30, stdev=835.03
bw (KB/s) : min= 1526, max= 1833, per=12.51%, avg=1534.21, stdev=27.66
cpu : usr=0.49%, sys=9.65%, ctx=190332, majf=183907, minf=277
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5748/0/0, short=0/0/0
lat (msec): 4=0.38%, 10=0.28%, 20=99.27%, 50=0.07%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2726
read : io=91968KB, bw=1532.8KB/s, iops=95 , runt= 60004msec
clat (usec): min=2229 , max=46163 , avg=10433.03, stdev=846.43
lat (usec): min=2231 , max=46164 , avg=10434.24, stdev=846.42
bw (KB/s) : min= 1529, max= 1833, per=12.51%, avg=1534.19, stdev=27.65
cpu : usr=0.49%, sys=9.65%, ctx=190329, majf=183903, minf=275
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5748/0/0, short=0/0/0
lat (msec): 4=0.40%, 10=0.26%, 20=99.27%, 50=0.07%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2727
read : io=91936KB, bw=1532.3KB/s, iops=95 , runt= 60001msec
clat (usec): min=2145 , max=40753 , avg=10435.82, stdev=766.86
lat (usec): min=2146 , max=40754 , avg=10437.06, stdev=766.84
bw (KB/s) : min= 1517, max= 1837, per=12.51%, avg=1533.88, stdev=28.10
cpu : usr=0.49%, sys=9.65%, ctx=190319, majf=183893, minf=271
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5746/0/0, short=0/0/0
lat (msec): 4=0.38%, 10=0.12%, 20=99.43%, 50=0.07%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2728
read : io=91952KB, bw=1532.4KB/s, iops=95 , runt= 60006msec
clat (usec): min=2266 , max=39839 , avg=10435.08, stdev=777.63
lat (usec): min=2267 , max=39840 , avg=10436.29, stdev=777.62
bw (KB/s) : min= 1520, max= 1826, per=12.51%, avg=1533.94, stdev=27.05
cpu : usr=0.49%, sys=9.65%, ctx=190325, majf=183912, minf=270
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5747/0/0, short=0/0/0
lat (msec): 4=0.38%, 10=0.21%, 20=99.34%, 50=0.07%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2729
read : io=91936KB, bw=1532.2KB/s, iops=95 , runt= 60004msec
clat (usec): min=2273 , max=41222 , avg=10436.64, stdev=772.24
lat (usec): min=2274 , max=41223 , avg=10437.89, stdev=772.21
bw (KB/s) : min= 1520, max= 1820, per=12.51%, avg=1533.53, stdev=26.56
cpu : usr=0.49%, sys=9.65%, ctx=190315, majf=183901, minf=266
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=5746/0/0, short=0/0/0
lat (msec): 4=0.38%, 10=0.16%, 20=99.39%, 50=0.07%
Run status group 0 (all jobs):
READ: io=735648KB, aggrb=12259KB/s, minb=1568KB/s, maxb=1569KB/s, mint=60001msec, maxt=60007msec
Disk stats (read/write):
xvdc: ios=183264/7, merge=0/10, ticks=476704/16, in_queue=476740, util=99.96%
#########
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio multi-mmap-rwrite-iops.cfg
multi-mmap-rread-iops-sep-files: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
multi-mmap-rread-iops-sep-files: (g=0): rw=randwrite, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
Jobs: 8 (f=8): [wwwwwwww] [100.0% done] [0K/12357K /s] [0 /754 iops] [eta 00m:00s]
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2743
write: io=77056KB, bw=1284.2KB/s, iops=80 , runt= 60005msec
clat (msec): min=2 , max=501 , avg=12.39, stdev=12.40
lat (msec): min=2 , max=501 , avg=12.39, stdev=12.40
bw (KB/s) : min= 78, max= 1536, per=12.50%, avg=1291.60, stdev=392.99
cpu : usr=0.89%, sys=10.03%, ctx=161856, majf=154952, minf=286
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4816/0, short=0/0/0
lat (msec): 4=0.31%, 10=0.77%, 20=94.41%, 50=0.87%, 100=3.57%
lat (msec): 500=0.04%, 750=0.02%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2744
write: io=77328KB, bw=1288.8KB/s, iops=80 , runt= 60003msec
clat (msec): min=1 , max=495 , avg=12.35, stdev=12.41
lat (msec): min=1 , max=495 , avg=12.35, stdev=12.41
bw (KB/s) : min= 165, max= 1540, per=12.65%, avg=1307.05, stdev=389.77
cpu : usr=0.89%, sys=10.02%, ctx=161869, majf=154966, minf=280
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4833/0, short=0/0/0
lat (msec): 2=0.02%, 4=0.52%, 10=0.95%, 20=93.98%, 50=0.87%
lat (msec): 100=3.60%, 500=0.06%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2745
write: io=77744KB, bw=1295.8KB/s, iops=80 , runt= 60002msec
clat (msec): min=1 , max=499 , avg=12.30, stdev=12.60
lat (msec): min=1 , max=499 , avg=12.30, stdev=12.60
bw (KB/s) : min= 164, max= 1584, per=12.71%, avg=1313.85, stdev=389.24
cpu : usr=0.89%, sys=10.01%, ctx=161891, majf=154989, minf=275
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4859/0, short=0/0/0
lat (msec): 2=0.23%, 4=0.72%, 10=1.17%, 20=93.39%, 50=0.99%
lat (msec): 100=3.44%, 500=0.06%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2746
write: io=77248KB, bw=1287.5KB/s, iops=80 , runt= 60002msec
clat (msec): min=2 , max=488 , avg=12.36, stdev=12.35
lat (msec): min=2 , max=488 , avg=12.36, stdev=12.35
bw (KB/s) : min= 158, max= 1536, per=12.61%, avg=1303.55, stdev=393.27
cpu : usr=0.89%, sys=10.01%, ctx=161908, majf=155009, minf=270
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4828/0, short=0/0/0
lat (msec): 4=0.46%, 10=0.83%, 20=94.18%, 50=0.93%, 100=3.54%
lat (msec): 500=0.06%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2747
write: io=77776KB, bw=1296.2KB/s, iops=81 , runt= 60005msec
clat (msec): min=1 , max=501 , avg=12.30, stdev=12.46
lat (msec): min=1 , max=501 , avg=12.30, stdev=12.46
bw (KB/s) : min= 156, max= 1590, per=12.69%, avg=1311.17, stdev=383.86
cpu : usr=0.89%, sys=10.01%, ctx=161918, majf=155021, minf=265
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4861/0, short=0/0/0
lat (msec): 2=0.25%, 4=0.72%, 10=1.03%, 20=93.52%, 50=0.95%
lat (msec): 100=3.48%, 500=0.04%, 750=0.02%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2748
write: io=77808KB, bw=1296.8KB/s, iops=81 , runt= 60004msec
clat (msec): min=1 , max=501 , avg=12.29, stdev=12.45
lat (msec): min=1 , max=501 , avg=12.29, stdev=12.45
bw (KB/s) : min= 156, max= 1606, per=12.71%, avg=1313.36, stdev=387.14
cpu : usr=0.89%, sys=10.01%, ctx=161929, majf=155033, minf=260
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4863/0, short=0/0/0
lat (msec): 2=0.25%, 4=0.74%, 10=1.11%, 20=93.32%, 50=1.03%
lat (msec): 100=3.50%, 500=0.04%, 750=0.02%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2749
write: io=77440KB, bw=1290.7KB/s, iops=80 , runt= 60002msec
clat (msec): min=2 , max=500 , avg=12.34, stdev=12.50
lat (msec): min=2 , max=500 , avg=12.34, stdev=12.50
bw (KB/s) : min= 157, max= 1593, per=12.66%, avg=1308.15, stdev=388.41
cpu : usr=0.89%, sys=10.01%, ctx=161932, majf=155038, minf=255
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4840/0, short=0/0/0
lat (msec): 4=0.64%, 10=0.97%, 20=93.95%, 50=0.87%, 100=3.51%
lat (msec): 500=0.04%, 750=0.02%
multi-mmap-rread-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2750
write: io=77856KB, bw=1297.5KB/s, iops=81 , runt= 60006msec
clat (msec): min=1 , max=501 , avg=12.29, stdev=12.61
lat (msec): min=1 , max=501 , avg=12.29, stdev=12.61
bw (KB/s) : min= 96, max= 1603, per=12.67%, avg=1309.16, stdev=383.63
cpu : usr=0.89%, sys=9.99%, ctx=161952, majf=155064, minf=250
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/4866/0, short=0/0/0
lat (msec): 2=0.33%, 4=0.78%, 10=1.17%, 20=93.26%, 50=1.05%
lat (msec): 100=3.35%, 500=0.04%, 750=0.02%
Run status group 0 (all jobs):
WRITE: io=620256KB, aggrb=10336KB/s, minb=1314KB/s, maxb=1328KB/s, mint=60002msec, maxt=60006msec
Disk stats (read/write):
xvdc: ios=154863/28299, merge=0/175, ticks=466748/1483352, in_queue=1950104, util=99.60%
##############
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio multi-mmap-rw-iops.cfg
multi-mmap-rw-iops-sep-files: (g=0): rw=randrw, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
multi-mmap-rw-iops-sep-files: (g=0): rw=randrw, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-rw-iops-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 2 (f=2): [__mE__m_] [16.9% done] [355K/88K /s] [21 /5 iops] [eta 04m:59s]
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2838
read : io=61008KB, bw=1016.4KB/s, iops=63 , runt= 60029msec
clat (msec): min=2 , max=57 , avg=10.96, stdev= 4.86
lat (msec): min=2 , max=57 , avg=10.96, stdev= 4.86
bw (KB/s) : min= 187, max= 1341, per=12.78%, avg=1026.76, stdev=192.35
write: io=26736KB, bw=456073 B/s, iops=27 , runt= 60029msec
clat (msec): min=2 , max=93 , avg=10.90, stdev= 4.70
lat (msec): min=2 , max=93 , avg=10.90, stdev= 4.70
bw (KB/s) : min= 55, max= 697, per=12.88%, avg=451.27, stdev=124.11
cpu : usr=0.44%, sys=10.21%, ctx=182018, majf=175433, minf=288
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3813/1671/0, short=0/0/0
lat (msec): 4=0.62%, 10=1.75%, 20=96.28%, 50=0.24%, 100=1.11%
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2839
read : io=61776KB, bw=1029.5KB/s, iops=64 , runt= 60008msec
clat (msec): min=2 , max=55 , avg=10.89, stdev= 4.44
lat (msec): min=2 , max=55 , avg=10.89, stdev= 4.44
bw (KB/s) : min= 213, max= 1373, per=12.86%, avg=1033.56, stdev=210.90
write: io=25952KB, bw=442855 B/s, iops=27 , runt= 60008msec
clat (msec): min=1 , max=68 , avg=11.05, stdev= 5.32
lat (msec): min=1 , max=68 , avg=11.05, stdev= 5.32
bw (KB/s) : min= 83, max= 670, per=12.46%, avg=436.58, stdev=115.14
cpu : usr=0.44%, sys=10.21%, ctx=182006, majf=175425, minf=278
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3861/1622/0, short=0/0/0
lat (msec): 2=0.02%, 4=0.60%, 10=1.73%, 20=96.28%, 50=0.27%
lat (msec): 100=1.09%
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2840
read : io=61472KB, bw=1010.2KB/s, iops=63 , runt= 60804msec
clat (msec): min=2 , max=816 , avg=11.19, stdev=13.86
lat (msec): min=2 , max=816 , avg=11.19, stdev=13.86
bw (KB/s) : min= 84, max= 1277, per=12.77%, avg=1025.68, stdev=210.95
write: io=26224KB, bw=441638 B/s, iops=26 , runt= 60804msec
clat (msec): min=2 , max=102 , avg=10.85, stdev= 4.67
lat (msec): min=2 , max=102 , avg=10.85, stdev= 4.67
bw (KB/s) : min= 61, max= 781, per=12.69%, avg=444.41, stdev=124.88
cpu : usr=0.43%, sys=10.09%, ctx=182100, majf=175439, minf=276
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3842/1639/0, short=0/0/0
lat (msec): 4=0.60%, 10=1.55%, 20=96.46%, 50=0.31%, 100=1.04%
lat (msec): 250=0.02%, 1000=0.02%
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2841
read : io=60304KB, bw=991.82KB/s, iops=61 , runt= 60803msec
clat (msec): min=2 , max=815 , avg=11.14, stdev=13.90
lat (msec): min=2 , max=815 , avg=11.14, stdev=13.90
bw (KB/s) : min= 32, max= 1301, per=12.46%, avg=1001.54, stdev=218.24
write: io=27408KB, bw=461585 B/s, iops=28 , runt= 60803msec
clat (msec): min=2 , max=64 , avg=10.96, stdev= 4.89
lat (msec): min=2 , max=64 , avg=10.96, stdev= 4.89
bw (KB/s) : min= 81, max= 812, per=13.15%, avg=460.82, stdev=123.68
cpu : usr=0.43%, sys=10.09%, ctx=182087, majf=175437, minf=270
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3769/1713/0, short=0/0/0
lat (msec): 4=0.60%, 10=1.70%, 20=96.32%, 50=0.31%, 100=1.06%
lat (msec): 1000=0.02%
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2842
read : io=61232KB, bw=1020.2KB/s, iops=63 , runt= 60021msec
clat (msec): min=2 , max=55 , avg=10.94, stdev= 4.64
lat (msec): min=2 , max=55 , avg=10.94, stdev= 4.64
bw (KB/s) : min= 121, max= 1343, per=12.75%, avg=1024.83, stdev=207.81
write: io=26464KB, bw=451494 B/s, iops=27 , runt= 60021msec
clat (msec): min=2 , max=55 , avg=10.95, stdev= 4.84
lat (msec): min=2 , max=55 , avg=10.95, stdev= 4.84
bw (KB/s) : min= 83, max= 781, per=12.77%, avg=447.49, stdev=118.67
cpu : usr=0.44%, sys=10.21%, ctx=181990, majf=175424, minf=265
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3827/1654/0, short=0/0/0
lat (msec): 4=0.58%, 10=1.64%, 20=96.39%, 50=0.31%, 100=1.08%
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2843
read : io=61360KB, bw=1022.4KB/s, iops=63 , runt= 60021msec
clat (msec): min=2 , max=55 , avg=10.89, stdev= 4.49
lat (msec): min=2 , max=55 , avg=10.89, stdev= 4.49
bw (KB/s) : min= 183, max= 1293, per=12.76%, avg=1024.97, stdev=216.75
write: io=26400KB, bw=450402 B/s, iops=27 , runt= 60021msec
clat (msec): min=2 , max=55 , avg=11.04, stdev= 5.15
lat (msec): min=2 , max=55 , avg=11.04, stdev= 5.15
bw (KB/s) : min= 55, max= 781, per=12.66%, avg=443.54, stdev=121.90
cpu : usr=0.44%, sys=10.21%, ctx=181983, majf=175423, minf=260
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3835/1650/0, short=0/0/0
lat (msec): 4=0.64%, 10=1.79%, 20=96.19%, 50=0.29%, 100=1.09%
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2844
read : io=60608KB, bw=996.58KB/s, iops=62 , runt= 60817msec
clat (msec): min=2 , max=55 , avg=11.00, stdev= 4.95
lat (msec): min=2 , max=55 , avg=11.00, stdev= 4.95
bw (KB/s) : min= 212, max= 1341, per=12.62%, avg=1013.66, stdev=205.86
write: io=27152KB, bw=457169 B/s, iops=27 , runt= 60817msec
clat (msec): min=2 , max=824 , avg=11.26, stdev=20.17
lat (msec): min=2 , max=824 , avg=11.26, stdev=20.17
bw (KB/s) : min= 25, max= 798, per=13.02%, avg=455.98, stdev=133.85
cpu : usr=0.43%, sys=10.08%, ctx=182069, majf=175428, minf=255
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3788/1697/0, short=0/0/0
lat (msec): 4=0.58%, 10=1.86%, 20=96.17%, 50=0.29%, 100=1.08%
lat (msec): 1000=0.02%
multi-mmap-rw-iops-sep-files: (groupid=0, jobs=1): err= 0: pid=2845
read : io=60944KB, bw=1015.2KB/s, iops=63 , runt= 60032msec
clat (msec): min=2 , max=57 , avg=10.97, stdev= 4.79
lat (msec): min=2 , max=57 , avg=10.97, stdev= 4.79
bw (KB/s) : min= 213, max= 1309, per=12.69%, avg=1019.47, stdev=208.31
write: io=26720KB, bw=455778 B/s, iops=27 , runt= 60032msec
clat (msec): min=2 , max=62 , avg=10.91, stdev= 4.62
lat (msec): min=2 , max=62 , avg=10.91, stdev= 4.62
bw (KB/s) : min= 46, max= 725, per=12.88%, avg=451.12, stdev=121.04
cpu : usr=0.44%, sys=10.21%, ctx=181969, majf=175419, minf=249
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=3809/1670/0, short=0/0/0
lat (msec): 4=0.55%, 10=1.72%, 20=96.37%, 50=0.27%, 100=1.10%
Run status group 0 (all jobs):
READ: io=488704KB, aggrb=8035KB/s, minb=1015KB/s, maxb=1054KB/s, mint=60008msec, maxt=60817msec
WRITE: io=213056KB, aggrb=3503KB/s, minb=441KB/s, maxb=461KB/s, mint=60008msec, maxt=60817msec
Disk stats (read/write):
xvdc: ios=175439/10926, merge=0/65, ticks=478216/592284, in_queue=1073784, util=99.89%
###### Multiple Threads - Single File
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio mmap-seqread-bw.cfg
multi-mmap-seqread-sep-file: (g=0): rw=read, bs=256K-256K/256K-256K, ioengine=mmap, iodepth=1
...
multi-mmap-seqread-sep-file: (g=0): rw=read, bs=256K-256K/256K-256K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 8 (f=8): [RRRRRRRR] [100.0% done] [23569K/0K /s] [89 /0 iops] [eta 00m:00s]
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2878
read : io=168704KB, bw=2806.4KB/s, iops=10 , runt= 60116msec
clat (usec): min=343 , max=187685 , avg=91210.91, stdev=90562.09
lat (usec): min=344 , max=187686 , avg=91212.34, stdev=90562.10
bw (KB/s) : min= 2777, max= 2865, per=12.53%, avg=2809.93, stdev=11.36
cpu : usr=1.85%, sys=9.18%, ctx=178093, majf=168791, minf=169092
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=659/0/0, short=0/0/0
lat (usec): 500=5.31%, 750=40.52%, 1000=3.95%
lat (msec): 10=0.15%, 100=0.15%, 250=49.92%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2879
read : io=168704KB, bw=2805.9KB/s, iops=10 , runt= 60127msec
clat (usec): min=353 , max=188632 , avg=91229.32, stdev=90575.16
lat (usec): min=354 , max=188633 , avg=91230.67, stdev=90575.03
bw (KB/s) : min= 2757, max= 2849, per=12.52%, avg=2808.20, stdev=11.43
cpu : usr=1.85%, sys=9.18%, ctx=178122, majf=168823, minf=169087
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=659/0/0, short=0/0/0
lat (usec): 500=1.82%, 750=42.19%, 1000=5.77%
lat (msec): 10=0.15%, 100=0.15%, 250=49.92%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2880
read : io=168704KB, bw=2805.7KB/s, iops=10 , runt= 60131msec
clat (usec): min=387 , max=190269 , avg=91236.37, stdev=90615.62
lat (usec): min=388 , max=190270 , avg=91237.69, stdev=90615.55
bw (KB/s) : min= 2767, max= 2849, per=12.52%, avg=2807.25, stdev= 9.88
cpu : usr=1.85%, sys=9.18%, ctx=178128, majf=168832, minf=169085
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=659/0/0, short=0/0/0
lat (usec): 500=3.03%, 750=42.64%, 1000=4.25%
lat (msec): 100=0.15%, 250=49.92%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2881
read : io=168704KB, bw=2806.4KB/s, iops=10 , runt= 60116msec
clat (usec): min=354 , max=188984 , avg=91213.64, stdev=90581.77
lat (usec): min=355 , max=188985 , avg=91214.98, stdev=90581.77
bw (KB/s) : min= 2752, max= 2881, per=12.53%, avg=2809.59, stdev=16.24
cpu : usr=1.85%, sys=9.18%, ctx=178090, majf=168792, minf=169083
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=659/0/0, short=0/0/0
lat (usec): 500=4.40%, 750=38.69%, 1000=6.68%
lat (msec): 4=0.15%, 100=0.15%, 250=49.92%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2882
read : io=168704KB, bw=2806.5KB/s, iops=10 , runt= 60114msec
clat (usec): min=350 , max=192696 , avg=91211.32, stdev=90567.85
lat (usec): min=351 , max=192697 , avg=91212.75, stdev=90567.90
bw (KB/s) : min= 2777, max= 2881, per=12.53%, avg=2809.61, stdev=13.04
cpu : usr=1.85%, sys=9.18%, ctx=178089, majf=168790, minf=169079
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=659/0/0, short=0/0/0
lat (usec): 500=2.88%, 750=40.67%, 1000=5.77%
lat (msec): 2=0.61%, 100=0.15%, 250=49.92%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2883
read : io=168704KB, bw=2806.3KB/s, iops=10 , runt= 60118msec
clat (usec): min=348 , max=187692 , avg=91217.02, stdev=90597.57
lat (usec): min=349 , max=187694 , avg=91218.29, stdev=90597.58
bw (KB/s) : min= 2767, max= 2881, per=12.53%, avg=2809.36, stdev=14.22
cpu : usr=1.85%, sys=9.18%, ctx=178092, majf=168797, minf=169079
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=659/0/0, short=0/0/0
lat (usec): 500=5.46%, 750=40.06%, 1000=3.95%
lat (msec): 2=0.30%, 10=0.15%, 100=0.15%, 250=49.92%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2884
read : io=168192KB, bw=2797.9KB/s, iops=10 , runt= 60116msec
clat (usec): min=384 , max=209970 , avg=91489.86, stdev=90810.61
lat (usec): min=386 , max=209971 , avg=91491.44, stdev=90810.44
bw (KB/s) : min= 2657, max= 2959, per=12.49%, avg=2801.07, stdev=22.62
cpu : usr=1.85%, sys=9.18%, ctx=178085, majf=168796, minf=169076
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=657/0/0, short=0/0/0
lat (usec): 500=1.07%, 750=43.99%, 1000=4.57%
lat (msec): 2=0.15%, 10=0.15%, 100=0.15%, 250=49.92%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2885
read : io=168192KB, bw=2797.3KB/s, iops=10 , runt= 60127msec
clat (usec): min=370 , max=190370 , avg=91508.88, stdev=90839.38
lat (usec): min=372 , max=190371 , avg=91510.20, stdev=90839.32
bw (KB/s) : min= 2733, max= 2813, per=12.48%, avg=2799.00, stdev=15.76
cpu : usr=1.85%, sys=9.18%, ctx=178114, majf=168829, minf=169074
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=657/0/0, short=0/0/0
lat (usec): 500=1.98%, 750=43.68%, 1000=4.26%
lat (msec): 250=50.08%
Run status group 0 (all jobs):
READ: io=1317.0MB, aggrb=22427KB/s, minb=2864KB/s, maxb=2873KB/s, mint=60114msec, maxt=60131msec
Disk stats (read/write):
xvdc: ios=184072/8, merge=0/9, ticks=546612/32, in_queue=546772, util=99.96%
#####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio mmap-seqwrite-bw.cfg
multi-mmap-seqwrite-sep-files: (g=0): rw=write, bs=256K-256K/256K-256K, ioengine=mmap, iodepth=1
...
multi-mmap-seqwrite-sep-files: (g=0): rw=write, bs=256K-256K/256K-256K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqwrite-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 8 (f=8): [WWWWWWWW] [100.0% done] [0K/34695K /s] [0 /132 iops] [eta 00m:00s]
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2920
write: io=328704KB, bw=5473.9KB/s, iops=21 , runt= 60050msec
clat (usec): min=502 , max=385665 , avg=46722.01, stdev=39102.82
lat (usec): min=522 , max=385682 , avg=46758.33, stdev=39103.35
bw (KB/s) : min= 2352, max=22412, per=15.15%, avg=5530.83, stdev=2401.62
cpu : usr=1.83%, sys=8.51%, ctx=32283, majf=1206, minf=548748
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/1284/0, short=0/0/0
lat (usec): 750=5.92%, 1000=1.25%
lat (msec): 2=4.83%, 4=0.78%, 10=2.88%, 20=5.92%, 50=40.81%
lat (msec): 100=31.15%, 250=5.92%, 500=0.55%
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2921
write: io=316672KB, bw=5274.9KB/s, iops=20 , runt= 60034msec
clat (usec): min=505 , max=391478 , avg=48486.90, stdev=41558.49
lat (usec): min=524 , max=391495 , avg=48523.15, stdev=41557.95
bw (KB/s) : min= 2963, max=23272, per=14.58%, avg=5323.13, stdev=2569.53
cpu : usr=1.83%, sys=8.51%, ctx=32278, majf=1204, minf=548563
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/1237/0, short=0/0/0
lat (usec): 750=5.42%, 1000=1.37%
lat (msec): 2=4.61%, 4=1.62%, 10=2.83%, 20=6.14%, 50=39.45%
lat (msec): 100=30.23%, 250=7.92%, 500=0.40%
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2922
write: io=287232KB, bw=4785.3KB/s, iops=18 , runt= 60025msec
clat (usec): min=503 , max=465453 , avg=53456.34, stdev=44674.49
lat (usec): min=524 , max=465468 , avg=53488.12, stdev=44667.85
bw (KB/s) : min= 2574, max=21169, per=13.27%, avg=4843.71, stdev=2327.01
cpu : usr=1.83%, sys=8.50%, ctx=32273, majf=1203, minf=548444
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/1122/0, short=0/0/0
lat (usec): 750=5.61%, 1000=0.89%
lat (msec): 2=4.19%, 4=1.34%, 10=1.96%, 20=4.19%, 50=39.48%
lat (msec): 100=30.12%, 250=11.68%, 500=0.53%
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2923
write: io=300544KB, bw=5006.2KB/s, iops=19 , runt= 60025msec
clat (usec): min=511 , max=474993 , avg=51093.42, stdev=44595.33
lat (usec): min=535 , max=475008 , avg=51120.00, stdev=44593.94
bw (KB/s) : min= 2148, max=21984, per=13.88%, avg=5067.28, stdev=2408.45
cpu : usr=1.83%, sys=8.50%, ctx=32274, majf=1204, minf=548414
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/1174/0, short=0/0/0
lat (usec): 750=5.62%, 1000=1.53%
lat (msec): 2=5.54%, 4=0.17%, 10=1.79%, 20=5.20%, 50=41.57%
lat (msec): 100=27.26%, 250=10.73%, 500=0.60%
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2924
write: io=318976KB, bw=5312.8KB/s, iops=20 , runt= 60040msec
clat (usec): min=506 , max=403743 , avg=48149.61, stdev=39142.52
lat (usec): min=527 , max=403780 , avg=48178.30, stdev=39140.25
bw (KB/s) : min= 2306, max=23040, per=14.69%, avg=5360.21, stdev=2460.50
cpu : usr=1.83%, sys=8.50%, ctx=32277, majf=1205, minf=548423
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/1246/0, short=0/0/0
lat (usec): 750=5.14%, 1000=1.12%
lat (msec): 2=3.61%, 4=0.56%, 10=3.21%, 20=5.70%, 50=41.49%
lat (msec): 100=32.42%, 250=6.26%, 500=0.48%
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2925
write: io=319232KB, bw=5315.3KB/s, iops=20 , runt= 60060msec
clat (usec): min=508 , max=402546 , avg=48125.59, stdev=40097.34
lat (usec): min=524 , max=402561 , avg=48156.68, stdev=40101.07
bw (KB/s) : min= 2936, max=21884, per=14.69%, avg=5363.19, stdev=2373.42
cpu : usr=1.83%, sys=8.50%, ctx=32288, majf=1207, minf=548524
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/1247/0, short=0/0/0
lat (usec): 750=5.29%, 1000=1.60%
lat (msec): 2=4.97%, 4=0.96%, 10=2.41%, 20=6.01%, 50=39.53%
lat (msec): 100=32.32%, 250=6.42%, 500=0.48%
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2926
write: io=316928KB, bw=5277.2KB/s, iops=20 , runt= 60057msec
clat (usec): min=506 , max=380581 , avg=48465.17, stdev=41057.46
lat (usec): min=526 , max=380595 , avg=48499.19, stdev=41052.43
bw (KB/s) : min= 2453, max=21841, per=14.56%, avg=5314.34, stdev=2355.79
cpu : usr=1.83%, sys=8.50%, ctx=32276, majf=1206, minf=548374
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/1238/0, short=0/0/0
lat (usec): 750=4.85%, 1000=1.62%
lat (msec): 2=4.85%, 4=1.05%, 10=3.63%, 20=5.09%, 50=40.63%
lat (msec): 100=30.37%, 250=7.35%, 500=0.57%
multi-mmap-seqwrite-sep-files: (groupid=0, jobs=1): err= 0: pid=2927
write: io=9472.0KB, bw=161078 B/s, iops=0 , runt= 60215msec
clat (usec): min=504 , max=5296.1K, avg=1627351.22, stdev=1682667.02
lat (usec): min=579 , max=5297.2K, avg=1627408.16, stdev=1682636.62
bw (KB/s) : min= 96, max= 252, per=0.45%, avg=165.00, stdev=43.21
cpu : usr=1.83%, sys=8.48%, ctx=32303, majf=1222, minf=548360
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/37/0, short=0/0/0
lat (usec): 750=10.81%
lat (msec): 10=2.70%, 20=5.41%, 50=27.03%, 100=2.70%, 2000=2.70%
lat (msec): >=2000=48.65%
Run status group 0 (all jobs):
WRITE: io=2146.3MB, aggrb=36498KB/s, minb=161KB/s, maxb=5605KB/s, mint=60025msec, maxt=60215msec
Disk stats (read/write):
xvdc: ios=52657/44026, merge=0/32, ticks=3122808/8629076, in_queue=11754780, util=100.00%
#####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio mmap-seqrw-bw.cfg
multi-mmap-seqread-sep-file: (g=0): rw=rw, bs=256K-256K/256K-256K, ioengine=mmap, iodepth=1
...
multi-mmap-seqread-sep-file: (g=0): rw=rw, bs=256K-256K/256K-256K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-sep-file: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 8 (f=8): [MMMMMMMM] [100.0% done] [26973K/9689K /s] [102 /36 iops] [eta 00m:00s]
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2972
read : io=216576KB, bw=3605.5KB/s, iops=14 , runt= 60069msec
clat (usec): min=371 , max=248576 , avg=49756.94, stdev=37614.59
lat (usec): min=372 , max=248577 , avg=49758.38, stdev=37614.66
bw (KB/s) : min= 2229, max=20317, per=13.80%, avg=3653.16, stdev=2349.60
write: io=87040KB, bw=1449.0KB/s, iops=5 , runt= 60069msec
clat (usec): min=518 , max=322196 , avg=52810.10, stdev=42556.48
lat (usec): min=534 , max=322212 , avg=52826.98, stdev=42556.33
bw (KB/s) : min= 292, max= 7968, per=14.01%, avg=1540.87, stdev=1124.70
cpu : usr=3.30%, sys=5.08%, ctx=23076, majf=1032, minf=562491
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=846/340/0, short=0/0/0
lat (usec): 500=1.01%, 750=1.60%, 1000=2.61%
lat (msec): 2=9.70%, 4=4.30%, 10=7.84%, 20=10.88%, 50=1.77%
lat (msec): 100=56.07%, 250=4.05%, 500=0.17%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2973
read : io=221696KB, bw=3691.2KB/s, iops=14 , runt= 60061msec
clat (usec): min=377 , max=190327 , avg=48657.49, stdev=38212.43
lat (usec): min=378 , max=190329 , avg=48659.08, stdev=38212.52
bw (KB/s) : min= 1732, max=30720, per=14.18%, avg=3754.47, stdev=3315.68
write: io=91904KB, bw=1530.2KB/s, iops=5 , runt= 60061msec
clat (usec): min=511 , max=323162 , avg=49860.47, stdev=44048.36
lat (usec): min=526 , max=323178 , avg=49893.59, stdev=44055.74
bw (KB/s) : min= 310, max=13908, per=15.46%, avg=1700.49, stdev=1799.72
cpu : usr=3.30%, sys=5.07%, ctx=23069, majf=1032, minf=561844
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=866/359/0, short=0/0/0
lat (usec): 500=0.90%, 750=1.63%, 1000=1.80%
lat (msec): 2=9.63%, 4=6.53%, 10=9.55%, 20=10.29%, 50=1.96%
lat (msec): 100=53.31%, 250=4.16%, 500=0.24%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2974
read : io=169216KB, bw=2817.5KB/s, iops=11 , runt= 60060msec
clat (usec): min=355 , max=3579.7K, avg=67659.30, stdev=155224.69
lat (usec): min=356 , max=3579.7K, avg=67661.07, stdev=155224.67
bw (KB/s) : min= 143, max= 4526, per=11.43%, avg=3025.98, stdev=654.92
write: io=65024KB, bw=1082.7KB/s, iops=4 , runt= 60060msec
clat (usec): min=515 , max=188732 , avg=60323.99, stdev=38049.35
lat (usec): min=540 , max=188748 , avg=60340.28, stdev=38048.68
bw (KB/s) : min= 43, max= 3053, per=11.67%, avg=1283.39, stdev=691.58
cpu : usr=3.30%, sys=5.07%, ctx=23073, majf=1032, minf=561965
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=661/254/0, short=0/0/0
lat (usec): 500=2.40%, 750=1.42%, 1000=2.30%
lat (msec): 2=9.95%, 4=3.50%, 10=3.17%, 20=2.40%, 50=4.15%
lat (msec): 100=63.83%, 250=6.45%, 500=0.11%, 750=0.11%, 2000=0.11%
lat (msec): >=2000=0.11%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2975
read : io=197376KB, bw=3286.5KB/s, iops=12 , runt= 60065msec
clat (usec): min=382 , max=674179 , avg=56609.27, stdev=44129.14
lat (usec): min=384 , max=674180 , avg=56615.51, stdev=44126.55
bw (KB/s) : min= 918, max=14000, per=12.56%, avg=3325.64, stdev=1465.11
write: io=81152KB, bw=1351.8KB/s, iops=5 , runt= 60065msec
clat (usec): min=508 , max=203951 , avg=51731.92, stdev=37997.94
lat (usec): min=524 , max=203966 , avg=51749.71, stdev=37996.59
bw (KB/s) : min= 195, max= 8998, per=13.15%, avg=1446.20, stdev=1113.41
cpu : usr=3.30%, sys=5.07%, ctx=23072, majf=1032, minf=562222
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=771/317/0, short=0/0/0
lat (usec): 500=0.83%, 750=2.57%, 1000=1.65%
lat (msec): 2=8.09%, 4=6.07%, 10=4.32%, 20=8.27%, 50=2.57%
lat (msec): 100=60.75%, 250=4.69%, 500=0.09%, 750=0.09%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2976
read : io=198656KB, bw=3307.5KB/s, iops=12 , runt= 60063msec
clat (usec): min=390 , max=676281 , avg=53387.53, stdev=44460.61
lat (usec): min=391 , max=676282 , avg=53388.91, stdev=44460.71
bw (KB/s) : min= 612, max=15469, per=12.62%, avg=3340.51, stdev=1526.36
write: io=85760KB, bw=1427.9KB/s, iops=5 , runt= 60063msec
clat (usec): min=501 , max=202833 , avg=55575.41, stdev=38590.46
lat (usec): min=517 , max=202862 , avg=55592.76, stdev=38589.91
bw (KB/s) : min= 321, max= 6185, per=13.74%, avg=1511.07, stdev=854.89
cpu : usr=3.30%, sys=5.07%, ctx=23071, majf=1032, minf=562029
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=776/335/0, short=0/0/0
lat (usec): 500=1.89%, 750=2.88%, 1000=2.16%
lat (msec): 2=8.73%, 4=4.86%, 10=4.41%, 20=7.92%, 50=2.70%
lat (msec): 100=59.77%, 250=4.50%, 500=0.09%, 750=0.09%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2977
read : io=217856KB, bw=3627.4KB/s, iops=14 , runt= 60060msec
clat (usec): min=376 , max=311232 , avg=49804.24, stdev=38588.67
lat (usec): min=377 , max=311234 , avg=49805.62, stdev=38588.64
bw (KB/s) : min= 1777, max=20420, per=13.85%, avg=3668.32, stdev=2376.45
write: io=85760KB, bw=1427.1KB/s, iops=5 , runt= 60060msec
clat (usec): min=517 , max=205051 , avg=52708.93, stdev=37433.52
lat (usec): min=530 , max=205067 , avg=52734.11, stdev=37421.64
bw (KB/s) : min= 339, max= 5240, per=13.85%, avg=1523.21, stdev=987.01
cpu : usr=3.30%, sys=5.08%, ctx=23070, majf=1032, minf=561836
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=851/335/0, short=0/0/0
lat (usec): 500=1.35%, 750=2.36%, 1000=1.69%
lat (msec): 2=9.27%, 4=5.23%, 10=6.16%, 20=11.21%, 50=2.19%
lat (msec): 100=56.58%, 250=3.88%, 500=0.08%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2978
read : io=212480KB, bw=3537.8KB/s, iops=13 , runt= 60061msec
clat (usec): min=395 , max=308542 , avg=48122.63, stdev=38726.25
lat (usec): min=396 , max=308543 , avg=48124.97, stdev=38728.02
bw (KB/s) : min= 1368, max=18926, per=13.53%, avg=3583.21, stdev=2202.72
write: io=96256KB, bw=1602.7KB/s, iops=6 , runt= 60061msec
clat (usec): min=546 , max=279467 , avg=53455.76, stdev=43515.24
lat (usec): min=561 , max=279484 , avg=53472.50, stdev=43515.12
bw (KB/s) : min= 304, max= 8501, per=15.65%, avg=1721.54, stdev=1278.95
cpu : usr=3.30%, sys=5.07%, ctx=23062, majf=1032, minf=561906
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=830/376/0, short=0/0/0
lat (usec): 500=1.33%, 750=2.74%, 1000=2.07%
lat (msec): 2=10.12%, 4=4.98%, 10=6.47%, 20=11.69%, 50=2.24%
lat (msec): 100=53.73%, 250=4.31%, 500=0.33%
multi-mmap-seqread-sep-file: (groupid=0, jobs=1): err= 0: pid=2979
read : io=156672KB, bw=2608.6KB/s, iops=10 , runt= 60062msec
clat (usec): min=383 , max=4070.4K, avg=72970.99, stdev=227656.19
lat (usec): min=384 , max=4070.4K, avg=72972.34, stdev=227656.18
bw (KB/s) : min= 125, max= 4114, per=11.29%, avg=2990.53, stdev=739.73
write: io=67840KB, bw=1129.6KB/s, iops=4 , runt= 60062msec
clat (usec): min=527 , max=326129 , avg=58079.17, stdev=38343.72
lat (usec): min=543 , max=326145 , avg=58098.96, stdev=38343.49
bw (KB/s) : min= 25, max= 3105, per=12.57%, avg=1382.95, stdev=690.57
cpu : usr=3.30%, sys=5.07%, ctx=23058, majf=1031, minf=561969
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=612/265/0, short=0/0/0
lat (usec): 500=1.37%, 750=1.94%, 1000=2.39%
lat (msec): 2=9.58%, 4=3.65%, 10=3.88%, 20=4.79%, 50=2.62%
lat (msec): 100=65.11%, 250=3.99%, 500=0.23%, 750=0.11%, 2000=0.11%
lat (msec): >=2000=0.23%
Run status group 0 (all jobs):
READ: io=1553.3MB, aggrb=26478KB/s, minb=2671KB/s, maxb=3779KB/s, mint=60060msec, maxt=60069msec
WRITE: io=660736KB, aggrb=10999KB/s, minb=1108KB/s, maxb=1641KB/s, mint=60060msec, maxt=60069msec
Disk stats (read/write):
xvdc: ios=53518/13413, merge=0/31, ticks=3378312/3820320, in_queue=7200968, util=99.96%
#### Mutiple Threads - Multiple Files
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio multi-mmap-seqread-bw.cfg
multi-mmap-seqread-bw-sep-files: (g=0): rw=read, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
multi-mmap-seqread-bw-sep-files: (g=0): rw=read, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqread-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 8 (f=8): [RRRRRRRR] [100.0% done] [36172K/0K /s] [2207 /0 iops] [eta 00m:00s]
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3282
read : io=222224KB, bw=3703.5KB/s, iops=231 , runt= 60004msec
clat (usec): min=19 , max=418333 , avg=4315.07, stdev=24193.14
lat (usec): min=20 , max=418334 , avg=4316.69, stdev=24193.12
bw (KB/s) : min= 1899, max=13031, per=10.12%, avg=3749.02, stdev=1569.21
cpu : usr=3.43%, sys=5.77%, ctx=29408, majf=12058, minf=544117
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=13889/0/0, short=0/0/0
lat (usec): 20=2.40%, 50=89.87%, 100=1.62%, 250=1.67%, 500=0.66%
lat (usec): 750=0.14%, 1000=0.01%
lat (msec): 2=0.09%, 4=0.02%, 10=0.04%, 20=0.12%, 50=0.16%
lat (msec): 100=0.65%, 250=2.52%, 500=0.04%
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3284
read : io=221200KB, bw=3686.4KB/s, iops=230 , runt= 60005msec
clat (usec): min=19 , max=418452 , avg=4334.72, stdev=24614.09
lat (usec): min=20 , max=418453 , avg=4336.31, stdev=24616.76
bw (KB/s) : min= 1899, max=14253, per=10.04%, avg=3721.28, stdev=1609.20
cpu : usr=3.43%, sys=5.77%, ctx=29407, majf=12059, minf=544112
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=13825/0/0, short=0/0/0
lat (usec): 20=3.60%, 50=89.48%, 100=1.45%, 250=1.30%, 500=0.54%
lat (usec): 750=0.07%, 1000=0.02%
lat (msec): 2=0.05%, 4=0.06%, 10=0.05%, 20=0.12%, 50=0.15%
lat (msec): 100=0.51%, 250=2.58%, 500=0.04%
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3285
read : io=220528KB, bw=3675.5KB/s, iops=229 , runt= 60001msec
clat (usec): min=19 , max=418552 , avg=4348.49, stdev=24701.46
lat (usec): min=20 , max=418553 , avg=4349.70, stdev=24701.46
bw (KB/s) : min= 1899, max=13248, per=10.04%, avg=3718.81, stdev=1648.48
cpu : usr=3.43%, sys=5.77%, ctx=29404, majf=12054, minf=544104
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=13783/0/0, short=0/0/0
lat (usec): 20=3.61%, 50=89.41%, 100=1.27%, 250=1.55%, 500=0.52%
lat (usec): 750=0.12%, 1000=0.01%
lat (msec): 2=0.05%, 4=0.04%, 10=0.06%, 20=0.08%, 50=0.19%
lat (msec): 100=0.45%, 250=2.61%, 500=0.03%
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3286
read : io=217616KB, bw=3626.6KB/s, iops=226 , runt= 60007msec
clat (usec): min=19 , max=459012 , avg=4407.51, stdev=24885.75
lat (usec): min=20 , max=459013 , avg=4408.71, stdev=24885.75
bw (KB/s) : min= 1838, max=13082, per=9.89%, avg=3664.57, stdev=1478.47
cpu : usr=3.43%, sys=5.77%, ctx=29409, majf=12065, minf=544108
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=13601/0/0, short=0/0/0
lat (usec): 20=4.39%, 50=88.30%, 100=1.37%, 250=1.68%, 500=0.60%
lat (usec): 750=0.10%, 1000=0.05%
lat (msec): 2=0.04%, 4=0.06%, 10=0.02%, 20=0.07%, 50=0.16%
lat (msec): 100=0.45%, 250=2.65%, 500=0.04%
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3287
read : io=219152KB, bw=3652.3KB/s, iops=228 , runt= 60005msec
clat (usec): min=19 , max=419095 , avg=4375.71, stdev=24442.97
lat (usec): min=20 , max=419097 , avg=4377.52, stdev=24442.94
bw (KB/s) : min= 1718, max=13285, per=10.01%, avg=3709.28, stdev=1643.59
cpu : usr=3.43%, sys=5.77%, ctx=29405, majf=12061, minf=544106
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=13697/0/0, short=0/0/0
lat (usec): 20=3.97%, 50=88.62%, 100=1.45%, 250=1.67%, 500=0.55%
lat (usec): 750=0.12%, 1000=0.04%
lat (msec): 2=0.06%, 4=0.02%, 10=0.02%, 20=0.09%, 50=0.17%
lat (msec): 100=0.63%, 250=2.56%, 500=0.04%
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3288
read : io=220176KB, bw=3669.3KB/s, iops=229 , runt= 60006msec
clat (usec): min=19 , max=419110 , avg=4355.83, stdev=24275.43
lat (usec): min=20 , max=419111 , avg=4357.12, stdev=24275.42
bw (KB/s) : min= 1692, max=13949, per=10.00%, avg=3706.37, stdev=1631.79
cpu : usr=3.43%, sys=5.77%, ctx=29407, majf=12064, minf=544104
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=13761/0/0, short=0/0/0
lat (usec): 20=3.74%, 50=88.44%, 100=1.64%, 250=1.72%, 500=0.60%
lat (usec): 750=0.10%, 1000=0.04%
lat (msec): 2=0.08%, 4=0.04%, 10=0.07%, 20=0.12%, 50=0.16%
lat (msec): 100=0.68%, 250=2.54%, 500=0.03%
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3289
read : io=220176KB, bw=3669.6KB/s, iops=229 , runt= 60001msec
clat (usec): min=19 , max=343334 , avg=4355.26, stdev=24477.86
lat (usec): min=20 , max=343336 , avg=4356.70, stdev=24478.45
bw (KB/s) : min= 1845, max=14031, per=10.01%, avg=3709.84, stdev=1608.57
cpu : usr=3.43%, sys=5.77%, ctx=29400, majf=12055, minf=544098
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=13761/0/0, short=0/0/0
lat (usec): 20=4.19%, 50=88.63%, 100=1.32%, 250=1.56%, 500=0.62%
lat (usec): 750=0.12%, 1000=0.02%
lat (msec): 2=0.09%, 4=0.04%, 10=0.03%, 20=0.08%, 50=0.19%
lat (msec): 100=0.39%, 250=2.68%, 500=0.04%
multi-mmap-seqread-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=3290
read : io=682512KB, bw=11375KB/s, iops=710 , runt= 60001msec
clat (usec): min=19 , max=344428 , avg=1396.82, stdev=9106.77
lat (usec): min=20 , max=344429 , avg=1400.07, stdev=9108.12
bw (KB/s) : min= 5019, max=38788, per=30.83%, avg=11423.27, stdev=3813.13
cpu : usr=3.43%, sys=5.77%, ctx=29393, majf=12056, minf=544101
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=42657/0/0, short=0/0/0
lat (usec): 20=2.81%, 50=78.79%, 100=3.61%, 250=6.47%, 500=2.10%
lat (usec): 750=0.79%, 1000=0.45%
lat (msec): 2=1.02%, 4=1.06%, 10=0.83%, 20=0.12%, 50=0.08%
lat (msec): 100=1.82%, 250=0.04%, 500=0.01%
Run status group 0 (all jobs):
READ: io=2171.5MB, aggrb=37055KB/s, minb=3713KB/s, maxb=11648KB/s, mint=60001msec, maxt=60007msec
Disk stats (read/write):
xvdc: ios=61183/8, merge=0/9, ticks=2265908/212, in_queue=2268168, util=99.01%
#####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio multi-mmap-seqw-bw.cfg
multi-mmap-seqw-bw-sep-files: (g=0): rw=write, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
multi-mmap-seqw-bw-sep-files: (g=0): rw=write, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 8 (f=8): [WWWWWWWW] [100.0% done] [0K/36330K /s] [0 /2217 iops] [eta 00m:00s]
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4209
write: io=296240KB, bw=4935.3KB/s, iops=308 , runt= 60025msec
clat (usec): min=28 , max=654520 , avg=3236.14, stdev=14519.52
lat (usec): min=29 , max=654521 , avg=3237.79, stdev=14519.55
bw (KB/s) : min= 1293, max=20549, per=12.88%, avg=4988.87, stdev=2514.93
cpu : usr=2.73%, sys=9.58%, ctx=31328, majf=8, minf=581774
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/18515/0, short=0/0/0
lat (usec): 50=78.49%, 100=5.45%, 250=4.56%, 500=2.57%, 750=0.51%
lat (usec): 1000=0.10%
lat (msec): 2=0.09%, 4=0.30%, 10=0.54%, 20=0.88%, 50=5.01%
lat (msec): 100=1.24%, 250=0.24%, 500=0.01%, 750=0.01%
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4210
write: io=297408KB, bw=4951.4KB/s, iops=309 , runt= 60066msec
clat (usec): min=28 , max=651388 , avg=3226.19, stdev=14732.34
lat (usec): min=29 , max=651389 , avg=3227.76, stdev=14732.36
bw (KB/s) : min= 2242, max=21088, per=13.00%, avg=5035.76, stdev=2506.17
cpu : usr=2.73%, sys=9.57%, ctx=31331, majf=8, minf=581771
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/18588/0, short=0/0/0
lat (usec): 50=78.73%, 100=5.55%, 250=3.95%, 500=2.80%, 750=0.36%
lat (usec): 1000=0.09%
lat (msec): 2=0.22%, 4=0.27%, 10=0.46%, 20=0.91%, 50=5.19%
lat (msec): 100=1.10%, 250=0.34%, 500=0.02%, 750=0.01%
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4211
write: io=298000KB, bw=4966.6KB/s, iops=310 , runt= 60001msec
clat (usec): min=28 , max=624026 , avg=3215.93, stdev=13989.16
lat (usec): min=29 , max=624028 , avg=3217.73, stdev=13994.73
bw (KB/s) : min= 817, max=20471, per=12.95%, avg=5016.64, stdev=2515.90
cpu : usr=2.73%, sys=9.57%, ctx=31314, majf=8, minf=581742
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/18625/0, short=0/0/0
lat (usec): 50=78.05%, 100=5.26%, 250=4.29%, 500=2.96%, 750=0.49%
lat (usec): 1000=0.13%
lat (msec): 2=0.18%, 4=0.20%, 10=0.55%, 20=0.93%, 50=5.58%
lat (msec): 100=1.11%, 250=0.26%, 500=0.01%, 750=0.01%
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4212
write: io=290576KB, bw=4842.5KB/s, iops=302 , runt= 60006msec
clat (usec): min=28 , max=746120 , avg=3298.73, stdev=15156.86
lat (usec): min=29 , max=746122 , avg=3300.49, stdev=15156.85
bw (KB/s) : min= 684, max=19295, per=12.65%, avg=4899.66, stdev=2475.08
cpu : usr=2.73%, sys=9.57%, ctx=31314, majf=8, minf=581743
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/18161/0, short=0/0/0
lat (usec): 50=78.72%, 100=5.50%, 250=4.28%, 500=2.63%, 750=0.59%
lat (usec): 1000=0.09%
lat (msec): 2=0.21%, 4=0.17%, 10=0.51%, 20=1.00%, 50=4.63%
lat (msec): 100=1.34%, 250=0.31%, 500=0.01%, 750=0.01%
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4213
write: io=265200KB, bw=4419.5KB/s, iops=276 , runt= 60013msec
clat (usec): min=28 , max=720445 , avg=3615.60, stdev=17208.63
lat (usec): min=29 , max=720446 , avg=3617.14, stdev=17208.63
bw (KB/s) : min= 710, max=18677, per=11.53%, avg=4464.91, stdev=2267.69
cpu : usr=2.73%, sys=9.56%, ctx=31313, majf=8, minf=581743
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/16575/0, short=0/0/0
lat (usec): 50=79.48%, 100=5.25%, 250=3.99%, 500=2.91%, 750=0.56%
lat (usec): 1000=0.12%
lat (msec): 2=0.12%, 4=0.24%, 10=0.34%, 20=0.78%, 50=4.34%
lat (msec): 100=1.31%, 250=0.52%, 500=0.02%, 750=0.01%
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4214
write: io=285504KB, bw=4757.6KB/s, iops=297 , runt= 60011msec
clat (usec): min=28 , max=716209 , avg=3355.91, stdev=14774.25
lat (usec): min=29 , max=716210 , avg=3357.64, stdev=14774.21
bw (KB/s) : min= 713, max=18567, per=12.39%, avg=4797.35, stdev=2307.26
cpu : usr=2.73%, sys=9.57%, ctx=31307, majf=8, minf=581733
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/17844/0, short=0/0/0
lat (usec): 50=78.56%, 100=5.00%, 250=3.69%, 500=3.27%, 750=0.47%
lat (usec): 1000=0.12%
lat (msec): 2=0.22%, 4=0.22%, 10=0.48%, 20=0.82%, 50=5.61%
lat (msec): 100=1.19%, 250=0.32%, 500=0.01%, 750=0.01%
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4215
write: io=296960KB, bw=4948.1KB/s, iops=309 , runt= 60015msec
clat (usec): min=28 , max=636918 , avg=3226.26, stdev=14145.99
lat (usec): min=29 , max=636920 , avg=3229.68, stdev=14149.12
bw (KB/s) : min= 1077, max=19455, per=12.93%, avg=5006.72, stdev=2439.55
cpu : usr=2.73%, sys=9.56%, ctx=31306, majf=8, minf=581735
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/18560/0, short=0/0/0
lat (usec): 50=78.79%, 100=5.30%, 250=4.07%, 500=2.49%, 750=0.47%
lat (usec): 1000=0.06%
lat (msec): 2=0.21%, 4=0.20%, 10=0.46%, 20=0.89%, 50=5.61%
lat (msec): 100=1.17%, 250=0.24%, 500=0.02%, 750=0.01%
multi-mmap-seqw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4216
write: io=296176KB, bw=4934.5KB/s, iops=308 , runt= 60022msec
clat (usec): min=27 , max=635567 , avg=3236.80, stdev=14817.42
lat (usec): min=29 , max=635569 , avg=3238.70, stdev=14817.37
bw (KB/s) : min= 1438, max=18352, per=12.90%, avg=4995.92, stdev=2422.72
cpu : usr=2.73%, sys=9.57%, ctx=31307, majf=7, minf=581713
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=0/18511/0, short=0/0/0
lat (usec): 50=78.83%, 100=5.19%, 250=4.28%, 500=2.93%, 750=0.40%
lat (usec): 1000=0.07%
lat (msec): 2=0.15%, 4=0.19%, 10=0.46%, 20=0.85%, 50=5.19%
lat (msec): 100=1.10%, 250=0.34%, 500=0.01%, 750=0.01%
Run status group 0 (all jobs):
WRITE: io=2271.6MB, aggrb=38725KB/s, minb=4525KB/s, maxb=5085KB/s, mint=60001msec, maxt=60066msec
Disk stats (read/write):
xvdc: ios=54428/46490, merge=0/31, ticks=3143576/8591608, in_queue=11765072, util=99.98%
#####
ubuntu@ip-172-31-3-94:~/IO-LAB/FIO-CFG$ fio multi-mmap-seqrw-bw.cfg
multi-mmap-seqrw-bw-sep-files: (g=0): rw=rw, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
...
multi-mmap-seqrw-bw-sep-files: (g=0): rw=rw, bs=16K-16K/16K-16K, ioengine=mmap, iodepth=1
fio 1.59
Starting 8 threads
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
multi-mmap-seqrw-bw-sep-files: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 8 (f=8): [MMMMMMMM] [100.0% done] [26253K/11899K /s] [1602 /726 iops] [eta 00m:00s]
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4243
read : io=197152KB, bw=3282.6KB/s, iops=205 , runt= 60060msec
clat (usec): min=19 , max=146919 , avg=3428.94, stdev=15307.96
lat (usec): min=20 , max=146920 , avg=3430.17, stdev=15307.94
bw (KB/s) : min= 1142, max=14396, per=12.65%, avg=3315.24, stdev=1660.68
write: io=83952KB, bw=1397.9KB/s, iops=87 , runt= 60060msec
clat (usec): min=28 , max=492768 , avg=3376.46, stdev=17883.45
lat (usec): min=29 , max=492769 , avg=3378.09, stdev=17883.43
bw (KB/s) : min= 314, max= 5899, per=12.68%, avg=1413.88, stdev=728.38
cpu : usr=3.40%, sys=6.58%, ctx=37187, majf=164, minf=561007
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=12322/5247/0, short=0/0/0
lat (usec): 20=2.06%, 50=74.29%, 100=4.30%, 250=8.35%, 500=4.46%
lat (usec): 750=0.40%, 1000=0.09%
lat (msec): 2=0.30%, 4=0.15%, 10=0.39%, 20=0.96%, 50=0.13%
lat (msec): 100=3.93%, 250=0.16%, 500=0.02%
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4244
read : io=201024KB, bw=3348.0KB/s, iops=209 , runt= 60043msec
clat (usec): min=19 , max=152021 , avg=3155.91, stdev=14736.23
lat (usec): min=20 , max=152022 , avg=3157.74, stdev=14736.36
bw (KB/s) : min= 1177, max=12319, per=12.92%, avg=3384.90, stdev=1313.43
write: io=85456KB, bw=1423.3KB/s, iops=88 , runt= 60043msec
clat (usec): min=28 , max=424949 , avg=3794.28, stdev=18531.92
lat (usec): min=29 , max=424950 , avg=3796.57, stdev=18532.00
bw (KB/s) : min= 270, max= 5489, per=12.89%, avg=1437.52, stdev=622.69
cpu : usr=3.40%, sys=6.58%, ctx=37183, majf=164, minf=560970
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=12564/5341/0, short=0/0/0
lat (usec): 20=2.17%, 50=73.64%, 100=4.47%, 250=8.60%, 500=4.48%
lat (usec): 750=0.47%, 1000=0.12%
lat (msec): 2=0.37%, 4=0.26%, 10=0.40%, 20=0.86%, 50=0.15%
lat (msec): 100=3.79%, 250=0.20%, 500=0.02%
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4245
read : io=202848KB, bw=3378.4KB/s, iops=211 , runt= 60044msec
clat (usec): min=19 , max=147220 , avg=3169.16, stdev=14735.12
lat (usec): min=20 , max=147221 , avg=3170.61, stdev=14735.08
bw (KB/s) : min= 1336, max=18746, per=13.05%, avg=3419.80, stdev=1938.39
write: io=86960KB, bw=1448.3KB/s, iops=90 , runt= 60044msec
clat (usec): min=28 , max=491615 , avg=3635.84, stdev=18764.08
lat (usec): min=29 , max=491617 , avg=3637.49, stdev=18764.05
bw (KB/s) : min= 447, max= 8399, per=13.22%, avg=1473.26, stdev=871.47
cpu : usr=3.40%, sys=6.58%, ctx=37183, majf=164, minf=560971
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=12678/5435/0, short=0/0/0
lat (usec): 20=1.00%, 50=73.85%, 100=4.81%, 250=9.22%, 500=4.55%
lat (usec): 750=0.49%, 1000=0.10%
lat (msec): 2=0.29%, 4=0.28%, 10=0.39%, 20=0.92%, 50=0.11%
lat (msec): 100=3.81%, 250=0.14%, 500=0.03%
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4246
read : io=200208KB, bw=3334.2KB/s, iops=208 , runt= 60047msec
clat (usec): min=19 , max=166628 , avg=3281.83, stdev=15175.93
lat (usec): min=20 , max=166629 , avg=3285.59, stdev=15177.97
bw (KB/s) : min= 877, max=19085, per=12.85%, avg=3366.47, stdev=1908.16
write: io=84816KB, bw=1412.6KB/s, iops=88 , runt= 60047msec
clat (usec): min=28 , max=487571 , avg=3550.77, stdev=18708.36
lat (usec): min=29 , max=487572 , avg=3552.42, stdev=18708.51
bw (KB/s) : min= 463, max= 7443, per=12.79%, avg=1426.09, stdev=752.60
cpu : usr=3.40%, sys=6.57%, ctx=37182, majf=164, minf=560970
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=12513/5301/0, short=0/0/0
lat (usec): 20=1.69%, 50=73.36%, 100=4.98%, 250=9.26%, 500=4.32%
lat (usec): 750=0.42%, 1000=0.15%
lat (msec): 2=0.27%, 4=0.22%, 10=0.38%, 20=0.83%, 50=0.14%
lat (msec): 100=3.74%, 250=0.22%, 500=0.02%
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4247
read : io=191904KB, bw=3195.8KB/s, iops=199 , runt= 60050msec
clat (usec): min=19 , max=154403 , avg=3483.60, stdev=15652.05
lat (usec): min=20 , max=154404 , avg=3484.92, stdev=15652.08
bw (KB/s) : min= 1426, max=11727, per=12.33%, avg=3231.64, stdev=1224.45
write: io=80240KB, bw=1336.3KB/s, iops=83 , runt= 60050msec
clat (usec): min=28 , max=406924 , avg=3622.31, stdev=18489.52
lat (usec): min=29 , max=406925 , avg=3623.92, stdev=18489.56
bw (KB/s) : min= 338, max= 4233, per=12.10%, avg=1349.34, stdev=532.79
cpu : usr=3.40%, sys=6.58%, ctx=37181, majf=164, minf=560969
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=11994/5015/0, short=0/0/0
lat (usec): 20=1.64%, 50=73.43%, 100=5.07%, 250=9.53%, 500=3.94%
lat (usec): 750=0.41%, 1000=0.08%
lat (msec): 2=0.32%, 4=0.21%, 10=0.32%, 20=0.75%, 50=0.12%
lat (msec): 100=3.94%, 250=0.24%, 500=0.02%
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4248
read : io=185760KB, bw=3093.4KB/s, iops=193 , runt= 60051msec
clat (usec): min=19 , max=420998 , avg=3543.94, stdev=16519.86
lat (usec): min=20 , max=420999 , avg=3545.37, stdev=16519.90
bw (KB/s) : min= 1572, max=12101, per=11.88%, avg=3113.79, stdev=1137.61
write: io=79984KB, bw=1331.1KB/s, iops=83 , runt= 60051msec
clat (usec): min=27 , max=407771 , avg=3763.05, stdev=18462.51
lat (usec): min=29 , max=407772 , avg=3764.75, stdev=18462.47
bw (KB/s) : min= 491, max= 5863, per=12.08%, avg=1347.17, stdev=588.27
cpu : usr=3.40%, sys=6.58%, ctx=37180, majf=164, minf=560968
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=11610/4999/0, short=0/0/0
lat (usec): 20=1.60%, 50=75.60%, 100=4.31%, 250=8.10%, 500=4.27%
lat (usec): 750=0.44%, 1000=0.04%
lat (msec): 2=0.26%, 4=0.18%, 10=0.17%, 20=0.63%, 50=0.13%
lat (msec): 100=3.96%, 250=0.29%, 500=0.02%
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4249
read : io=198560KB, bw=3306.6KB/s, iops=206 , runt= 60051msec
clat (usec): min=19 , max=151237 , avg=3218.22, stdev=15077.45
lat (usec): min=20 , max=151238 , avg=3219.49, stdev=15077.44
bw (KB/s) : min= 986, max=15937, per=12.76%, avg=3344.29, stdev=1762.02
write: io=83312KB, bw=1387.4KB/s, iops=86 , runt= 60051msec
clat (usec): min=28 , max=436883 , avg=3844.93, stdev=19133.16
lat (usec): min=29 , max=436885 , avg=3846.51, stdev=19133.33
bw (KB/s) : min= 460, max= 7261, per=12.58%, avg=1402.30, stdev=787.40
cpu : usr=3.40%, sys=6.57%, ctx=37173, majf=164, minf=560966
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=12410/5207/0, short=0/0/0
lat (usec): 20=1.06%, 50=74.69%, 100=4.37%, 250=8.84%, 500=4.80%
lat (usec): 750=0.39%, 1000=0.11%
lat (msec): 2=0.33%, 4=0.19%, 10=0.28%, 20=0.74%, 50=0.14%
lat (msec): 100=3.85%, 250=0.18%, 500=0.02%
multi-mmap-seqrw-bw-sep-files: (groupid=0, jobs=1): err= 0: pid=4250
read : io=196528KB, bw=3272.7KB/s, iops=204 , runt= 60052msec
clat (usec): min=19 , max=151635 , avg=3218.36, stdev=14922.00
lat (usec): min=20 , max=151636 , avg=3219.79, stdev=14922.04
bw (KB/s) : min= 1119, max=14031, per=12.65%, avg=3315.40, stdev=1599.94
write: io=84832KB, bw=1412.7KB/s, iops=88 , runt= 60052msec
clat (usec): min=27 , max=492589 , avg=3850.75, stdev=19423.98
lat (usec): min=29 , max=492590 , avg=3852.46, stdev=19424.32
bw (KB/s) : min= 472, max= 6031, per=12.81%, avg=1428.60, stdev=666.95
cpu : usr=3.40%, sys=6.57%, ctx=37173, majf=164, minf=560965
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w/d: total=12283/5302/0, short=0/0/0
lat (usec): 20=1.47%, 50=74.10%, 100=4.57%, 250=9.09%, 500=4.34%
lat (usec): 750=0.38%, 1000=0.10%
lat (msec): 2=0.31%, 4=0.28%, 10=0.33%, 20=0.82%, 50=0.13%
lat (msec): 100=3.88%, 250=0.18%, 500=0.02%
Run status group 0 (all jobs):
READ: io=1537.1MB, aggrb=26206KB/s, minb=3167KB/s, maxb=3459KB/s, mint=60043msec, maxt=60060msec
WRITE: io=669552KB, aggrb=11148KB/s, minb=1363KB/s, maxb=1483KB/s, mint=60043msec, maxt=60060msec
Disk stats (read/write):
xvdc: ios=52645/24200, merge=0/29, ticks=3655488/5966956, in_queue=9635664, util=99.93%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment