Skip to content

Instantly share code, notes, and snippets.

@hrkokw
Created May 31, 2014 16:44
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save hrkokw/2497209f5411597bc6d9 to your computer and use it in GitHub Desktop.
Save hrkokw/2497209f5411597bc6d9 to your computer and use it in GitHub Desktop.
NAS benchmark (over AFP, FreeNAS on HP MicroServer N54L 4GB RAM)
fio: this platform does not support process shared mutexes, forcing use of threads. Use the 'thread' option to get rid of this warning.
RandomRW: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.0.15
Starting 1 process
RandomRW: Laying out IO file(s) (1 file(s) / 1024MB)
RandomRW: (groupid=0, jobs=1): err= 0: pid=4355: Sun May 25 13:51:52 2014
read : io=524704KB, bw=10023KB/s, iops=2505 , runt= 52350msec
clat (usec): min=1 , max=2789 , avg= 3.42, stdev= 9.90
lat (usec): min=1 , max=2789 , avg= 3.59, stdev= 9.95
clat percentiles (usec):
| 1.00th=[ 2], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 3], 60.00th=[ 3],
| 70.00th=[ 4], 80.00th=[ 4], 90.00th=[ 5], 95.00th=[ 6],
| 99.00th=[ 15], 99.50th=[ 18], 99.90th=[ 31], 99.95th=[ 39],
| 99.99th=[ 104]
bw (KB/s) : min= 595, max=21840, per=100.00%, avg=11271.80, stdev=3377.25
write: io=523872KB, bw=10007KB/s, iops=2501 , runt= 52350msec
clat (usec): min=1 , max=6258.2K, avg=390.97, stdev=17296.09
lat (usec): min=1 , max=6258.2K, avg=391.18, stdev=17296.09
clat percentiles (usec):
| 1.00th=[ 2], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 3],
| 30.00th=[ 4], 40.00th=[ 282], 50.00th=[ 326], 60.00th=[ 410],
| 70.00th=[ 474], 80.00th=[ 628], 90.00th=[ 964], 95.00th=[ 996],
| 99.00th=[ 1032], 99.50th=[ 1064], 99.90th=[ 1976], 99.95th=[ 3184],
| 99.99th=[ 9024]
bw (KB/s) : min= 552, max=21464, per=100.00%, avg=11255.60, stdev=3295.07
lat (usec) : 2=0.92%, 4=44.62%, 10=22.91%, 20=1.20%, 50=0.24%
lat (usec) : 100=0.02%, 250=0.01%, 500=15.94%, 750=7.96%, 1000=4.57%
lat (msec) : 2=1.58%, 4=0.02%, 10=0.02%, 20=0.01%, 50=0.01%
lat (msec) : >=2000=0.01%
cpu : usr=1.31%, sys=16.42%, ctx=101269, majf=0, minf=8
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=131176/w=130968/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=524704KB, aggrb=10022KB/s, minb=10022KB/s, maxb=10022KB/s, mint=52350msec, maxt=52350msec
WRITE: io=523872KB, aggrb=10007KB/s, minb=10007KB/s, maxb=10007KB/s, mint=52350msec, maxt=52350msec
fio: this platform does not support process shared mutexes, forcing use of threads. Use the 'thread' option to get rid of this warning.
RandomRW: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.0.15
Starting 1 process
RandomRW: Laying out IO file(s) (1 file(s) / 2048MB)
RandomRW: (groupid=0, jobs=1): err= 0: pid=4355: Sun May 25 15:15:04 2014
read : io=1024.7MB, bw=4035.1KB/s, iops=1008 , runt=259973msec
clat (usec): min=1 , max=6571.1K, avg=76.99, stdev=21593.92
lat (usec): min=1 , max=6571.1K, avg=77.19, stdev=21593.92
clat percentiles (usec):
| 1.00th=[ 2], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 4],
| 70.00th=[ 4], 80.00th=[ 5], 90.00th=[ 8], 95.00th=[ 9],
| 99.00th=[ 16], 99.50th=[ 19], 99.90th=[ 23], 99.95th=[ 26],
| 99.99th=[ 43]
bw (KB/s) : min= 10, max=22184, per=100.00%, avg=4653.91, stdev=2528.53
write: io=1023.4MB, bw=4030.9KB/s, iops=1007 , runt=259973msec
clat (usec): min=1 , max=7143.1K, avg=907.45, stdev=20977.19
lat (usec): min=1 , max=7143.1K, avg=907.71, stdev=20977.19
clat percentiles (usec):
| 1.00th=[ 2], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 8],
| 30.00th=[ 346], 40.00th=[ 644], 50.00th=[ 940], 60.00th=[ 980],
| 70.00th=[ 996], 80.00th=[ 1048], 90.00th=[ 1960], 95.00th=[ 2008],
| 99.00th=[ 3024], 99.50th=[ 3984], 99.90th=[ 6048], 99.95th=[ 7072],
| 99.99th=[12864]
bw (KB/s) : min= 12, max=21832, per=100.00%, avg=4648.18, stdev=2513.88
lat (usec) : 2=0.17%, 4=33.17%, 10=24.88%, 20=2.13%, 50=0.22%
lat (usec) : 100=0.01%, 250=0.01%, 500=7.23%, 750=4.55%, 1000=13.98%
lat (msec) : 2=11.03%, 4=2.42%, 10=0.21%, 20=0.01%, 50=0.01%
lat (msec) : 100=0.01%, 500=0.01%, >=2000=0.01%
cpu : usr=0.91%, sys=10.05%, ctx=276381, majf=0, minf=7
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=262309/w=261979/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=1024.7MB, aggrb=4035KB/s, minb=4035KB/s, maxb=4035KB/s, mint=259973msec, maxt=259973msec
WRITE: io=1023.4MB, aggrb=4030KB/s, minb=4030KB/s, maxb=4030KB/s, mint=259973msec, maxt=259973msec
fio: this platform does not support process shared mutexes, forcing use of threads. Use the 'thread' option to get rid of this warning.
RandomRW: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.0.15
Starting 1 process
RandomRW: Laying out IO file(s) (1 file(s) / 500MB)
RandomRW: (groupid=0, jobs=1): err= 0: pid=4355: Sun May 25 13:47:15 2014
read : io=256348KB, bw=47445KB/s, iops=11861 , runt= 5403msec
clat (usec): min=1 , max=82 , avg= 2.50, stdev= 1.34
lat (usec): min=1 , max=82 , avg= 2.60, stdev= 1.42
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 3], 90.00th=[ 4], 95.00th=[ 4],
| 99.00th=[ 6], 99.50th=[ 10], 99.90th=[ 19], 99.95th=[ 21],
| 99.99th=[ 23]
bw (KB/s) : min=45528, max=52448, per=100.00%, avg=47932.80, stdev=1933.89
write: io=255652KB, bw=47317KB/s, iops=11829 , runt= 5403msec
clat (usec): min=1 , max=26560 , avg=79.49, stdev=220.51
lat (usec): min=1 , max=26560 , avg=79.63, stdev=220.51
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 3], 80.00th=[ 7], 90.00th=[ 398], 95.00th=[ 422],
| 99.00th=[ 516], 99.50th=[ 580], 99.90th=[ 916], 99.95th=[ 1320],
| 99.99th=[ 2992]
bw (KB/s) : min=46224, max=52288, per=100.00%, avg=47750.40, stdev=1858.30
lat (usec) : 2=5.04%, 4=74.70%, 10=10.14%, 20=0.37%, 50=0.06%
lat (usec) : 100=0.01%, 500=9.01%, 750=0.59%, 1000=0.05%
lat (msec) : 2=0.03%, 4=0.01%, 10=0.01%, 50=0.01%
cpu : usr=3.11%, sys=25.93%, ctx=14699, majf=0, minf=6
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=64087/w=63913/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=256348KB, aggrb=47445KB/s, minb=47445KB/s, maxb=47445KB/s, mint=5403msec, maxt=5403msec
WRITE: io=255652KB, aggrb=47316KB/s, minb=47316KB/s, maxb=47316KB/s, mint=5403msec, maxt=5403msec
fio: this platform does not support process shared mutexes, forcing use of threads. Use the 'thread' option to get rid of this warning.
RandomRW: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.0.15
Starting 1 process
RandomRW: Laying out IO file(s) (1 file(s) / 500MB)
RandomRW: (groupid=0, jobs=1): err= 0: pid=4355: Sun May 25 13:41:57 2014
read : io=256348KB, bw=44785KB/s, iops=11196 , runt= 5724msec
clat (usec): min=1 , max=37 , avg= 2.42, stdev= 1.17
lat (usec): min=1 , max=37 , avg= 2.52, stdev= 1.25
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 3], 90.00th=[ 4], 95.00th=[ 4],
| 99.00th=[ 5], 99.50th=[ 6], 99.90th=[ 18], 99.95th=[ 20],
| 99.99th=[ 21]
bw (KB/s) : min=40784, max=49672, per=99.42%, avg=44523.64, stdev=2998.31
write: io=255652KB, bw=44663KB/s, iops=11165 , runt= 5724msec
clat (usec): min=1 , max=3080 , avg=84.66, stdev=183.31
lat (usec): min=1 , max=3080 , avg=84.79, stdev=183.31
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 3], 80.00th=[ 6], 90.00th=[ 402], 95.00th=[ 438],
| 99.00th=[ 724], 99.50th=[ 860], 99.90th=[ 1256], 99.95th=[ 1624],
| 99.99th=[ 2224]
bw (KB/s) : min=39632, max=49520, per=99.34%, avg=44370.18, stdev=3121.10
lat (usec) : 2=5.01%, 4=76.34%, 10=8.66%, 20=0.26%, 50=0.05%
lat (usec) : 500=8.05%, 750=1.21%, 1000=0.31%
lat (msec) : 2=0.12%, 4=0.01%
cpu : usr=2.87%, sys=23.45%, ctx=14529, majf=0, minf=5
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=64087/w=63913/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=256348KB, aggrb=44784KB/s, minb=44784KB/s, maxb=44784KB/s, mint=5724msec, maxt=5724msec
WRITE: io=255652KB, aggrb=44663KB/s, minb=44663KB/s, maxb=44663KB/s, mint=5724msec, maxt=5724msec
fio: this platform does not support process shared mutexes, forcing use of threads. Use the 'thread' option to get rid of this warning.
RandomRW: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.0.15
Starting 1 process
RandomRW: Laying out IO file(s) (1 file(s) / 500MB)
RandomRW: (groupid=0, jobs=1): err= 0: pid=4355: Sun May 25 13:40:51 2014
read : io=256348KB, bw=1230.8KB/s, iops=307 , runt=208284msec
clat (usec): min=1 , max=41403K, avg=650.35, stdev=163547.12
lat (usec): min=1 , max=41403K, avg=650.53, stdev=163547.12
clat percentiles (usec):
| 1.00th=[ 2], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 3],
| 70.00th=[ 4], 80.00th=[ 5], 90.00th=[ 8], 95.00th=[ 12],
| 99.00th=[ 22], 99.50th=[ 25], 99.90th=[ 39], 99.95th=[ 53],
| 99.99th=[ 131]
bw (KB/s) : min= 16, max=25584, per=100.00%, avg=3361.37, stdev=2934.87
write: io=255652KB, bw=1227.5KB/s, iops=306 , runt=208284msec
clat (usec): min=1 , max=53563K, avg=2600.99, stdev=215635.90
lat (usec): min=1 , max=53563K, avg=2601.23, stdev=215635.90
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 4],
| 70.00th=[ 6], 80.00th=[ 14], 90.00th=[ 1640], 95.00th=[ 7648],
| 99.00th=[12864], 99.50th=[13504], 99.90th=[21120], 99.95th=[1089536],
| 99.99th=[2244608]
bw (KB/s) : min= 17, max=25432, per=100.00%, avg=3346.02, stdev=2901.56
lat (usec) : 2=1.30%, 4=59.74%, 10=23.03%, 20=5.48%, 50=1.32%
lat (usec) : 100=0.04%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.28%
lat (msec) : 2=4.67%, 4=0.33%, 10=2.16%, 20=1.55%, 50=0.03%
lat (msec) : 250=0.01%, 750=0.01%, 1000=0.01%, 2000=0.02%, >=2000=0.01%
cpu : usr=0.31%, sys=1.67%, ctx=41213, majf=0, minf=8
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=64087/w=63913/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=256348KB, aggrb=1230KB/s, minb=1230KB/s, maxb=1230KB/s, mint=208284msec, maxt=208284msec
WRITE: io=255652KB, aggrb=1227KB/s, minb=1227KB/s, maxb=1227KB/s, mint=208284msec, maxt=208284msec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment