Skip to content

Instantly share code, notes, and snippets.

@pupapaik

pupapaik/dbench-10g-glusterfs.log

Last active August 30, 2021 08:43
Show Gist options
  • Star 2 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save pupapaik/76c5b7f124dbb69080840f01bf71f924 to your computer and use it in GitHub Desktop.
Save pupapaik/76c5b7f124dbb69080840f01bf71f924 to your computer and use it in GitHub Desktop.
Download ZIP
dbench test cases
Raw
dbench-10g-glusterfs.log
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=8: Tue Jan 29 19:00:26 2019
read: IOPS=2124, BW=8513KiB/s (8718kB/s)(125MiB/15027msec)
cpu : usr=1.89%, sys=3.83%, ctx=34743, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.1%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=31920,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=8513KiB/s (8718kB/s), 8513KiB/s-8513KiB/s (8718kB/s-8718kB/s), io=125MiB (131MB), run=15027-15027msec
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=16: Tue Jan 29 19:00:58 2019
write: IOPS=827, BW=3318KiB/s (3398kB/s)(92.9MiB/28418msec)
cpu : usr=0.67%, sys=2.06%, ctx=23976, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=115.7%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,23511,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=3318KiB/s (3398kB/s), 3318KiB/s-3318KiB/s (3398kB/s-3398kB/s), io=92.9MiB (96.6MB), run=28418-28418msec
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=24: Tue Jan 29 19:01:15 2019
read: IOPS=1871, BW=235MiB/s (246MB/s)(3524MiB/15026msec)
cpu : usr=1.74%, sys=3.83%, ctx=29893, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=111.3%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=28127,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=235MiB/s (246MB/s), 235MiB/s-235MiB/s (246MB/s-246MB/s), io=3524MiB (3695MB), run=15026-15026msec
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=32: Tue Jan 29 19:01:33 2019
write: IOPS=224, BW=28.7MiB/s (30.3MB/s)(441MiB/15410msec)
cpu : usr=1.80%, sys=0.64%, ctx=4337, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=114.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,3467,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=28.7MiB/s (30.3MB/s), 28.7MiB/s-28.7MiB/s (30.3MB/s-30.3MB/s), io=441MiB (463MB), run=15410-15410msec
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=40: Tue Jan 29 19:01:50 2019
read: IOPS=1182, BW=4731KiB/s (4845kB/s)(69.4MiB/15001msec)
slat (usec): min=25, max=28070, avg=480.95, stdev=892.36
clat (usec): min=42, max=4391.6k, avg=2898.88, stdev=65964.98
lat (usec): min=162, max=4391.9k, avg=3376.72, stdev=65965.92
clat percentiles (usec):
| 1.00th=[ 346], 5.00th=[ 532], 10.00th=[ 692], 20.00th=[ 948],
| 30.00th=[ 1048], 40.00th=[ 1096], 50.00th=[ 1160], 60.00th=[ 1240],
| 70.00th=[ 1400], 80.00th=[ 1672], 90.00th=[ 2416], 95.00th=[ 5280],
| 99.00th=[20096], 99.50th=[26496], 99.90th=[43776], 99.95th=[112128],
| 99.99th=[4423680]
lat (usec) : 50=0.02%, 100=0.05%, 250=0.02%, 500=4.07%, 750=8.33%
lat (usec) : 1000=12.57%
lat (msec) : 2=62.07%, 4=6.27%, 10=4.63%, 20=0.98%, 50=0.92%
lat (msec) : 100=0.02%, 250=0.05%, >=2000=0.02%
cpu : usr=1.23%, sys=2.81%, ctx=21161, majf=0, minf=2
IO depths : 1=0.1%, 2=0.1%, 4=112.2%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=17741,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=4731KiB/s (4845kB/s), 4731KiB/s-4731KiB/s (4845kB/s-4845kB/s), io=69.4MiB (72.7MB), run=15001-15001msec
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=48: Tue Jan 29 19:02:08 2019
write: IOPS=1988, BW=7954KiB/s (8144kB/s)(117MiB/15001msec)
slat (usec): min=36, max=18998, avg=483.30, stdev=623.55
clat (usec): min=89, max=69561, avg=1521.13, stdev=1713.58
lat (usec): min=563, max=69938, avg=2005.49, stdev=1843.73
clat percentiles (usec):
| 1.00th=[ 764], 5.00th=[ 988], 10.00th=[ 1048], 20.00th=[ 1112],
| 30.00th=[ 1160], 40.00th=[ 1208], 50.00th=[ 1256], 60.00th=[ 1304],
| 70.00th=[ 1368], 80.00th=[ 1464], 90.00th=[ 1800], 95.00th=[ 2512],
| 99.00th=[ 8096], 99.50th=[ 9792], 99.90th=[15936], 99.95th=[42240],
| 99.99th=[69120]
lat (usec) : 100=0.01%, 500=0.01%, 750=0.93%, 1000=5.01%
lat (msec) : 2=86.07%, 4=5.16%, 10=2.38%, 20=0.39%, 50=0.02%
lat (msec) : 100=0.04%
cpu : usr=1.71%, sys=5.22%, ctx=30129, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=113.6%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,29825,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=7954KiB/s (8144kB/s), 7954KiB/s-7954KiB/s (8144kB/s-8144kB/s), io=117MiB (122MB), run=15001-15001msec
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=56: Tue Jan 29 19:06:46 2019
read: IOPS=8, BW=9713KiB/s (9946kB/s)(175MiB/18450msec)
cpu : usr=0.00%, sys=0.11%, ctx=1372, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=5.0%, 16=109.4%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=160,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=57: Tue Jan 29 19:06:46 2019
read: IOPS=6, BW=7974KiB/s (8165kB/s)(125MiB/16053msec)
cpu : usr=0.00%, sys=0.08%, ctx=1122, majf=0, minf=0
IO depths : 1=0.9%, 2=1.8%, 4=3.6%, 8=7.3%, 16=100.9%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=110,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Tue Jan 29 19:06:46 2019
read: IOPS=8, BW=9827KiB/s (10.7MB/s)(179MiB/18653msec)
cpu : usr=0.00%, sys=0.11%, ctx=1443, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.9%, 16=106.7%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=164,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Tue Jan 29 19:06:46 2019
read: IOPS=9, BW=10.2MiB/s (10.7MB/s)(189MiB/18597msec)
cpu : usr=0.01%, sys=0.10%, ctx=1492, majf=0, minf=0
IO depths : 1=0.6%, 2=1.1%, 4=2.3%, 8=4.6%, 16=100.6%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=174,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=35.9MiB/s (37.6MB/s), 7974KiB/s-10.2MiB/s (8165kB/s-10.7MB/s), io=668MiB (700MB), run=16053-18653msec
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=67: Tue Jan 29 19:07:18 2019
write: IOPS=4, BW=4781KiB/s (4895kB/s)(125MiB/26774msec)
cpu : usr=0.18%, sys=0.07%, ctx=972, majf=0, minf=0
IO depths : 1=0.9%, 2=1.8%, 4=3.6%, 8=7.3%, 16=100.9%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,110,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=68: Tue Jan 29 19:07:18 2019
write: IOPS=3, BW=4587KiB/s (4697kB/s)(123MiB/27458msec)
cpu : usr=0.15%, sys=0.08%, ctx=901, majf=0, minf=0
IO depths : 1=0.9%, 2=1.9%, 4=3.7%, 8=7.4%, 16=102.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,108,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Tue Jan 29 19:07:18 2019
write: IOPS=4, BW=4809KiB/s (4925kB/s)(125MiB/26615msec)
cpu : usr=0.17%, sys=0.09%, ctx=947, majf=0, minf=0
IO depths : 1=0.9%, 2=1.8%, 4=3.6%, 8=7.3%, 16=100.9%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,110,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Tue Jan 29 19:07:18 2019
write: IOPS=3, BW=4530KiB/s (4639kB/s)(125MiB/28256msec)
cpu : usr=0.15%, sys=0.08%, ctx=980, majf=0, minf=0
IO depths : 1=0.9%, 2=1.8%, 4=3.6%, 8=7.3%, 16=100.9%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,110,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=17.7MiB/s (18.5MB/s), 4530KiB/s-4809KiB/s (4639kB/s-4925kB/s), io=498MiB (522MB), run=26615-28256msec
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=78: Tue Jan 29 19:07:36 2019
read: IOPS=1283, BW=5147KiB/s (5270kB/s)(75.5MiB/15007msec)
write: IOPS=422, BW=1695KiB/s (1735kB/s)(24.9MiB/15007msec)
cpu : usr=1.68%, sys=3.17%, ctx=26630, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=111.2%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=19259,6345,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=5147KiB/s (5270kB/s), 5147KiB/s-5147KiB/s (5270kB/s-5270kB/s), io=75.5MiB (79.9MB), run=15007-15007msec
WRITE: bw=1695KiB/s (1735kB/s), 1695KiB/s-1695KiB/s (1735kB/s-1735kB/s), io=24.9MiB (26.5MB), run=15007-15007msec
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 2124/827. BW: 235MiB/s / 28.7MiB/s
Average Latency (usec) Read/Write: 3376.72/2005.49
Sequential Read/Write: 35.9MiB/s / 17.7MiB/s
Mixed Random Read/Write IOPS: 1283/422
Raw
dbench-10g-portworx.log
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=9: Tue Jan 29 09:26:51 2019
read: IOPS=35.2k, BW=137MiB/s (144MB/s)(2062MiB/15003msec)
cpu : usr=15.29%, sys=52.59%, ctx=309242, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=527774,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=137MiB/s (144MB/s), 137MiB/s-137MiB/s (144MB/s-144MB/s), io=2062MiB (2162MB), run=15003-15003msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=596025/0, merge=0/0, ticks=1056792/0, in_queue=1056928, util=99.53%
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=17: Tue Jan 29 09:27:12 2019
write: IOPS=2637, BW=10.4MiB/s (10.9MB/s)(171MiB/16576msec)
cpu : usr=1.08%, sys=4.17%, ctx=17694, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=130.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,43723,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=10.4MiB/s (10.9MB/s), 10.4MiB/s-10.4MiB/s (10.9MB/s-10.9MB/s), io=171MiB (179MB), run=16576-16576msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=0/56776, merge=0/18, ticks=0/1064236, in_queue=1321824, util=99.65%
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=25: Tue Jan 29 09:27:29 2019
read: IOPS=5986, BW=749MiB/s (785MB/s)(10.2GiB/15021msec)
cpu : usr=3.58%, sys=16.06%, ctx=78439, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=112.3%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=89924,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=749MiB/s (785MB/s), 749MiB/s-749MiB/s (785MB/s-785MB/s), io=10.2GiB (11.8GB), run=15021-15021msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=100936/1, merge=0/0, ticks=1072712/6924, in_queue=1073384, util=100.00%
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=33: Tue Jan 29 09:27:49 2019
write: IOPS=168, BW=21.6MiB/s (22.7MB/s)(380MiB/17621msec)
cpu : usr=1.15%, sys=0.64%, ctx=2916, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.1%, >=64=129.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,2977,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=21.6MiB/s (22.7MB/s), 21.6MiB/s-21.6MiB/s (22.7MB/s-22.7MB/s), io=380MiB (398MB), run=17621-17621msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=0/3847, merge=0/1, ticks=0/1124580, in_queue=1212076, util=99.64%
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=41: Tue Jan 29 09:28:07 2019
read: IOPS=14.7k, BW=57.2MiB/s (59.1MB/s)(857MiB/15001msec)
slat (usec): min=2, max=4841, avg=14.48, stdev=18.39
clat (usec): min=2, max=62794, avg=254.24, stdev=655.28
lat (usec): min=22, max=62821, avg=268.99, stdev=655.35
clat percentiles (usec):
| 1.00th=[ 33], 5.00th=[ 43], 10.00th=[ 47], 20.00th=[ 56],
| 30.00th=[ 65], 40.00th=[ 75], 50.00th=[ 88], 60.00th=[ 107],
| 70.00th=[ 139], 80.00th=[ 490], 90.00th=[ 756], 95.00th=[ 900],
| 99.00th=[ 1416], 99.50th=[ 2128], 99.90th=[ 5600], 99.95th=[ 8640],
| 99.99th=[27776]
lat (usec) : 4=0.08%, 10=0.01%, 20=0.08%, 50=12.27%, 100=44.25%
lat (usec) : 250=21.78%, 500=1.66%, 750=9.58%, 1000=7.09%
lat (msec) : 2=2.68%, 4=0.36%, 10=0.14%, 20=0.02%, 50=0.01%
lat (msec) : 100=0.01%
cpu : usr=11.90%, sys=35.29%, ctx=174987, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=115.3%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=219426,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=57.2MiB/s (59.1MB/s), 57.2MiB/s-57.2MiB/s (59.1MB/s-59.1MB/s), io=857MiB (899MB), run=15001-15001msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=253060/0, merge=0/0, ticks=61336/0, in_queue=78392, util=100.00%
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=49: Tue Jan 29 09:28:27 2019
write: IOPS=880, BW=3522KiB/s (3607kB/s)(60.1MiB/17702msec)
slat (usec): min=3, max=2357, avg=18.30, stdev=26.85
clat (usec): min=376, max=3206.7k, avg=4519.61, stdev=90138.47
lat (usec): min=392, max=3206.7k, avg=4538.11, stdev=90138.55
clat percentiles (usec):
| 1.00th=[ 502], 5.00th=[ 572], 10.00th=[ 620], 20.00th=[ 692],
| 30.00th=[ 748], 40.00th=[ 804], 50.00th=[ 852], 60.00th=[ 900],
| 70.00th=[ 964], 80.00th=[ 1032], 90.00th=[ 1224], 95.00th=[ 1624],
| 99.00th=[ 5344], 99.50th=[10944], 99.90th=[1019904], 99.95th=[3194880],
| 99.99th=[3194880]
lat (usec) : 500=0.92%, 750=29.17%, 1000=45.60%
lat (msec) : 2=20.60%, 4=2.20%, 10=0.99%, 20=0.18%, 50=0.07%
lat (msec) : 100=0.03%, 250=0.03%, 500=0.03%, 750=0.05%, 1000=0.05%
lat (msec) : 2000=0.03%, >=2000=0.08%
cpu : usr=0.81%, sys=2.06%, ctx=9387, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=158.1%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,15584,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=3522KiB/s (3607kB/s), 3522KiB/s-3522KiB/s (3607kB/s-3607kB/s), io=60.1MiB (63.9MB), run=17702-17702msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=0/24632, merge=0/1, ticks=0/106972, in_queue=96868, util=100.00%
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=57: Tue Jan 29 09:32:17 2019
read: IOPS=206, BW=207MiB/s (217MB/s)(3180MiB/15348msec)
cpu : usr=0.25%, sys=0.96%, ctx=3135, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=110.7%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=3165,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Tue Jan 29 09:32:17 2019
read: IOPS=205, BW=206MiB/s (217MB/s)(3171MiB/15356msec)
cpu : usr=0.14%, sys=1.36%, ctx=3149, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=111.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=3156,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Tue Jan 29 09:32:17 2019
read: IOPS=204, BW=205MiB/s (215MB/s)(3152MiB/15361msec)
cpu : usr=0.12%, sys=1.11%, ctx=3113, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=111.7%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=3137,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=60: Tue Jan 29 09:32:17 2019
read: IOPS=204, BW=206MiB/s (216MB/s)(3158MiB/15341msec)
cpu : usr=0.22%, sys=1.02%, ctx=3095, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=111.5%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=3143,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=824MiB/s (864MB/s), 205MiB/s-207MiB/s (215MB/s-217MB/s), io=12.4GiB (13.3GB), run=15341-15361msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=14422/0, merge=0/0, ticks=1101496/0, in_queue=1105260, util=98.10%
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=68: Tue Jan 29 09:32:47 2019
write: IOPS=5, BW=6107KiB/s (6254kB/s)(161MiB/26994msec)
cpu : usr=0.23%, sys=0.00%, ctx=194, majf=0, minf=0
IO depths : 1=0.7%, 2=1.4%, 4=2.7%, 8=5.5%, 16=119.9%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,146,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Tue Jan 29 09:32:47 2019
write: IOPS=5, BW=6249KiB/s (6399kB/s)(156MiB/25565msec)
cpu : usr=0.22%, sys=0.02%, ctx=163, majf=0, minf=0
IO depths : 1=0.7%, 2=1.4%, 4=2.8%, 8=5.7%, 16=124.1%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,141,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Tue Jan 29 09:32:47 2019
write: IOPS=5, BW=5885KiB/s (6027kB/s)(158MiB/27491msec)
cpu : usr=0.17%, sys=0.05%, ctx=156, majf=0, minf=0
IO depths : 1=0.7%, 2=1.4%, 4=2.8%, 8=5.6%, 16=122.4%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,143,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=71: Tue Jan 29 09:32:47 2019
write: IOPS=5, BW=6470KiB/s (6625kB/s)(173MiB/27380msec)
cpu : usr=0.18%, sys=0.08%, ctx=205, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,158,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=23.6MiB/s (24.8MB/s), 5885KiB/s-6470KiB/s (6027kB/s-6625kB/s), io=648MiB (679MB), run=25565-27491msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=0/758, merge=0/44, ticks=0/1785416, in_queue=1807248, util=99.79%
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=79: Tue Jan 29 09:33:05 2019
read: IOPS=2901, BW=11.4MiB/s (11.9MB/s)(171MiB/15045msec)
write: IOPS=971, BW=3901KiB/s (3995kB/s)(57.4MiB/15045msec)
cpu : usr=2.22%, sys=5.05%, ctx=30435, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=142.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=43652,14611,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=11.4MiB/s (11.9MB/s), 11.4MiB/s-11.4MiB/s (11.9MB/s-11.9MB/s), io=171MiB (179MB), run=15045-15045msec
WRITE: bw=3901KiB/s (3995kB/s), 3901KiB/s-3901KiB/s (3995kB/s-3995kB/s), io=57.4MiB (60.2MB), run=15045-15045msec
Disk stats (read/write):
pxd!pxd1148423976548905389: ios=62119/20794, merge=0/1, ticks=120708/1066624, in_queue=1177328, util=100.00%
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 35.2k/2637. BW: 749MiB/s / 21.6MiB/s
Average Latency (usec) Read/Write: 268.99/4538.11
Sequential Read/Write: 824MiB/s / 23.6MiB/s
Mixed Random Read/Write IOPS: 2901/971
Raw
dbench-azure-host-path.log
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=8: Thu Jan 24 13:46:27 2019
read: IOPS=3146, BW=12.4MiB/s (12.1MB/s)(185MiB/15002msec)
cpu : usr=0.41%, sys=2.37%, ctx=3766, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=105.2%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=47208,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=12.4MiB/s (12.1MB/s), 12.4MiB/s-12.4MiB/s (12.1MB/s-12.1MB/s), io=185MiB (194MB), run=15002-15002msec
Disk stats (read/write):
sdd: ios=49601/152, merge=0/0, ticks=1073700/5920, in_queue=821268, util=76.28%
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=16: Thu Jan 24 13:46:45 2019
write: IOPS=1080, BW=4339KiB/s (4443kB/s)(63.6MiB/15001msec)
cpu : usr=0.35%, sys=0.76%, ctx=409, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=143.7%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,16210,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=4339KiB/s (4443kB/s), 4339KiB/s-4339KiB/s (4443kB/s-4443kB/s), io=63.6MiB (66.7MB), run=15001-15001msec
Disk stats (read/write):
sdd: ios=0/23328, merge=0/2, ticks=0/1140616, in_queue=358220, util=33.53%
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=24: Thu Jan 24 13:47:03 2019
read: IOPS=238, BW=30.4MiB/s (31.9MB/s)(466MiB/15351msec)
cpu : usr=0.01%, sys=0.48%, ctx=1039, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=113.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=3667,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=30.4MiB/s (31.9MB/s), 30.4MiB/s-30.4MiB/s (31.9MB/s-31.9MB/s), io=466MiB (489MB), run=15351-15351msec
Disk stats (read/write):
sdd: ios=4188/56, merge=0/0, ticks=1095004/15312, in_queue=855936, util=77.31%
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=32: Thu Jan 24 13:47:21 2019
write: IOPS=227, BW=28.1MiB/s (30.4MB/s)(446MiB/15401msec)
cpu : usr=1.48%, sys=0.31%, ctx=392, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=109.6%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,3502,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=28.1MiB/s (30.4MB/s), 28.1MiB/s-28.1MiB/s (30.4MB/s-30.4MB/s), io=446MiB (467MB), run=15401-15401msec
Disk stats (read/write):
sdd: ios=0/3971, merge=0/2, ticks=0/1125016, in_queue=861708, util=76.82%
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=40: Thu Jan 24 13:47:38 2019
read: IOPS=2620, BW=10.3MiB/s (10.8MB/s)(154MiB/15001msec)
slat (usec): min=2, max=2477, avg= 9.91, stdev=20.80
clat (usec): min=23, max=3567.7k, avg=1512.49, stdev=36358.58
lat (usec): min=48, max=3567.8k, avg=1522.48, stdev=36358.66
clat percentiles (usec):
| 1.00th=[ 141], 5.00th=[ 165], 10.00th=[ 183], 20.00th=[ 207],
| 30.00th=[ 233], 40.00th=[ 258], 50.00th=[ 282], 60.00th=[ 310],
| 70.00th=[ 338], 80.00th=[ 382], 90.00th=[ 474], 95.00th=[ 1160],
| 99.00th=[35072], 99.50th=[37120], 99.90th=[49920], 99.95th=[50432],
| 99.99th=[3555328]
lat (usec) : 50=0.03%, 100=0.21%, 250=36.77%, 500=54.18%, 750=2.93%
lat (usec) : 1000=0.63%
lat (msec) : 2=1.25%, 4=1.36%, 10=0.36%, 20=0.12%, 50=2.10%
lat (msec) : 100=0.05%, >=2000=0.01%
cpu : usr=1.84%, sys=3.49%, ctx=16010, majf=0, minf=2
IO depths : 1=0.1%, 2=0.1%, 4=117.7%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=39308,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=10.3MiB/s (10.8MB/s), 10.3MiB/s-10.3MiB/s (10.8MB/s-10.8MB/s), io=154MiB (161MB), run=15001-15001msec
Disk stats (read/write):
sdd: ios=46237/138, merge=0/3, ticks=63400/19116, in_queue=40312, util=72.18%
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=48: Thu Jan 24 13:47:55 2019
write: IOPS=3426, BW=13.4MiB/s (14.4MB/s)(201MiB/15001msec)
slat (usec): min=3, max=5051, avg= 9.96, stdev=46.67
clat (usec): min=16, max=64165, avg=1157.02, stdev=6204.08
lat (usec): min=33, max=64169, avg=1166.92, stdev=6204.33
clat percentiles (usec):
| 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 77], 20.00th=[ 101],
| 30.00th=[ 119], 40.00th=[ 141], 50.00th=[ 165], 60.00th=[ 193],
| 70.00th=[ 221], 80.00th=[ 253], 90.00th=[ 314], 95.00th=[ 466],
| 99.00th=[41216], 99.50th=[43264], 99.90th=[49920], 99.95th=[52480],
| 99.99th=[58624]
lat (usec) : 20=0.01%, 50=2.05%, 100=17.10%, 250=59.87%, 500=16.18%
lat (usec) : 750=0.62%, 1000=0.41%
lat (msec) : 2=0.56%, 4=0.69%, 10=0.19%, 20=0.09%, 50=2.11%
lat (msec) : 100=0.13%
cpu : usr=1.52%, sys=4.11%, ctx=14148, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=113.8%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,51408,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=13.4MiB/s (14.4MB/s), 13.4MiB/s-13.4MiB/s (14.4MB/s-14.4MB/s), io=201MiB (211MB), run=15001-15001msec
Disk stats (read/write):
sdd: ios=0/58664, merge=0/0, ticks=0/66580, in_queue=42644, util=77.43%
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=56: Thu Jan 24 13:50:46 2019
read: IOPS=7, BW=8403KiB/s (8605kB/s)(183MiB/22301msec)
cpu : usr=0.04%, sys=0.01%, ctx=158, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.8%, 16=104.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=168,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=57: Thu Jan 24 13:50:46 2019
read: IOPS=7, BW=8299KiB/s (8498kB/s)(171MiB/21100msec)
cpu : usr=0.00%, sys=0.06%, ctx=145, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.6%, 8=5.1%, 16=112.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=156,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Thu Jan 24 13:50:46 2019
read: IOPS=7, BW=8356KiB/s (8557kB/s)(173MiB/21200msec)
cpu : usr=0.03%, sys=0.02%, ctx=159, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=158,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Thu Jan 24 13:50:46 2019
read: IOPS=7, BW=8416KiB/s (8618kB/s)(173MiB/21050msec)
cpu : usr=0.00%, sys=0.06%, ctx=152, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=158,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=31.4MiB/s (32.1MB/s), 8299KiB/s-8416KiB/s (8498kB/s-8618kB/s), io=700MiB (734MB), run=21050-22301msec
Disk stats (read/write):
sdd: ios=1519/19, merge=0/0, ticks=2919928/30148, in_queue=2320444, util=77.80%
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=67: Thu Jan 24 13:51:08 2019
write: IOPS=4, BW=5882KiB/s (6023kB/s)(110MiB/19151msec)
cpu : usr=0.22%, sys=0.05%, ctx=122, majf=0, minf=0
IO depths : 1=1.1%, 2=2.1%, 4=4.2%, 8=8.4%, 16=116.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,95,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=68: Thu Jan 24 13:51:08 2019
write: IOPS=5, BW=6201KiB/s (6350kB/s)(109MiB/18000msec)
cpu : usr=0.21%, sys=0.02%, ctx=100, majf=0, minf=0
IO depths : 1=1.1%, 2=2.1%, 4=4.3%, 8=8.5%, 16=118.1%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,94,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Thu Jan 24 13:51:08 2019
write: IOPS=5, BW=6087KiB/s (6233kB/s)(107MiB/18000msec)
cpu : usr=0.13%, sys=0.09%, ctx=108, majf=0, minf=0
IO depths : 1=1.1%, 2=2.2%, 4=4.3%, 8=8.7%, 16=120.7%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,92,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Thu Jan 24 13:51:08 2019
write: IOPS=5, BW=6082KiB/s (6228kB/s)(109MiB/18351msec)
cpu : usr=0.23%, sys=0.05%, ctx=114, majf=0, minf=0
IO depths : 1=1.1%, 2=2.1%, 4=4.3%, 8=8.5%, 16=118.1%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,94,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=22.8MiB/s (23.9MB/s), 5882KiB/s-6201KiB/s (6023kB/s-6350kB/s), io=435MiB (456MB), run=18000-19151msec
Disk stats (read/write):
sdd: ios=0/1034, merge=0/2, ticks=0/2485652, in_queue=1642612, util=67.91%
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=78: Thu Jan 24 13:51:31 2019
read: IOPS=1690, BW=6771KiB/s (6933kB/s)(139MiB/20950msec)
write: IOPS=573, BW=2299KiB/s (2354kB/s)(47.4MiB/20950msec)
cpu : usr=0.64%, sys=1.74%, ctx=3471, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=115.5%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=35419,12023,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=6771KiB/s (6933kB/s), 6771KiB/s-6771KiB/s (6933kB/s-6933kB/s), io=139MiB (145MB), run=20950-20950msec
WRITE: bw=2299KiB/s (2354kB/s), 2299KiB/s-2299KiB/s (2354kB/s-2354kB/s), io=47.4MiB (49.4MB), run=20950-20950msec
Disk stats (read/write):
sdd: ios=40941/13967, merge=0/3, ticks=716240/254016, in_queue=838884, util=59.47%
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 3146/1080. BW: 30.4MiB/s / 28.1MiB/s
Average Latency (usec) Read/Write: 1522.48/1166.92
Sequential Read/Write: 31.4MiB/s / 22.8MiB/s
Mixed Random Read/Write IOPS: 1690/573
Raw
dbench-azure-pvc-premium.log
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=10: Mon Jan 21 21:10:03 2019
read: IOPS=2857, BW=11.2MiB/s (11.8MB/s)(168MiB/15009msec)
cpu : usr=2.03%, sys=4.43%, ctx=25917, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.7%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=42881,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=11.2MiB/s (11.8MB/s), 11.2MiB/s-11.2MiB/s (11.8MB/s-11.8MB/s), io=168MiB (176MB), run=15009-15009msec
Disk stats (read/write):
sdc: ios=48760/272, merge=0/0, ticks=1086224/11780, in_queue=1084432, util=99.57%
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=18: Mon Jan 21 21:10:21 2019
write: IOPS=2759, BW=10.9MiB/s (11.4MB/s)(162MiB/15009msec)
cpu : usr=2.19%, sys=4.64%, ctx=22514, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=114.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,41420,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=10.9MiB/s (11.4MB/s), 10.9MiB/s-10.9MiB/s (11.4MB/s-11.4MB/s), io=162MiB (170MB), run=15009-15009msec
Disk stats (read/write):
sdc: ios=0/47475, merge=0/20, ticks=0/1098644, in_queue=1086320, util=99.69%
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=26: Mon Jan 21 21:10:39 2019
read: IOPS=234, BW=29.9MiB/s (31.4MB/s)(459MiB/15360msec)
cpu : usr=0.21%, sys=0.68%, ctx=2940, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=113.5%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=3607,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=29.9MiB/s (31.4MB/s), 29.9MiB/s-29.9MiB/s (31.4MB/s-31.4MB/s), io=459MiB (481MB), run=15360-15360msec
Disk stats (read/write):
sdc: ios=4134/70, merge=0/0, ticks=1095548/19920, in_queue=1109672, util=99.60%
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=34: Mon Jan 21 21:10:56 2019
write: IOPS=223, BW=28.5MiB/s (29.9MB/s)(437MiB/15354msec)
cpu : usr=1.20%, sys=0.63%, ctx=2797, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=111.8%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,3433,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=28.5MiB/s (29.9MB/s), 28.5MiB/s-28.5MiB/s (29.9MB/s-29.9MB/s), io=437MiB (458MB), run=15354-15354msec
Disk stats (read/write):
sdc: ios=0/3999, merge=0/2, ticks=0/1128412, in_queue=1120872, util=99.61%
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=42: Mon Jan 21 21:11:14 2019
read: IOPS=914, BW=3657KiB/s (3745kB/s)(53.7MiB/15004msec)
slat (usec): min=3, max=1017, avg=13.68, stdev=12.31
clat (msec): min=2, max=45, avg= 4.36, stdev= 4.08
lat (msec): min=2, max=45, avg= 4.37, stdev= 4.08
clat percentiles (usec):
| 1.00th=[ 3152], 5.00th=[ 3312], 10.00th=[ 3376], 20.00th=[ 3440],
| 30.00th=[ 3504], 40.00th=[ 3568], 50.00th=[ 3632], 60.00th=[ 3728],
| 70.00th=[ 3856], 80.00th=[ 4048], 90.00th=[ 4704], 95.00th=[ 5728],
| 99.00th=[33024], 99.50th=[40192], 99.90th=[43264], 99.95th=[43776],
| 99.99th=[45312]
lat (msec) : 4=78.16%, 10=19.95%, 20=0.36%, 50=1.55%
cpu : usr=1.11%, sys=2.42%, ctx=12099, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=113.8%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=13716,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=3657KiB/s (3745kB/s), 3657KiB/s-3657KiB/s (3745kB/s-3745kB/s), io=53.7MiB (56.2MB), run=15004-15004msec
Disk stats (read/write):
sdc: ios=15606/284, merge=0/0, ticks=67024/6204, in_queue=57504, util=99.60%
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=50: Mon Jan 21 21:11:31 2019
write: IOPS=942, BW=3772KiB/s (3863kB/s)(55.3MiB/15003msec)
slat (usec): min=4, max=7862, avg=17.05, stdev=64.03
clat (msec): min=2, max=43, avg= 4.22, stdev= 4.34
lat (msec): min=2, max=43, avg= 4.24, stdev= 4.34
clat percentiles (usec):
| 1.00th=[ 2928], 5.00th=[ 3024], 10.00th=[ 3088], 20.00th=[ 3184],
| 30.00th=[ 3280], 40.00th=[ 3344], 50.00th=[ 3440], 60.00th=[ 3568],
| 70.00th=[ 3696], 80.00th=[ 3984], 90.00th=[ 4768], 95.00th=[ 5600],
| 99.00th=[37632], 99.50th=[40192], 99.90th=[42240], 99.95th=[42752],
| 99.99th=[43776]
lat (msec) : 4=80.25%, 10=18.03%, 20=0.06%, 50=1.67%
cpu : usr=1.01%, sys=2.57%, ctx=10814, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=112.9%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,14145,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=3772KiB/s (3863kB/s), 3772KiB/s-3772KiB/s (3863kB/s-3863kB/s), io=55.3MiB (57.1MB), run=15003-15003msec
Disk stats (read/write):
sdc: ios=0/16246, merge=0/3, ticks=0/73492, in_queue=57500, util=99.68%
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Mon Jan 21 21:13:49 2019
read: IOPS=7, BW=8256KiB/s (8454kB/s)(179MiB/22201msec)
cpu : usr=0.00%, sys=0.06%, ctx=180, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.9%, 16=106.7%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=164,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Mon Jan 21 21:13:49 2019
read: IOPS=7, BW=8480KiB/s (8683kB/s)(171MiB/20650msec)
cpu : usr=0.01%, sys=0.04%, ctx=171, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.6%, 8=5.1%, 16=112.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=156,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=60: Mon Jan 21 21:13:49 2019
read: IOPS=7, BW=8376KiB/s (8577kB/s)(173MiB/21151msec)
cpu : usr=0.00%, sys=0.06%, ctx=172, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=158,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=61: Mon Jan 21 21:13:49 2019
read: IOPS=7, BW=8136KiB/s (8331kB/s)(176MiB/22151msec)
cpu : usr=0.00%, sys=0.05%, ctx=177, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=5.0%, 16=108.7%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=161,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=31.5MiB/s (33.2MB/s), 8136KiB/s-8480KiB/s (8331kB/s-8683kB/s), io=699MiB (733MB), run=20650-22201msec
Disk stats (read/write):
sdc: ios=1505/23, merge=0/0, ticks=2899480/30452, in_queue=2932456, util=99.04%
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Mon Jan 21 21:14:14 2019
write: IOPS=7, BW=8297KiB/s (8496kB/s)(173MiB/21352msec)
cpu : usr=0.25%, sys=0.00%, ctx=159, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,158,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Mon Jan 21 21:14:14 2019
write: IOPS=7, BW=8317KiB/s (8516kB/s)(173MiB/21301msec)
cpu : usr=0.23%, sys=0.04%, ctx=163, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,158,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=71: Mon Jan 21 21:14:14 2019
write: IOPS=7, BW=8222KiB/s (8420kB/s)(173MiB/21545msec)
cpu : usr=0.23%, sys=0.03%, ctx=161, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,158,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=72: Mon Jan 21 21:14:14 2019
write: IOPS=7, BW=8297KiB/s (8496kB/s)(173MiB/21352msec)
cpu : usr=0.24%, sys=0.03%, ctx=162, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,158,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=32.2MiB/s (33.7MB/s), 8222KiB/s-8317KiB/s (8420kB/s-8516kB/s), io=692MiB (726MB), run=21301-21545msec
Disk stats (read/write):
sdc: ios=0/1563, merge=0/2, ticks=0/2915940, in_queue=2900380, util=99.71%
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=80: Mon Jan 21 21:14:31 2019
read: IOPS=2144, BW=8592KiB/s (8798kB/s)(126MiB/15047msec)
write: IOPS=712, BW=2855KiB/s (2924kB/s)(41.1MiB/15047msec)
cpu : usr=1.53%, sys=5.60%, ctx=22600, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.6%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=32270,10728,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=8592KiB/s (8798kB/s), 8592KiB/s-8592KiB/s (8798kB/s-8798kB/s), io=126MiB (132MB), run=15047-15047msec
WRITE: bw=2855KiB/s (2924kB/s), 2855KiB/s-2855KiB/s (2924kB/s-2924kB/s), io=41.1MiB (43.1MB), run=15047-15047msec
Disk stats (read/write):
sdc: ios=36597/12485, merge=0/2, ticks=817264/277916, in_queue=1081532, util=99.65%
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 2857/2759. BW: 29.9MiB/s / 28.5MiB/s
Average Latency (usec) Read/Write: /
Sequential Read/Write: 31.5MiB/s / 32.2MiB/s
Mixed Random Read/Write IOPS: 2144/712
Raw
dbench-longhorn
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=8: Sun Aug 23 19:11:35 2020
read: IOPS=5262, BW=20.6MiB/s (21.6MB/s)(309MiB/15004msec)
cpu : usr=1.45%, sys=4.19%, ctx=29975, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=78960,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=20.6MiB/s (21.6MB/s), 20.6MiB/s-20.6MiB/s (21.6MB/s-21.6MB/s), io=309MiB (324MB), run=15004-15004msec
Disk stats (read/write):
sdd: ios=89197/64, merge=1/0, ticks=763372/2924, in_queue=459884, util=99.19%
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=16: Sun Aug 23 19:11:52 2020
write: IOPS=1362, BW=5468KiB/s (5599kB/s)(80.3MiB/15026msec)
cpu : usr=0.57%, sys=1.39%, ctx=10990, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=118.1%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,20477,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=5468KiB/s (5599kB/s), 5468KiB/s-5468KiB/s (5599kB/s-5599kB/s), io=80.3MiB (84.2MB), run=15026-15026msec
Disk stats (read/write):
sdd: ios=0/24215, merge=0/3, ticks=0/1032056, in_queue=525620, util=99.61%
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=24: Sun Aug 23 19:12:10 2020
read: IOPS=685, BW=86.2MiB/s (90.4MB/s)(1303MiB/15127msec)
cpu : usr=0.43%, sys=1.06%, ctx=6731, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=113.6%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=10363,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=86.2MiB/s (90.4MB/s), 86.2MiB/s-86.2MiB/s (90.4MB/s-90.4MB/s), io=1303MiB (1367MB), run=15127-15127msec
Disk stats (read/write):
sdd: ios=11700/55, merge=33/0, ticks=1059616/7664, in_queue=530600, util=99.60%
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=32: Sun Aug 23 19:12:27 2020
write: IOPS=223, BW=28.5MiB/s (29.8MB/s)(439MiB/15446msec)
cpu : usr=0.51%, sys=0.61%, ctx=6799, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=113.3%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,3446,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=28.5MiB/s (29.8MB/s), 28.5MiB/s-28.5MiB/s (29.8MB/s-29.8MB/s), io=439MiB (460MB), run=15446-15446msec
Disk stats (read/write):
sdd: ios=0/3960, merge=0/5, ticks=0/1088848, in_queue=538540, util=99.62%
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=40: Sun Aug 23 19:12:45 2020
read: IOPS=2921, BW=11.5MiB/s (11.1MB/s)(171MiB/15001msec)
slat (usec): min=4, max=15772, avg=67.70, stdev=196.01
clat (usec): min=31, max=46479, avg=1290.44, stdev=1818.79
lat (usec): min=424, max=51948, avg=1358.07, stdev=1837.53
clat percentiles (usec):
| 1.00th=[ 494], 5.00th=[ 628], 10.00th=[ 700], 20.00th=[ 796],
| 30.00th=[ 876], 40.00th=[ 948], 50.00th=[ 1020], 60.00th=[ 1096],
| 70.00th=[ 1192], 80.00th=[ 1336], 90.00th=[ 1608], 95.00th=[ 2224],
| 99.00th=[ 6752], 99.50th=[ 9536], 99.90th=[32384], 99.95th=[38656],
| 99.99th=[44288]
lat (usec) : 50=0.01%, 100=0.01%, 250=0.03%, 500=1.08%, 750=13.76%
lat (usec) : 1000=32.36%
lat (msec) : 2=46.85%, 4=3.39%, 10=2.04%, 20=0.24%, 50=0.23%
cpu : usr=2.59%, sys=6.09%, ctx=59620, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=113.4%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=43818,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=11.5MiB/s (11.1MB/s), 11.5MiB/s-11.5MiB/s (11.1MB/s-11.1MB/s), io=171MiB (179MB), run=15001-15001msec
Disk stats (read/write):
sdd: ios=49702/68, merge=0/0, ticks=61796/1960, in_queue=49776, util=98.66%
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=48: Sun Aug 23 19:13:02 2020
write: IOPS=1206, BW=4827KiB/s (4942kB/s)(70.8MiB/15002msec)
slat (usec): min=4, max=16399, avg=105.79, stdev=265.35
clat (usec): min=63, max=1936.8k, avg=3198.92, stdev=40807.38
lat (usec): min=710, max=1936.9k, avg=3297.62, stdev=40806.71
clat percentiles (usec):
| 1.00th=[ 644], 5.00th=[ 916], 10.00th=[ 1020], 20.00th=[ 1144],
| 30.00th=[ 1240], 40.00th=[ 1336], 50.00th=[ 1432], 60.00th=[ 1544],
| 70.00th=[ 1704], 80.00th=[ 1960], 90.00th=[ 2928], 95.00th=[ 6304],
| 99.00th=[23680], 99.50th=[36096], 99.90th=[57088], 99.95th=[87552],
| 99.99th=[1941504]
lat (usec) : 100=0.02%, 250=0.02%, 500=0.28%, 750=1.56%, 1000=7.16%
lat (msec) : 2=71.93%, 4=11.59%, 10=4.27%, 20=1.83%, 50=1.22%
lat (msec) : 100=0.09%, 2000=0.04%
cpu : usr=1.13%, sys=2.61%, ctx=24651, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=119.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,18099,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=4827KiB/s (4942kB/s), 4827KiB/s-4827KiB/s (4942kB/s-4942kB/s), io=70.8MiB (74.2MB), run=15002-15002msec
Disk stats (read/write):
sdd: ios=0/21574, merge=0/3, ticks=0/72104, in_queue=61016, util=99.00%
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=56: Sun Aug 23 19:15:35 2020
read: IOPS=22, BW=23.6MiB/s (24.7MB/s)(409MiB/17395msec)
cpu : usr=0.02%, sys=0.13%, ctx=696, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=109.4%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=394,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=57: Sun Aug 23 19:15:35 2020
read: IOPS=22, BW=22.1MiB/s (24.5MB/s)(385MiB/16792msec)
cpu : usr=0.02%, sys=0.11%, ctx=648, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.1%, 8=2.2%, 16=116.5%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=370,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Sun Aug 23 19:15:35 2020
read: IOPS=22, BW=23.4MiB/s (24.5MB/s)(408MiB/17485msec)
cpu : usr=0.02%, sys=0.12%, ctx=706, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=109.7%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=393,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Sun Aug 23 19:15:35 2020
read: IOPS=23, BW=23.9MiB/s (25.3MB/s)(414MiB/17344msec)
cpu : usr=0.04%, sys=0.10%, ctx=678, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=108.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=399,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=92.5MiB/s (96.1MB/s), 22.1MiB/s-23.9MiB/s (24.5MB/s-25.3MB/s), io=1616MiB (1694MB), run=16792-17485msec
Disk stats (read/write):
sdd: ios=1765/26, merge=0/0, ticks=1195672/22304, in_queue=593644, util=99.22%
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=67: Sun Aug 23 19:16:00 2020
write: IOPS=7, BW=8088KiB/s (8282kB/s)(173MiB/21904msec)
cpu : usr=0.16%, sys=0.08%, ctx=1981, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,158,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=68: Sun Aug 23 19:16:00 2020
write: IOPS=7, BW=8396KiB/s (8598kB/s)(180MiB/21953msec)
cpu : usr=0.12%, sys=0.12%, ctx=2011, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.8%, 16=106.1%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,165,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Sun Aug 23 19:16:00 2020
write: IOPS=7, BW=8198KiB/s (8395kB/s)(163MiB/20359msec)
cpu : usr=0.12%, sys=0.11%, ctx=1762, majf=0, minf=0
IO depths : 1=0.7%, 2=1.4%, 4=2.7%, 8=5.4%, 16=118.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,148,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Sun Aug 23 19:16:00 2020
write: IOPS=7, BW=8119KiB/s (8314kB/s)(178MiB/22451msec)
cpu : usr=0.12%, sys=0.12%, ctx=1881, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=4.9%, 16=107.4%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,163,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=30.1MiB/s (32.5MB/s), 8088KiB/s-8396KiB/s (8282kB/s-8598kB/s), io=694MiB (728MB), run=20359-22451msec
Disk stats (read/write):
sdd: ios=0/779, merge=0/3, ticks=0/1486084, in_queue=745540, util=99.73%
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=78: Sun Aug 23 19:16:18 2020
read: IOPS=2696, BW=10.6MiB/s (11.6MB/s)(158MiB/15023msec)
write: IOPS=888, BW=3560KiB/s (3646kB/s)(52.3MiB/15023msec)
cpu : usr=1.17%, sys=3.48%, ctx=25652, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=105.2%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=40509,13349,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=10.6MiB/s (11.6MB/s), 10.6MiB/s-10.6MiB/s (11.6MB/s-11.6MB/s), io=158MiB (166MB), run=15023-15023msec
WRITE: bw=3560KiB/s (3646kB/s), 3560KiB/s-3560KiB/s (3646kB/s-3646kB/s), io=52.3MiB (54.8MB), run=15023-15023msec
Disk stats (read/write):
sdd: ios=42540/14100, merge=0/2, ticks=601984/252936, in_queue=477752, util=99.54%
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 5262/1362. BW: 86.2MiB/s / 28.5MiB/s
Average Latency (usec) Read/Write: 1358.07/3297.62
Sequential Read/Write: 92.5MiB/s / 30.1MiB/s
Mixed Random Read/Write IOPS: 2696/888
Raw
dbench-openebs-10g-cstor-1-replica.log
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=9: Thu Jan 24 13:08:29 2019
read: IOPS=890, BW=3580KiB/s (3666kB/s)(52.8MiB/15082msec)
cpu : usr=1.10%, sys=2.06%, ctx=16834, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=108.1%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=13434,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=3580KiB/s (3666kB/s), 3580KiB/s-3580KiB/s (3666kB/s-3666kB/s), io=52.8MiB (55.3MB), run=15082-15082msec
Disk stats (read/write):
sdd: ios=14481/0, merge=3/0, ticks=1083772/0, in_queue=529372, util=99.61%
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=17: Thu Jan 24 13:08:47 2019
write: IOPS=330, BW=1340KiB/s (1372kB/s)(19.9MiB/15156msec)
cpu : usr=0.21%, sys=0.90%, ctx=4857, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=116.1%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,5015,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=1340KiB/s (1372kB/s), 1340KiB/s-1340KiB/s (1372kB/s-1372kB/s), io=19.9MiB (20.8MB), run=15156-15156msec
Disk stats (read/write):
sdd: ios=0/5813, merge=0/18, ticks=0/1085284, in_queue=531948, util=99.58%
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=25: Thu Jan 24 13:09:06 2019
read: IOPS=95, BW=12.5MiB/s (12.1MB/s)(201MiB/16250msec)
cpu : usr=0.15%, sys=0.28%, ctx=2103, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.1%, >=64=103.3%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=1548,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=12.5MiB/s (12.1MB/s), 12.5MiB/s-12.5MiB/s (12.1MB/s-12.1MB/s), io=201MiB (211MB), run=16250-16250msec
Disk stats (read/write):
sdd: ios=1635/0, merge=3/0, ticks=1129736/0, in_queue=562244, util=99.62%
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=33: Thu Jan 24 13:09:29 2019
write: IOPS=23, BW=3395KiB/s (3477kB/s)(67.6MiB/20357msec)
cpu : usr=0.17%, sys=0.07%, ctx=679, majf=0, minf=1
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.4%, 32=6.7%, >=64=187.6%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,477,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=3395KiB/s (3477kB/s), 3395KiB/s-3395KiB/s (3477kB/s-3477kB/s), io=67.6MiB (70.8MB), run=20357-20357msec
Disk stats (read/write):
sdd: ios=0/938, merge=0/2, ticks=0/1238544, in_queue=673372, util=99.70%
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=41: Thu Jan 24 13:09:46 2019
read: IOPS=615, BW=2464KiB/s (2523kB/s)(36.1MiB/15001msec)
slat (usec): min=5, max=3975, avg=48.38, stdev=118.28
clat (usec): min=54, max=2795.2k, avg=6449.31, stdev=71839.54
lat (usec): min=892, max=2795.2k, avg=6497.02, stdev=71839.40
clat percentiles (usec):
| 1.00th=[ 1096], 5.00th=[ 1352], 10.00th=[ 1512], 20.00th=[ 1736],
| 30.00th=[ 1912], 40.00th=[ 2096], 50.00th=[ 2320], 60.00th=[ 2672],
| 70.00th=[ 3248], 80.00th=[ 4640], 90.00th=[ 8640], 95.00th=[16064],
| 99.00th=[34560], 99.50th=[39680], 99.90th=[54016], 99.95th=[2023424],
| 99.99th=[2801664]
lat (usec) : 100=0.01%, 1000=0.35%
lat (msec) : 2=34.68%, 4=41.71%, 10=15.04%, 20=4.19%, 50=3.92%
lat (msec) : 100=0.05%, >=2000=0.09%
cpu : usr=0.73%, sys=2.19%, ctx=10472, majf=0, minf=2
IO depths : 1=0.1%, 2=0.1%, 4=104.9%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=9237,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=2464KiB/s (2523kB/s), 2464KiB/s-2464KiB/s (2523kB/s-2523kB/s), io=36.1MiB (37.9MB), run=15001-15001msec
Disk stats (read/write):
sdd: ios=9687/2, merge=0/1, ticks=67248/2040, in_queue=56248, util=99.46%
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=49: Thu Jan 24 13:10:04 2019
write: IOPS=439, BW=1757KiB/s (1799kB/s)(26.4MiB/15373msec)
slat (usec): min=6, max=6775, avg=46.29, stdev=128.35
clat (msec): min=1, max=1160, avg= 9.05, stdev=57.25
lat (msec): min=1, max=1160, avg= 9.09, stdev=57.24
clat percentiles (usec):
| 1.00th=[ 1896], 5.00th=[ 2128], 10.00th=[ 2288], 20.00th=[ 2448],
| 30.00th=[ 2576], 40.00th=[ 2768], 50.00th=[ 2960], 60.00th=[ 3280],
| 70.00th=[ 3952], 80.00th=[ 5600], 90.00th=[10944], 95.00th=[23680],
| 99.00th=[46848], 99.50th=[77312], 99.90th=[1056768], 99.95th=[1155072],
| 99.99th=[1155072]
lat (msec) : 2=2.27%, 4=68.13%, 10=18.58%, 20=5.17%, 50=5.19%
lat (msec) : 100=0.36%, 750=0.06%, 1000=0.18%, 2000=0.12%
cpu : usr=0.72%, sys=1.35%, ctx=6317, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=118.3%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,6749,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=1757KiB/s (1799kB/s), 1757KiB/s-1757KiB/s (1799kB/s-1799kB/s), io=26.4MiB (27.7MB), run=15373-15373msec
Disk stats (read/write):
sdd: ios=0/7980, merge=0/0, ticks=0/64152, in_queue=56828, util=99.66%
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=57: Thu Jan 24 13:15:27 2019
read: IOPS=1, BW=2187KiB/s (2239kB/s)(61.0MiB/28563msec)
cpu : usr=0.00%, sys=0.01%, ctx=72, majf=0, minf=0
IO depths : 1=2.2%, 2=4.3%, 4=8.7%, 8=17.4%, 16=102.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=46,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Thu Jan 24 13:15:27 2019
read: IOPS=1, BW=1912KiB/s (1958kB/s)(55.0MiB/29456msec)
cpu : usr=0.00%, sys=0.01%, ctx=63, majf=0, minf=0
IO depths : 1=2.5%, 2=5.0%, 4=10.0%, 8=20.0%, 16=117.5%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=40,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Thu Jan 24 13:15:27 2019
read: IOPS=1, BW=2063KiB/s (2113kB/s)(61.0MiB/30277msec)
cpu : usr=0.00%, sys=0.01%, ctx=84, majf=0, minf=0
IO depths : 1=2.2%, 2=4.3%, 4=8.7%, 8=17.4%, 16=102.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=46,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=60: Thu Jan 24 13:15:27 2019
read: IOPS=1, BW=2181KiB/s (2234kB/s)(61.0MiB/28634msec)
cpu : usr=0.00%, sys=0.01%, ctx=74, majf=0, minf=0
IO depths : 1=2.2%, 2=4.3%, 4=8.7%, 8=17.4%, 16=102.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=46,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=8049KiB/s (8243kB/s), 1912KiB/s-2187KiB/s (1958kB/s-2239kB/s), io=238MiB (250MB), run=28563-30277msec
Disk stats (read/write):
sdd: ios=246/7, merge=0/44, ticks=1869724/77468, in_queue=995304, util=99.11%
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=68: Thu Jan 24 13:15:59 2019
write: IOPS=5, BW=6213KiB/s (6362kB/s)(170MiB/28018msec)
cpu : usr=0.21%, sys=0.05%, ctx=241, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.6%, 8=5.2%, 16=112.9%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,155,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Thu Jan 24 13:15:59 2019
write: IOPS=5, BW=6005KiB/s (6149kB/s)(162MiB/27624msec)
cpu : usr=0.23%, sys=0.03%, ctx=243, majf=0, minf=0
IO depths : 1=0.7%, 2=1.4%, 4=2.7%, 8=5.4%, 16=119.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,147,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Thu Jan 24 13:15:59 2019
write: IOPS=5, BW=6611KiB/s (6769kB/s)(169MiB/26178msec)
cpu : usr=0.23%, sys=0.04%, ctx=253, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.6%, 8=5.2%, 16=113.6%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,154,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=71: Thu Jan 24 13:15:59 2019
write: IOPS=5, BW=6145KiB/s (6292kB/s)(172MiB/28662msec)
cpu : usr=0.23%, sys=0.03%, ctx=261, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=111.5%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,157,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=23.5MiB/s (24.7MB/s), 6005KiB/s-6611KiB/s (6149kB/s-6769kB/s), io=673MiB (706MB), run=26178-28662msec
Disk stats (read/write):
sdd: ios=0/757, merge=0/0, ticks=0/1836152, in_queue=940052, util=99.76%
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=79: Thu Jan 24 13:16:42 2019
read: IOPS=432, BW=1741KiB/s (1783kB/s)(25.8MiB/15159msec)
write: IOPS=141, BW=571KiB/s (585kB/s)(8660KiB/15159msec)
cpu : usr=0.59%, sys=1.41%, ctx=9868, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=6549,2150,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=1741KiB/s (1783kB/s), 1741KiB/s-1741KiB/s (1783kB/s-1783kB/s), io=25.8MiB (27.3MB), run=15159-15159msec
WRITE: bw=571KiB/s (585kB/s), 571KiB/s-571KiB/s (585kB/s-585kB/s), io=8660KiB (8868kB), run=15159-15159msec
Disk stats (read/write):
sdd: ios=6521/2136, merge=0/2, ticks=2065136/697440, in_queue=1331436, util=99.98%
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 890/330. BW: 12.5MiB/s / 3395KiB/s
Average Latency (usec) Read/Write: 6497.02/
Sequential Read/Write: 8049KiB/s / 23.5MiB/s
Mixed Random Read/Write IOPS: 432/141
Raw
dbench-openebs-10g-cstor-3-replicas.log
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=8: Thu Jan 24 09:24:13 2019
read: IOPS=1351, BW=5425KiB/s (5555kB/s)(79.8MiB/15043msec)
cpu : usr=0.96%, sys=2.60%, ctx=18011, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=106.7%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=20338,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=5425KiB/s (5555kB/s), 5425KiB/s-5425KiB/s (5555kB/s-5555kB/s), io=79.8MiB (83.6MB), run=15043-15043msec
Disk stats (read/write):
sdd: ios=21644/6, merge=0/0, ticks=1085480/608, in_queue=531600, util=99.58%
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=16: Thu Jan 24 09:24:31 2019
write: IOPS=715, BW=2878KiB/s (2948kB/s)(43.9MiB/15579msec)
cpu : usr=0.59%, sys=1.13%, ctx=7341, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=116.5%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,11148,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=2878KiB/s (2948kB/s), 2878KiB/s-2878KiB/s (2948kB/s-2948kB/s), io=43.9MiB (45.1MB), run=15579-15579msec
Disk stats (read/write):
sdd: ios=0/13021, merge=0/18, ticks=0/1111944, in_queue=547096, util=99.59%
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=24: Thu Jan 24 09:24:49 2019
read: IOPS=187, BW=23.1MiB/s (25.2MB/s)(370MiB/15454msec)
cpu : usr=0.34%, sys=0.47%, ctx=3747, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.6%, 32=1.1%, >=64=106.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=2898,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=23.1MiB/s (25.2MB/s), 23.1MiB/s-23.1MiB/s (25.2MB/s-25.2MB/s), io=370MiB (388MB), run=15454-15454msec
Disk stats (read/write):
sdd: ios=3097/6, merge=2/0, ticks=1094440/3856, in_queue=536496, util=99.57%
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=32: Thu Jan 24 09:25:19 2019
write: IOPS=18, BW=2613KiB/s (2675kB/s)(69.9MiB/27386msec)
cpu : usr=0.14%, sys=0.05%, ctx=523, majf=0, minf=1
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.5%, >=64=180.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,496,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=2613KiB/s (2675kB/s), 2613KiB/s-2613KiB/s (2675kB/s-2675kB/s), io=69.9MiB (73.3MB), run=27386-27386msec
Disk stats (read/write):
sdd: ios=0/965, merge=0/2, ticks=0/1643612, in_queue=904792, util=99.84%
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=40: Thu Jan 24 09:25:42 2019
read: IOPS=114, BW=458KiB/s (468kB/s)(9332KiB/20397msec)
slat (usec): min=5, max=875, avg=28.82, stdev=33.97
clat (msec): min=1, max=8155, avg=37.07, stdev=411.47
lat (msec): min=1, max=8155, avg=37.10, stdev=411.47
clat percentiles (usec):
| 1.00th=[ 1896], 5.00th=[ 2192], 10.00th=[ 2416], 20.00th=[ 2736],
| 30.00th=[ 3024], 40.00th=[ 3344], 50.00th=[ 3856], 60.00th=[ 4640],
| 70.00th=[ 6048], 80.00th=[10176], 90.00th=[27008], 95.00th=[30848],
| 99.00th=[78336], 99.50th=[1351680], 99.90th=[8159232], 99.95th=[8159232],
| 99.99th=[8159232]
lat (msec) : 2=2.36%, 4=49.96%, 10=27.64%, 20=5.79%, 50=13.09%
lat (msec) : 100=0.34%, 250=0.09%, 500=0.09%, 750=0.13%, 2000=0.26%
lat (msec) : >=2000=0.39%
cpu : usr=0.07%, sys=0.50%, ctx=2260, majf=0, minf=2
IO depths : 1=0.1%, 2=0.1%, 4=100.1%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=2330,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=458KiB/s (468kB/s), 458KiB/s-458KiB/s (468kB/s-468kB/s), io=9332KiB (9556kB), run=20397-20397msec
Disk stats (read/write):
sdd: ios=2333/4, merge=0/2, ticks=71960/12352, in_queue=97036, util=99.74%
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=48: Thu Jan 24 09:26:00 2019
write: IOPS=8, BW=34.1KiB/s (35.9kB/s)(536KiB/15325msec)
slat (usec): min=6, max=210, avg=41.91, stdev=37.52
clat (msec): min=236, max=1227, avg=466.70, stdev=163.63
lat (msec): min=236, max=1227, avg=466.74, stdev=163.63
clat percentiles (msec):
| 1.00th=[ 239], 5.00th=[ 258], 10.00th=[ 297], 20.00th=[ 351],
| 30.00th=[ 379], 40.00th=[ 412], 50.00th=[ 445], 60.00th=[ 461],
| 70.00th=[ 490], 80.00th=[ 545], 90.00th=[ 676], 95.00th=[ 816],
| 99.00th=[ 898], 99.50th=[ 1221], 99.90th=[ 1221], 99.95th=[ 1221],
| 99.99th=[ 1221]
lat (msec) : 250=3.05%, 500=71.76%, 750=17.56%, 1000=9.16%, 2000=0.76%
cpu : usr=0.00%, sys=0.05%, ctx=116, majf=0, minf=2
IO depths : 1=0.8%, 2=1.5%, 4=109.9%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,131,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=34.1KiB/s (35.9kB/s), 34.1KiB/s-34.1KiB/s (35.9kB/s-35.9kB/s), io=536KiB (549kB), run=15325-15325msec
Disk stats (read/write):
sdd: ios=0/152, merge=0/2, ticks=0/83404, in_queue=67108, util=100.00%
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=56: Thu Jan 24 09:37:15 2019
read: IOPS=1, BW=2328KiB/s (2384kB/s)(61.0MiB/26832msec)
cpu : usr=0.00%, sys=0.01%, ctx=67, majf=0, minf=0
IO depths : 1=2.2%, 2=4.3%, 4=8.7%, 8=17.4%, 16=102.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=46,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=57: Thu Jan 24 09:37:15 2019
read: IOPS=1, BW=1818KiB/s (1861kB/s)(55.0MiB/30987msec)
cpu : usr=0.00%, sys=0.01%, ctx=61, majf=0, minf=0
IO depths : 1=2.5%, 2=5.0%, 4=10.0%, 8=20.0%, 16=117.5%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=40,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Thu Jan 24 09:37:15 2019
read: IOPS=1, BW=1985KiB/s (2033kB/s)(60.0MiB/30949msec)
cpu : usr=0.00%, sys=0.01%, ctx=68, majf=0, minf=0
IO depths : 1=2.2%, 2=4.4%, 4=8.9%, 8=17.8%, 16=104.4%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=45,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Thu Jan 24 09:37:15 2019
read: IOPS=1, BW=2343KiB/s (2399kB/s)(61.0MiB/26657msec)
cpu : usr=0.00%, sys=0.01%, ctx=68, majf=0, minf=0
IO depths : 1=2.2%, 2=4.3%, 4=8.7%, 8=17.4%, 16=102.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.9%, 8=0.0%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=46,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=7832KiB/s (8020kB/s), 1818KiB/s-2343KiB/s (1861kB/s-2399kB/s), io=237MiB (249MB), run=26657-30987msec
Disk stats (read/write):
sdd: ios=245/7, merge=0/44, ticks=2087024/47232, in_queue=1099876, util=99.39%
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=67: Thu Jan 24 09:38:38 2019
write: IOPS=1, BW=1391KiB/s (1424kB/s)(109MiB/80264msec)
cpu : usr=0.04%, sys=0.01%, ctx=134, majf=0, minf=0
IO depths : 1=1.1%, 2=2.1%, 4=4.3%, 8=8.5%, 16=118.1%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,94,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=68: Thu Jan 24 09:38:38 2019
write: IOPS=1, BW=1392KiB/s (1426kB/s)(97.0MiB/71340msec)
cpu : usr=0.03%, sys=0.02%, ctx=129, majf=0, minf=0
IO depths : 1=1.2%, 2=2.4%, 4=4.9%, 8=9.8%, 16=135.4%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,82,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Thu Jan 24 09:38:38 2019
write: IOPS=1, BW=1401KiB/s (1434kB/s)(109MiB/79694msec)
cpu : usr=0.05%, sys=0.00%, ctx=145, majf=0, minf=0
IO depths : 1=1.1%, 2=2.1%, 4=4.3%, 8=8.5%, 16=118.1%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,94,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Thu Jan 24 09:38:38 2019
write: IOPS=1, BW=1613KiB/s (1651kB/s)(109MiB/69216msec)
cpu : usr=0.05%, sys=0.01%, ctx=140, majf=0, minf=0
IO depths : 1=1.1%, 2=2.1%, 4=4.3%, 8=8.5%, 16=118.1%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.9%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,94,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=5409KiB/s (5539kB/s), 1391KiB/s-1613KiB/s (1424kB/s-1651kB/s), io=424MiB (445MB), run=69216-80264msec
Disk stats (read/write):
sdd: ios=0/506, merge=0/2, ticks=0/4177208, in_queue=2422872, util=100.00%
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=78: Thu Jan 24 09:38:56 2019
read: IOPS=185, BW=756KiB/s (774kB/s)(11.2MiB/15100msec)
write: IOPS=64, BW=261KiB/s (267kB/s)(3936KiB/15100msec)
cpu : usr=0.15%, sys=0.74%, ctx=3973, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=2803,971,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=756KiB/s (774kB/s), 756KiB/s-756KiB/s (774kB/s-774kB/s), io=11.2MiB (11.7MB), run=15100-15100msec
WRITE: bw=261KiB/s (267kB/s), 261KiB/s-261KiB/s (267kB/s-267kB/s), io=3936KiB (4030kB), run=15100-15100msec
Disk stats (read/write):
sdd: ios=2772/959, merge=0/0, ticks=834204/272848, in_queue=541088, util=99.64%
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 1351/715. BW: 23.1MiB/s / 2613KiB/s
Average Latency (usec) Read/Write: 37.10/466.74
Sequential Read/Write: 7832KiB/s / 5409KiB/s
Mixed Random Read/Write IOPS: 185/64
Raw
dbench-openebs-mayastor
Working dir: /data
Testing Read IOPS...
read_iops: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_iops: Laying out IO file(s) (1 file(s) / 2048MiB)
read_iops: (groupid=0, jobs=1): err= 0: pid=8: Wed Aug 19 14:54:58 2020
read: IOPS=11.4k, BW=44.3MiB/s (46.5MB/s)(665MiB/15025msec)
cpu : usr=3.13%, sys=12.77%, ctx=49905, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.6%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=170148,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=44.3MiB/s (46.5MB/s), 44.3MiB/s-44.3MiB/s (46.5MB/s-46.5MB/s), io=665MiB (697MB), run=15025-15025msec
Disk stats (read/write):
sdd: ios=193145/24, merge=6/0, ticks=957152/1208, in_queue=495144, util=97.28%
Testing Write IOPS...
write_iops: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_iops: (groupid=0, jobs=1): err= 0: pid=16: Wed Aug 19 14:55:16 2020
write: IOPS=3137, BW=12.3MiB/s (12.9MB/s)(184MiB/15008msec)
cpu : usr=1.43%, sys=4.06%, ctx=19968, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.2%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,47091,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=12.3MiB/s (12.9MB/s), 12.3MiB/s-12.3MiB/s (12.9MB/s-12.9MB/s), io=184MiB (193MB), run=15008-15008msec
Disk stats (read/write):
sdd: ios=0/53323, merge=0/6, ticks=0/1034668, in_queue=513140, util=97.77%
Testing Read Bandwidth...
read_bw: (g=0): rw=randread, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
read_bw: (groupid=0, jobs=1): err= 0: pid=24: Wed Aug 19 14:55:33 2020
read: IOPS=704, BW=88.6MiB/s (92.9MB/s)(1336MiB/15086msec)
cpu : usr=0.40%, sys=1.43%, ctx=6834, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=113.9%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=10621,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=88.6MiB/s (92.9MB/s), 88.6MiB/s-88.6MiB/s (92.9MB/s-92.9MB/s), io=1336MiB (1400MB), run=15086-15086msec
Disk stats (read/write):
sdd: ios=12037/20, merge=47/0, ticks=1072516/3816, in_queue=528728, util=99.65%
Testing Write Bandwidth...
write_bw: (g=0): rw=randwrite, bs=128KiB-128KiB,128KiB-128KiB,128KiB-128KiB, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
write_bw: (groupid=0, jobs=1): err= 0: pid=32: Wed Aug 19 14:55:51 2020
write: IOPS=234, BW=29.9MiB/s (31.3MB/s)(459MiB/15406msec)
cpu : usr=1.08%, sys=0.62%, ctx=2576, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=113.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=0,3612,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=29.9MiB/s (31.3MB/s), 29.9MiB/s-29.9MiB/s (31.3MB/s-31.3MB/s), io=459MiB (482MB), run=15406-15406msec
Disk stats (read/write):
sdd: ios=0/4139, merge=0/13, ticks=0/1084520, in_queue=533168, util=99.58%
Testing Read Latency...
read_latency: (g=0): rw=randread, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
read_latency: (groupid=0, jobs=1): err= 0: pid=40: Wed Aug 19 14:56:09 2020
read: IOPS=2771, BW=10.9MiB/s (11.4MB/s)(162MiB/15002msec)
slat (usec): min=6, max=34361, avg=29.33, stdev=325.46
clat (usec): min=9, max=59940, avg=1407.32, stdev=1918.86
lat (usec): min=263, max=60827, avg=1437.66, stdev=1976.73
clat percentiles (usec):
| 1.00th=[ 394], 5.00th=[ 502], 10.00th=[ 588], 20.00th=[ 724],
| 30.00th=[ 828], 40.00th=[ 940], 50.00th=[ 1064], 60.00th=[ 1208],
| 70.00th=[ 1400], 80.00th=[ 1704], 90.00th=[ 2224], 95.00th=[ 2864],
| 99.00th=[ 6944], 99.50th=[11840], 99.90th=[31360], 99.95th=[39168],
| 99.99th=[52992]
lat (usec) : 10=0.01%, 50=0.01%, 250=0.06%, 500=4.92%, 750=17.32%
lat (usec) : 1000=23.07%
lat (msec) : 2=41.10%, 4=11.26%, 10=1.65%, 20=0.39%, 50=0.21%
lat (msec) : 100=0.01%
cpu : usr=2.33%, sys=6.07%, ctx=69954, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=114.7%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=41582,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
READ: bw=10.9MiB/s (11.4MB/s), 10.9MiB/s-10.9MiB/s (11.4MB/s-11.4MB/s), io=162MiB (170MB), run=15002-15002msec
Disk stats (read/write):
sdd: ios=47661/25, merge=0/0, ticks=61596/992, in_queue=47936, util=93.40%
Testing Write Latency...
write_latency: (g=0): rw=randwrite, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=4
fio-2.17-45-g06cb
Starting 1 process
write_latency: (groupid=0, jobs=1): err= 0: pid=48: Wed Aug 19 14:56:26 2020
write: IOPS=1019, BW=4079KiB/s (4177kB/s)(59.8MiB/15004msec)
slat (usec): min=7, max=69488, avg=56.26, stdev=761.90
clat (usec): min=138, max=60291, avg=3865.46, stdev=3171.61
lat (msec): min=1, max=60, avg= 3.92, stdev= 3.20
clat percentiles (usec):
| 1.00th=[ 1928], 5.00th=[ 2192], 10.00th=[ 2384], 20.00th=[ 2608],
| 30.00th=[ 2832], 40.00th=[ 3024], 50.00th=[ 3248], 60.00th=[ 3536],
| 70.00th=[ 3856], 80.00th=[ 4256], 90.00th=[ 5152], 95.00th=[ 6560],
| 99.00th=[16512], 99.50th=[30848], 99.90th=[40192], 99.95th=[46336],
| 99.99th=[54528]
lat (usec) : 250=0.09%, 750=0.01%, 1000=0.01%
lat (msec) : 2=1.56%, 4=72.09%, 10=24.20%, 20=1.20%, 50=0.84%
lat (msec) : 100=0.02%
cpu : usr=0.99%, sys=2.31%, ctx=23703, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=113.4%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,15299,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
Run status group 0 (all jobs):
WRITE: bw=4079KiB/s (4177kB/s), 4079KiB/s-4079KiB/s (4177kB/s-4177kB/s), io=59.8MiB (62.7MB), run=15004-15004msec
Disk stats (read/write):
sdd: ios=0/17368, merge=0/2, ticks=0/64092, in_queue=48784, util=93.97%
Testing Read Sequential Speed...
read_seq: (g=0): rw=read, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
read_seq: Laying out IO file(s) (1 file(s) / 3548MiB)
read_seq: (groupid=0, jobs=1): err= 0: pid=56: Wed Aug 19 14:58:44 2020
read: IOPS=21, BW=22.2MiB/s (23.3MB/s)(406MiB/18298msec)
cpu : usr=0.02%, sys=0.11%, ctx=239, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=110.2%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=391,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=57: Wed Aug 19 14:58:44 2020
read: IOPS=21, BW=22.3MiB/s (23.4MB/s)(409MiB/18361msec)
cpu : usr=0.02%, sys=0.11%, ctx=230, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=109.4%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=394,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=58: Wed Aug 19 14:58:44 2020
read: IOPS=21, BW=22.4MiB/s (23.5MB/s)(411MiB/18400msec)
cpu : usr=0.00%, sys=0.14%, ctx=254, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=108.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=396,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
read_seq: (groupid=0, jobs=1): err= 0: pid=59: Wed Aug 19 14:58:44 2020
read: IOPS=21, BW=22.3MiB/s (23.4MB/s)(413MiB/18564msec)
cpu : usr=0.00%, sys=0.13%, ctx=244, majf=0, minf=0
IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=108.3%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.2%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=398,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=88.3MiB/s (92.6MB/s), 22.2MiB/s-22.4MiB/s (23.3MB/s-23.5MB/s), io=1639MiB (1719MB), run=18298-18564msec
Disk stats (read/write):
sdd: ios=962/24, merge=821/0, ticks=669436/4380, in_queue=616636, util=97.57%
Testing Write Sequential Speed...
write_seq: (g=0): rw=write, bs=1024KiB-1024KiB,1024KiB-1024KiB,1024KiB-1024KiB, ioengine=libaio, iodepth=16
...
fio-2.17-45-g06cb
Starting 4 threads
write_seq: (groupid=0, jobs=1): err= 0: pid=67: Wed Aug 19 14:59:09 2020
write: IOPS=7, BW=8250KiB/s (8448kB/s)(172MiB/21350msec)
cpu : usr=0.18%, sys=0.09%, ctx=118, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=111.5%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,157,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=68: Wed Aug 19 14:59:09 2020
write: IOPS=7, BW=8081KiB/s (8275kB/s)(169MiB/21415msec)
cpu : usr=0.15%, sys=0.11%, ctx=124, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.6%, 8=5.2%, 16=113.6%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,154,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=69: Wed Aug 19 14:59:09 2020
write: IOPS=7, BW=8167KiB/s (8363kB/s)(173MiB/21690msec)
cpu : usr=0.18%, sys=0.09%, ctx=127, majf=0, minf=0
IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=110.8%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,158,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
write_seq: (groupid=0, jobs=1): err= 0: pid=70: Wed Aug 19 14:59:09 2020
write: IOPS=7, BW=8113KiB/s (8308kB/s)(177MiB/22341msec)
cpu : usr=0.20%, sys=0.06%, ctx=119, majf=0, minf=0
IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=4.9%, 16=108.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.6%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,162,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=30.1MiB/s (32.5MB/s), 8081KiB/s-8250KiB/s (8275kB/s-8448kB/s), io=691MiB (725MB), run=21350-22341msec
Disk stats (read/write):
sdd: ios=0/435, merge=0/340, ticks=0/769792, in_queue=704496, util=99.64%
Testing Read/Write Mixed...
rw_mix: (g=0): rw=randrw, bs=4096B-4096B,4096B-4096B,4096B-4096B, ioengine=libaio, iodepth=64
fio-2.17-45-g06cb
Starting 1 process
rw_mix: (groupid=0, jobs=1): err= 0: pid=78: Wed Aug 19 14:59:26 2020
read: IOPS=5700, BW=22.3MiB/s (23.4MB/s)(334MiB/15006msec)
write: IOPS=1878, BW=7520KiB/s (7701kB/s)(110MiB/15006msec)
cpu : usr=2.53%, sys=8.60%, ctx=30771, majf=0, minf=1
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=113.8%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwt: total=85537,28187,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=22.3MiB/s (23.4MB/s), 22.3MiB/s-22.3MiB/s (23.4MB/s-23.4MB/s), io=334MiB (351MB), run=15006-15006msec
WRITE: bw=7520KiB/s (7701kB/s), 7520KiB/s-7520KiB/s (7701kB/s-7701kB/s), io=110MiB (116MB), run=15006-15006msec
Disk stats (read/write):
sdd: ios=97318/32122, merge=2/2, ticks=676576/330576, in_queue=504240, util=98.44%
All tests complete.
==================
= Dbench Summary =
==================
Random Read/Write IOPS: 11.4k/3137. BW: 88.6MiB/s / 29.9MiB/s
Average Latency (usec) Read/Write: 1437.66/
Sequential Read/Write: 88.3MiB/s / 30.1MiB/s
Mixed Random Read/Write IOPS: 5700/1878
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment