Skip to content

Instantly share code, notes, and snippets.

@carldanley
Created February 11, 2020 17:15
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save carldanley/70aad25c83a3547a7dbc244c10013401 to your computer and use it in GitHub Desktop.
Save carldanley/70aad25c83a3547a7dbc244c10013401 to your computer and use it in GitHub Desktop.
=============================================================================================================================================
BEFORE
=============================================================================================================================================
root@k8s-master-01:/home/carldanley# fio --rw=write --ioengine=sync --fdatasync=1 --directory=test-data --size=22m --bs=2300 --name=mytest
mytest: (g=0): rw=write, bs=(R) 2300B-2300B, (W) 2300B-2300B, (T) 2300B-2300B, ioengine=sync, iodepth=1
fio-3.1
Starting 1 process
mytest: Laying out IO file (1 file / 22MiB)
Jobs: 1 (f=1): [W(1)][100.0%][r=0KiB/s,w=481KiB/s][r=0,w=214 IOPS][eta 00m:00s]
mytest: (groupid=0, jobs=1): err= 0: pid=5906: Tue Feb 11 03:34:27 2020
write: IOPS=142, BW=321KiB/s (329kB/s)(21.0MiB/70205msec)
clat (usec): min=2, max=8136, avg=13.53, stdev=198.42
lat (usec): min=3, max=8136, avg=13.85, stdev=198.43
clat percentiles (usec):
| 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 5],
| 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 10],
| 70.00th=[ 10], 80.00th=[ 11], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 25], 99.50th=[ 29], 99.90th=[ 67], 99.95th=[ 8094],
| 99.99th=[ 8160]
bw ( KiB/s): min= 8, max= 489, per=100.00%, avg=403.56, stdev=125.43, samples=111
iops : min= 4, max= 218, avg=179.90, stdev=55.86, samples=111
lat (usec) : 4=1.96%, 10=70.95%, 20=25.04%, 50=1.90%, 100=0.06%
lat (usec) : 250=0.02%
lat (msec) : 10=0.06%
cpu : usr=0.08%, sys=0.41%, ctx=15695, majf=0, minf=13
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,10029,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
WRITE: bw=321KiB/s (329kB/s), 321KiB/s-321KiB/s (329kB/s-329kB/s), io=21.0MiB (23.1MB), run=70205-70205msec
Disk stats (read/write):
sda: ios=2/22426, merge=0/12206, ticks=52/86276, in_queue=86324, util=99.15%
root@k8s-master-01:/home/carldanley# fio --version
fio-3.1
root@k8s-master-01:/home/carldanley# ^C
root@k8s-master-01:/home/carldanley# dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 2.29366 s, 468 MB/s
root@k8s-master-01:/home/carldanley# dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.75749 s, 159 MB/s
=============================================================================================================================================
AFTER (https://communities.vmware.com/thread/554004)
=============================================================================================================================================
root@k8s-master-01:/home/carldanley# fio --rw=write --ioengine=sync --fdatasync=1 --directory=test-data --size=22m --bs=2300 --name=mytest
mytest: (g=0): rw=write, bs=(R) 2300B-2300B, (W) 2300B-2300B, (T) 2300B-2300B, ioengine=sync, iodepth=1
fio-3.1
Starting 1 process
Jobs: 1 (f=1)
mytest: (groupid=0, jobs=1): err= 0: pid=1430: Tue Feb 11 12:14:08 2020
write: IOPS=5534, BW=12.1MiB/s (12.7MB/s)(21.0MiB/1812msec)
clat (usec): min=2, max=8160, avg=67.59, stdev=127.86
lat (usec): min=2, max=8161, avg=67.76, stdev=127.90
clat percentiles (usec):
| 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3],
| 30.00th=[ 3], 40.00th=[ 4], 50.00th=[ 100], 60.00th=[ 104],
| 70.00th=[ 112], 80.00th=[ 118], 90.00th=[ 125], 95.00th=[ 133],
| 99.00th=[ 147], 99.50th=[ 157], 99.90th=[ 281], 99.95th=[ 1287],
| 99.99th=[ 7046]
bw ( KiB/s): min= 5565, max=18323, per=89.47%, avg=11122.00, stdev=6535.95, samples=3
iops : min= 2478, max= 8158, avg=4952.00, stdev=2909.89, samples=3
lat (usec) : 4=41.54%, 10=1.71%, 20=0.56%, 50=0.04%, 100=5.94%
lat (usec) : 250=50.07%, 500=0.06%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.02%, 4=0.02%, 10=0.02%
cpu : usr=2.26%, sys=12.31%, ctx=15697, majf=0, minf=12
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,10029,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
WRITE: bw=12.1MiB/s (12.7MB/s), 12.1MiB/s-12.1MiB/s (12.7MB/s-12.7MB/s), io=21.0MiB (23.1MB), run=1812-1812msec
Disk stats (read/write):
sda: ios=4862/8670, merge=0/0, ticks=512/1404, in_queue=1916, util=83.34%
root@k8s-master-01:/home/carldanley# fio --version
fio-3.1
root@k8s-master-01:/home/carldanley# dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.05268 s, 1.0 GB/s
root@k8s-master-01:/home/carldanley# dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.979683 s, 1.1 GB/s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment