Skip to content

Instantly share code, notes, and snippets.

@de-sh

de-sh/randread_fio.log Secret

Last active August 12, 2020 12:04
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save de-sh/92f1ca7d50675e07ea77d726b4764ec3 to your computer and use it in GitHub Desktop.
Save de-sh/92f1ca7d50675e07ea77d726b4764ec3 to your computer and use it in GitHub Desktop.
Download ZIP
The benchmark for multiple randreads from S3 with fio
Raw
randread_fio.log
$ fio read_bench_4k.fio;fio read_bench_8.fio;fio read_bench_16k.fio;fio read_bench_32k.fio;fio read_bench_64k.fio;fio read_bench_128k.fio;fio read_bench_256k.fio;fio read_bench_512k.fio;fio read_bench_1m.fio;
read_bench_4k: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=68KiB/s][r=17 IOPS][eta 00m:00s]
read_bench_4k: (groupid=0, jobs=1): err= 0: pid=12271: Wed Aug 12 08:37:14 2020
read: IOPS=16, BW=64.9KiB/s (66.5kB/s)(100MiB/1577775msec)
clat (msec): min=34, max=1165, avg=61.61, stdev=25.02
lat (msec): min=34, max=1165, avg=61.62, stdev=25.02
clat percentiles (msec):
| 1.00th=[ 41], 5.00th=[ 45], 10.00th=[ 48], 20.00th=[ 52],
| 30.00th=[ 54], 40.00th=[ 56], 50.00th=[ 57], 60.00th=[ 59],
| 70.00th=[ 62], 80.00th=[ 66], 90.00th=[ 74], 95.00th=[ 87],
| 99.00th=[ 182], 99.50th=[ 203], 99.90th=[ 321], 99.95th=[ 384],
| 99.99th=[ 558]
bw ( KiB/s): min= 7, max= 88, per=98.61%, avg=64.43, stdev= 9.52, samples=3147
iops : min= 1, max= 22, avg=15.62, stdev= 2.43, samples=3147
lat (msec) : 50=15.53%, 100=81.44%, 250=2.82%, 500=0.19%, 750=0.01%
lat (msec) : 2000=0.01%
cpu : usr=1.79%, sys=0.51%, ctx=47221, majf=1, minf=3772
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=25600,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=64.9KiB/s (66.5kB/s), 64.9KiB/s-64.9KiB/s (66.5kB/s-66.5kB/s), io=100MiB (105MB), run=1577775-1577775msec
fio: unable to open 'read_bench_8.fio' job file
read_bench_16k: (g=0): rw=randread, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=416KiB/s][r=26 IOPS][eta 00m:00s]
read_bench_16k: (groupid=0, jobs=1): err= 0: pid=13795: Wed Aug 12 08:41:46 2020
read: IOPS=23, BW=379KiB/s (388kB/s)(100MiB/270499msec)
clat (msec): min=31, max=364, avg=42.25, stdev=23.36
lat (msec): min=31, max=364, avg=42.25, stdev=23.36
clat percentiles (msec):
| 1.00th=[ 33], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 37],
| 30.00th=[ 37], 40.00th=[ 38], 50.00th=[ 39], 60.00th=[ 39],
| 70.00th=[ 40], 80.00th=[ 41], 90.00th=[ 43], 95.00th=[ 51],
| 99.00th=[ 163], 99.50th=[ 176], 99.90th=[ 351], 99.95th=[ 359],
| 99.99th=[ 363]
bw ( KiB/s): min= 127, max= 448, per=99.85%, avg=378.51, stdev=64.25, samples=539
iops : min= 7, max= 28, avg=22.91, stdev= 4.02, samples=539
lat (msec) : 50=94.98%, 100=2.34%, 250=2.41%, 500=0.27%
cpu : usr=2.18%, sys=0.75%, ctx=7100, majf=0, minf=1155
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=6400,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=379KiB/s (388kB/s), 379KiB/s-379KiB/s (388kB/s-388kB/s), io=100MiB (105MB), run=270499-270499msec
read_bench_32k: (g=0): rw=randread, bs=(R) 32.0KiB-32.0KiB, (W) 32.0KiB-32.0KiB, (T) 32.0KiB-32.0KiB, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=832KiB/s][r=26 IOPS][eta 00m:00s]
read_bench_32k: (groupid=0, jobs=1): err= 0: pid=13915: Wed Aug 12 08:43:57 2020
read: IOPS=24, BW=787KiB/s (806kB/s)(100MiB/130127msec)
clat (msec): min=31, max=365, avg=40.65, stdev=17.91
lat (msec): min=31, max=365, avg=40.65, stdev=17.91
clat percentiles (msec):
| 1.00th=[ 33], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 37],
| 30.00th=[ 37], 40.00th=[ 38], 50.00th=[ 39], 60.00th=[ 39],
| 70.00th=[ 40], 80.00th=[ 41], 90.00th=[ 42], 95.00th=[ 46],
| 99.00th=[ 157], 99.50th=[ 174], 99.90th=[ 284], 99.95th=[ 368],
| 99.99th=[ 368]
bw ( KiB/s): min= 320, max= 896, per=99.88%, avg=786.85, stdev=94.25, samples=259
iops : min= 10, max= 28, avg=23.92, stdev= 2.97, samples=259
lat (msec) : 50=96.62%, 100=2.06%, 250=1.19%, 500=0.12%
cpu : usr=2.31%, sys=0.72%, ctx=3549, majf=0, minf=717
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=3200,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=787KiB/s (806kB/s), 787KiB/s-787KiB/s (806kB/s-806kB/s), io=100MiB (105MB), run=130127-130127msec
read_bench_64k: (g=0): rw=randread, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=1600KiB/s][r=25 IOPS][eta 00m:00s]
read_bench_64k: (groupid=0, jobs=1): err= 0: pid=13940: Wed Aug 12 08:45:03 2020
read: IOPS=24, BW=1586KiB/s (1624kB/s)(100MiB/64584msec)
clat (msec): min=31, max=359, avg=40.35, stdev=15.63
lat (msec): min=31, max=359, avg=40.35, stdev=15.63
clat percentiles (msec):
| 1.00th=[ 34], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 37],
| 30.00th=[ 37], 40.00th=[ 38], 50.00th=[ 39], 60.00th=[ 39],
| 70.00th=[ 40], 80.00th=[ 41], 90.00th=[ 43], 95.00th=[ 46],
| 99.00th=[ 138], 99.50th=[ 165], 99.90th=[ 188], 99.95th=[ 359],
| 99.99th=[ 359]
bw ( KiB/s): min= 1149, max= 1792, per=99.97%, avg=1585.57, stdev=169.26, samples=128
iops : min= 17, max= 28, avg=23.94, stdev= 2.64, samples=128
lat (msec) : 50=96.44%, 100=2.38%, 250=1.12%, 500=0.06%
cpu : usr=2.26%, sys=0.76%, ctx=1788, majf=0, minf=502
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=1600,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=1586KiB/s (1624kB/s), 1586KiB/s-1586KiB/s (1624kB/s-1624kB/s), io=100MiB (105MB), run=64584-64584msec
read_bench_128k: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=3456KiB/s][r=27 IOPS][eta 00m:00s]
read_bench_128k: (groupid=0, jobs=1): err= 0: pid=13959: Wed Aug 12 08:45:37 2020
read: IOPS=24, BW=3088KiB/s (3162kB/s)(100MiB/33162msec)
clat (msec): min=32, max=210, avg=41.42, stdev=17.49
lat (msec): min=32, max=210, avg=41.43, stdev=17.49
clat percentiles (msec):
| 1.00th=[ 34], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 37],
| 30.00th=[ 38], 40.00th=[ 39], 50.00th=[ 39], 60.00th=[ 40],
| 70.00th=[ 40], 80.00th=[ 41], 90.00th=[ 42], 95.00th=[ 46],
| 99.00th=[ 150], 99.50th=[ 167], 99.90th=[ 211], 99.95th=[ 211],
| 99.99th=[ 211]
bw ( KiB/s): min= 1788, max= 3576, per=100.00%, avg=3088.86, stdev=449.55, samples=66
iops : min= 13, max= 27, avg=23.24, stdev= 3.46, samples=66
lat (msec) : 50=96.00%, 100=1.88%, 250=2.12%
cpu : usr=2.15%, sys=0.74%, ctx=895, majf=0, minf=399
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=800,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=3088KiB/s (3162kB/s), 3088KiB/s-3088KiB/s (3162kB/s-3162kB/s), io=100MiB (105MB), run=33162-33162msec
read_bench_256k: (g=0): rw=randread, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=6400KiB/s][r=25 IOPS][eta 00m:00s]
read_bench_256k: (groupid=0, jobs=1): err= 0: pid=13973: Wed Aug 12 08:45:55 2020
read: IOPS=24, BW=6286KiB/s (6437kB/s)(100MiB/16289msec)
clat (msec): min=32, max=196, avg=40.70, stdev=13.49
lat (msec): min=32, max=196, avg=40.70, stdev=13.49
clat percentiles (msec):
| 1.00th=[ 34], 5.00th=[ 36], 10.00th=[ 37], 20.00th=[ 38],
| 30.00th=[ 39], 40.00th=[ 39], 50.00th=[ 40], 60.00th=[ 40],
| 70.00th=[ 41], 80.00th=[ 41], 90.00th=[ 43], 95.00th=[ 45],
| 99.00th=[ 73], 99.50th=[ 161], 99.90th=[ 197], 99.95th=[ 197],
| 99.99th=[ 197]
bw ( KiB/s): min= 4087, max= 7153, per=100.00%, avg=6290.69, stdev=600.96, samples=32
iops : min= 15, max= 27, avg=23.62, stdev= 2.35, samples=32
lat (msec) : 50=97.25%, 100=1.75%, 250=1.00%
cpu : usr=2.44%, sys=0.53%, ctx=452, majf=0, minf=372
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=6286KiB/s (6437kB/s), 6286KiB/s-6286KiB/s (6437kB/s-6437kB/s), io=100MiB (105MB), run=16289-16289msec
read_bench_512k: (g=0): rw=randread, bs=(R) 512KiB-512KiB, (W) 512KiB-512KiB, (T) 512KiB-512KiB, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=13.0MiB/s][r=26 IOPS][eta 00m:00s]
read_bench_512k: (groupid=0, jobs=1): err= 0: pid=13981: Wed Aug 12 08:46:04 2020
read: IOPS=24, BW=12.4MiB/s (13.0MB/s)(100MiB/8052msec)
clat (msec): min=31, max=201, avg=40.24, stdev=15.05
lat (msec): min=31, max=201, avg=40.24, stdev=15.05
clat percentiles (msec):
| 1.00th=[ 33], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 37],
| 30.00th=[ 37], 40.00th=[ 38], 50.00th=[ 39], 60.00th=[ 39],
| 70.00th=[ 40], 80.00th=[ 41], 90.00th=[ 43], 95.00th=[ 45],
| 99.00th=[ 110], 99.50th=[ 148], 99.90th=[ 203], 99.95th=[ 203],
| 99.99th=[ 203]
bw ( KiB/s): min= 8192, max=14307, per=99.95%, avg=12711.19, stdev=1746.20, samples=16
iops : min= 16, max= 27, avg=23.94, stdev= 3.26, samples=16
lat (msec) : 50=97.00%, 100=1.50%, 250=1.50%
cpu : usr=2.22%, sys=0.72%, ctx=239, majf=0, minf=405
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=200,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=12.4MiB/s (13.0MB/s), 12.4MiB/s-12.4MiB/s (13.0MB/s-13.0MB/s), io=100MiB (105MB), run=8052-8052msec
read_bench_1M: (g=0): rw=randread, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=http, iodepth=1
fio-3.21
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=24.0MiB/s][r=24 IOPS][eta 00m:00s]
read_bench_1M: (groupid=0, jobs=1): err= 0: pid=13991: Wed Aug 12 08:46:10 2020
read: IOPS=23, BW=23.5MiB/s (24.6MB/s)(100MiB/4256msec)
clat (msec): min=35, max=214, avg=42.54, stdev=17.90
lat (msec): min=35, max=214, avg=42.54, stdev=17.90
clat percentiles (msec):
| 1.00th=[ 36], 5.00th=[ 37], 10.00th=[ 38], 20.00th=[ 39],
| 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 40], 60.00th=[ 41],
| 70.00th=[ 41], 80.00th=[ 42], 90.00th=[ 45], 95.00th=[ 51],
| 99.00th=[ 64], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215],
| 99.99th=[ 215]
bw ( KiB/s): min=14307, max=26570, per=98.75%, avg=23759.62, stdev=3929.47, samples=8
iops : min= 13, max= 25, avg=22.25, stdev= 3.85, samples=8
lat (msec) : 50=94.00%, 100=5.00%, 250=1.00%
cpu : usr=2.59%, sys=0.73%, ctx=131, majf=0, minf=516
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=100,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=23.5MiB/s (24.6MB/s), 23.5MiB/s-23.5MiB/s (24.6MB/s-24.6MB/s), io=100MiB (105MB), run=4256-4256msec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment