Skip to content

Instantly share code, notes, and snippets.

@Zate
Created September 20, 2020 21:58
Show Gist options
  • Save Zate/104a4d7dfa0b98c96a08624e2bf8aecc to your computer and use it in GitHub Desktop.
Save Zate/104a4d7dfa0b98c96a08624e2bf8aecc to your computer and use it in GitHub Desktop.
Splunk IOPS Testing
fio --time_based --name=4k_benchmark --size=10G --runtime=30 --filename=/opt/splunk/test --ioengine=libaio --randrepeat=0 --iodepth=128 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=4 --rw=randread --blocksize=4k --group_reporting
4k_benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=128
@Zate
Copy link
Author

Zate commented Sep 27, 2022

sudo fio --time_based --name=4k_benchmark --size=5G --runtime=3
0 --filename=/opt/splunk/test --ioengine=libaio --randrepeat=0 --iodepth=128 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=4 --rw=randread --blocksize=4k --group_reporting

sudo fio --time_based --name=4k_benchmark --size=5G --runtime=3
0 --filename=/opt/splunk/test --ioengine=libaio --randrepeat=0 --iodepth=128 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=4 --rw=randread --blocksize=4k --group_reporting
4k_benchmark: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128
...
fio-3.25
Starting 4 processes
4k_benchmark: Laying out IO file (1 file / 5120MiB)
Jobs: 4 (f=4): [r(4)][100.0%][r=62.9MiB/s][r=16.1k IOPS][eta 00m:00s]
4k_benchmark: (groupid=0, jobs=4): err= 0: pid=970: Tue Sep 27 17:11:14 2022
read: IOPS=18.8k, BW=73.6MiB/s (77.1MB/s)(2209MiB/30027msec)
slat (usec): min=3, max=74615, avg=73.02, stdev=982.67
clat (usec): min=48, max=126097, avg=27108.42, stdev=12993.84
lat (usec): min=67, max=126101, avg=27181.64, stdev=12999.11
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 10], 10.00th=[ 14], 20.00th=[ 17],
| 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 29],
| 70.00th=[ 33], 80.00th=[ 37], 90.00th=[ 44], 95.00th=[ 52],
| 99.00th=[ 68], 99.50th=[ 74], 99.90th=[ 96], 99.95th=[ 104],
| 99.99th=[ 115]
bw ( KiB/s): min=53233, max=90882, per=100.00%, avg=75465.39, stdev=1888.33, samples=236
iops : min=13307, max=22720, avg=18865.78, stdev=472.10, samples=236
lat (usec) : 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.02%
lat (usec) : 1000=0.09%
lat (msec) : 2=0.18%, 4=0.55%, 10=4.77%, 20=26.40%, 50=62.55%
lat (msec) : 100=5.34%, 250=0.08%
cpu : usr=2.04%, sys=15.80%, ctx=70598, majf=0, minf=565
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
issued rwts: total=565517,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=128

Run status group 0 (all jobs):
READ: bw=73.6MiB/s (77.1MB/s), 73.6MiB/s-73.6MiB/s (77.1MB/s-77.1MB/s), io=2209MiB (2316MB), run=30027-30027msec

@Zate
Copy link
Author

Zate commented Sep 28, 2022

sudo fio --time_based --name=4k_benchmark --size=5G --runtime=30 --filename=/opt/test --ioengine=libaio --randrepeat=0 --iodepth=128 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=10 --rw=randread --blocksize=4k --group_reporting

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment