$ runc --version
runc version 1.0.0-rc4+dev
commit: f53ad9cec928821a25c2a74eb8bd95558f8cf152-dirty
spec: 1.0.0
$ containerd --version
containerd github.com/containerd/containerd v1.0.0-beta.3-86-g9649a42 9649a428e8c470cddc0d5a3c394f36111f940adc
$ cri-containerd version
1.0.0-alpha.1-68-ga1ac0c4
$ crio --version
crio version 1.9.0-dev
commit: "6c8ab88e9eb6323a2c7744ee0c592ae9b298dfb4-dirty"
$ uname -a
Linux kunal-HP-Z400-Workstation 4.4.0-98-generic #121-Ubuntu SMP Tue Oct 10 14:24:03 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
$ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Thread(s) per core: 1
Core(s) per socket: 4
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 26
Model name: Intel(R) Xeon(R) CPU W3520 @ 2.67GHz
Stepping: 5
CPU MHz: 1596.000
CPU max MHz: 2661.0000
CPU min MHz: 1596.0000
BogoMIPS: 5332.91
Virtualization: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 8192K
NUMA node0 CPU(s): 0-3
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm tpr_shadow vnmi flexpriority ept vpid dtherm ida
$ sudo ./bucketbench run -b examples/ctrd.yaml
SUMMARY TIMINGS/THREAD RATES
Iter/Thd 1 thrd 2 thrds 3 thrds 4 thrds 5 thrds 6 thrds 7 thrds 8 thrds 9 thrds 10 thrds
Limit 1000 709.88 1542.14 2171.41 2063.05 2025.49 1879.84 1741.97 1696.53 1650.72 1691.56
CtrdOnly:Containerd 1 2.00 2.73 3.11 2.95 3.16
DETAILED COMMAND TIMINGS/STATISTICS
CtrdOnly:Containerd:1 Min Max Avg Median Stddev Errors
run 294.00 294.00 294.00 294.00 0.00 0
stop 103.00 103.00 103.00 103.00 0.00 0
delete 100.00 100.00 100.00 100.00 0.00 0
CtrdOnly:Containerd:2 Min Max Avg Median Stddev Errors
run 388.00 419.00 403.50 403.50 15.50 0
stop 99.00 102.00 100.50 100.50 1.50 0
delete 174.00 212.00 193.00 193.00 19.00 0
CtrdOnly:Containerd:3 Min Max Avg Median Stddev Errors
run 473.00 564.00 509.67 492.00 39.19 0
stop 83.00 95.00 89.00 89.00 4.90 0
delete 203.00 340.00 286.00 315.00 59.57 0
CtrdOnly:Containerd:4 Min Max Avg Median Stddev Errors
run 579.00 830.00 678.00 651.50 94.63 0
stop 96.00 110.00 101.50 100.00 5.36 0
delete 249.00 485.00 383.50 400.00 87.49 0
CtrdOnly:Containerd:5 Min Max Avg Median Stddev Errors
run 655.00 943.00 757.00 759.00 103.44 0
stop 91.00 127.00 115.80 120.00 12.70 0
delete 264.00 662.00 508.40 545.00 132.95 0
$ sudo ./bucketbench run -b examples/cri-containerd.yaml
SUMMARY TIMINGS/THREAD RATES
Iter/Thd 1 thrd 2 thrds 3 thrds 4 thrds 5 thrds 6 thrds 7 thrds 8 thrds 9 thrds 10 thrds
Limit 1000 663.49 1367.11 1493.41 1334.11 1371.14 1361.02 1258.04 1226.86 1186.53 1209.31
CRIContainerd:CRI 1 0.14 0.25 0.35 0.44 0.49
DETAILED COMMAND TIMINGS/STATISTICS
CRIContainerd:CRI:1 Min Max Avg Median Stddev Errors
run 303.00 303.00 303.00 303.00 0.00 0
stop 220.00 220.00 220.00 220.00 0.00 0
delete 243.00 243.00 243.00 243.00 0.00 0
CRIContainerd:CRI:2 Min Max Avg Median Stddev Errors
run 501.00 547.00 524.00 524.00 23.00 0
stop 257.00 259.00 258.00 258.00 1.00 0
delete 399.00 426.00 412.50 412.50 13.50 0
CRIContainerd:CRI:3 Min Max Avg Median Stddev Errors
run 423.00 648.00 570.00 639.00 104.01 0
stop 227.00 236.00 230.67 229.00 3.86 0
delete 410.00 824.00 557.00 437.00 189.12 0
CRIContainerd:CRI:4 Min Max Avg Median Stddev Errors
run 432.00 593.00 502.25 492.00 62.11 0
stop 212.00 262.00 230.50 224.00 20.12 0
delete 257.00 753.00 529.75 554.50 197.77 0
CRIContainerd:CRI:5 Min Max Avg Median Stddev Errors
run 498.00 992.00 749.20 821.00 182.47 0
stop 210.00 252.00 231.40 242.00 17.45 0
delete 306.00 1357.00 837.60 921.00 426.53 0
$ sudo ./bucketbench run -b examples/crio.yaml
SUMMARY TIMINGS/THREAD RATES
Iter/Thd 1 thrd 2 thrds 3 thrds 4 thrds 5 thrds 6 thrds 7 thrds 8 thrds 9 thrds 10 thrds
Limit 1000 705.23 1579.17 2022.65 1493.93 1394.92 1375.05 1345.36 1574.97 1534.90 1558.08
CRICrio:CRI 1 0.08 0.13 0.18 0.23 0.26
DETAILED COMMAND TIMINGS/STATISTICS
CRICrio:CRI:1 Min Max Avg Median Stddev Errors
run 461.00 461.00 461.00 461.00 0.00 0
stop 635.00 635.00 635.00 635.00 0.00 0
delete 446.00 446.00 446.00 446.00 0.00 0
CRICrio:CRI:2 Min Max Avg Median Stddev Errors
run 463.00 648.00 555.50 555.50 92.50 0
stop 840.00 933.00 886.50 886.50 46.50 0
delete 437.00 474.00 455.50 455.50 18.50 0
CRICrio:CRI:3 Min Max Avg Median Stddev Errors
run 471.00 1440.00 853.67 650.00 420.99 0
stop 708.00 910.00 822.00 848.00 84.49 0
delete 446.00 859.00 623.33 565.00 173.58 0
CRICrio:CRI:4 Min Max Avg Median Stddev Errors
run 498.00 1326.00 914.50 917.00 297.27 0
stop 892.00 1669.00 1208.00 1135.50 287.64 0
delete 420.00 1104.00 866.00 970.00 264.34 0
CRICrio:CRI:5 Min Max Avg Median Stddev Errors
run 473.00 2062.00 1171.20 1182.00 574.82 0
stop 1122.00 1915.00 1380.40 1171.00 306.87 0
delete 405.00 1460.00 883.40 879.00 340.70 0
Runtime Comparison Charts