Skip to content

Instantly share code, notes, and snippets.

@rtsisyk
Created April 24, 2013 14:38
Show Gist options
  • Save rtsisyk/5452629 to your computer and use it in GitHub Desktop.
Save rtsisyk/5452629 to your computer and use it in GitHub Desktop.
LevelDB vs TokuKV vs KyotoCabinet vs BerkeleyDB vs NessDB
Key Len: 16
Val Len: 100
Count: 500000
----
LevelDB PUT:
Min latency : 0.957982 * 1e-6 sec/op
Avg latency : 9.486168 * 1e-6 sec/op
Max latency : 83533.152938 * 1e-6 sec/op
5.0000% latency : 1.059449 * 1e-6 sec/op
50.0000% latency : 1.594726 * 1e-6 sec/op
95.0000% latency : 2.989157 * 1e-6 sec/op
96.0000% latency : 3.385377 * 1e-6 sec/op
97.0000% latency : 3.823205 * 1e-6 sec/op
98.0000% latency : 4.419151 * 1e-6 sec/op
99.0000% latency : 5.870741 * 1e-6 sec/op
99.5000% latency : 1019.920029 * 1e-6 sec/op
99.9000% latency : 1165.321701 * 1e-6 sec/op
99.9500% latency : 1183.496910 * 1e-6 sec/op
99.9900% latency : 1198.037077 * 1e-6 sec/op
Avg throughput : 105417 ops/sec
TokuKV PUT:
Min latency : 0.991044 * 1e-6 sec/op
Avg latency : 4.371083 * 1e-6 sec/op
Max latency : 40661.294945 * 1e-6 sec/op
5.0000% latency : 1.395379 * 1e-6 sec/op
50.0000% latency : 3.423685 * 1e-6 sec/op
95.0000% latency : 4.936942 * 1e-6 sec/op
96.0000% latency : 4.995189 * 1e-6 sec/op
97.0000% latency : 5.311384 * 1e-6 sec/op
98.0000% latency : 5.650804 * 1e-6 sec/op
99.0000% latency : 5.990225 * 1e-6 sec/op
99.5000% latency : 7.236462 * 1e-6 sec/op
99.9000% latency : 29.545455 * 1e-6 sec/op
99.9500% latency : 98.275862 * 1e-6 sec/op
99.9900% latency : 375.000000 * 1e-6 sec/op
Avg throughput : 228776 ops/sec
KyotoCabinet PUT:
Min latency : 0.394066 * 1e-6 sec/op
Avg latency : 1.499276 * 1e-6 sec/op
Max latency : 43.828972 * 1e-6 sec/op
5.0000% latency : 0.394066 * 1e-6 sec/op
50.0000% latency : 1.465726 * 1e-6 sec/op
95.0000% latency : 2.609613 * 1e-6 sec/op
96.0000% latency : 2.761137 * 1e-6 sec/op
97.0000% latency : 2.912661 * 1e-6 sec/op
98.0000% latency : 3.252113 * 1e-6 sec/op
99.0000% latency : 3.847280 * 1e-6 sec/op
99.5000% latency : 4.585659 * 1e-6 sec/op
99.9000% latency : 10.445000 * 1e-6 sec/op
99.9500% latency : 11.695000 * 1e-6 sec/op
99.9900% latency : 25.729167 * 1e-6 sec/op
Avg throughput : 666988 ops/sec
BerkeleyDB PUT:
Min latency : 1.123990 * 1e-6 sec/op
Avg latency : 7.509666 * 1e-6 sec/op
Max latency : 74.230018 * 1e-6 sec/op
5.0000% latency : 4.250513 * 1e-6 sec/op
50.0000% latency : 6.636052 * 1e-6 sec/op
95.0000% latency : 16.394874 * 1e-6 sec/op
96.0000% latency : 18.756516 * 1e-6 sec/op
97.0000% latency : 19.899634 * 1e-6 sec/op
98.0000% latency : 21.757746 * 1e-6 sec/op
99.0000% latency : 23.684677 * 1e-6 sec/op
99.5000% latency : 24.648142 * 1e-6 sec/op
99.9000% latency : 29.476936 * 1e-6 sec/op
99.9500% latency : 33.044554 * 1e-6 sec/op
99.9900% latency : 42.089552 * 1e-6 sec/op
Avg throughput : 133162 ops/sec
NessDB-LSM PUT:
Min latency : 2.127024 * 1e-6 sec/op
Avg latency : 3.716154 * 1e-6 sec/op
Max latency : 97.021926 * 1e-6 sec/op
5.0000% latency : 2.470473 * 1e-6 sec/op
50.0000% latency : 3.588547 * 1e-6 sec/op
95.0000% latency : 4.989692 * 1e-6 sec/op
96.0000% latency : 5.376057 * 1e-6 sec/op
97.0000% latency : 5.835785 * 1e-6 sec/op
98.0000% latency : 6.368663 * 1e-6 sec/op
99.0000% latency : 6.942189 * 1e-6 sec/op
99.5000% latency : 8.010043 * 1e-6 sec/op
99.9000% latency : 13.726340 * 1e-6 sec/op
99.9500% latency : 14.962963 * 1e-6 sec/op
99.9900% latency : 25.000000 * 1e-6 sec/op
Avg throughput : 269095 ops/sec
----
LevelDB GET:
Min latency : 1.561013 * 1e-6 sec/op
Avg latency : 15.348193 * 1e-6 sec/op
Max latency : 152914.703009 * 1e-6 sec/op
5.0000% latency : 2.115197 * 1e-6 sec/op
50.0000% latency : 4.237023 * 1e-6 sec/op
95.0000% latency : 8.716735 * 1e-6 sec/op
96.0000% latency : 8.966660 * 1e-6 sec/op
97.0000% latency : 9.464715 * 1e-6 sec/op
98.0000% latency : 10.002903 * 1e-6 sec/op
99.0000% latency : 11.615546 * 1e-6 sec/op
99.5000% latency : 13.769959 * 1e-6 sec/op
99.9000% latency : 23.715084 * 1e-6 sec/op
99.9500% latency : 156.000000 * 1e-6 sec/op
99.9900% latency : 36428.571429 * 1e-6 sec/op
Avg throughput : 65154 ops/sec
TokuKV GET:
Min latency : 1.535052 * 1e-6 sec/op
Avg latency : 9.371458 * 1e-6 sec/op
Max latency : 123959.795921 * 1e-6 sec/op
5.0000% latency : 1.919828 * 1e-6 sec/op
50.0000% latency : 2.479096 * 1e-6 sec/op
95.0000% latency : 2.962878 * 1e-6 sec/op
96.0000% latency : 2.973629 * 1e-6 sec/op
97.0000% latency : 2.984379 * 1e-6 sec/op
98.0000% latency : 2.995130 * 1e-6 sec/op
99.0000% latency : 3.468322 * 1e-6 sec/op
99.5000% latency : 3.896404 * 1e-6 sec/op
99.9000% latency : 32.500000 * 1e-6 sec/op
99.9500% latency : 6769.230769 * 1e-6 sec/op
99.9900% latency : 11967.213115 * 1e-6 sec/op
Avg throughput : 106707 ops/sec
KyotoCabinet GET:
Min latency : 0.580912 * 1e-6 sec/op
Avg latency : 9.984990 * 1e-6 sec/op
Max latency : 111367.859063 * 1e-6 sec/op
5.0000% latency : 0.826665 * 1e-6 sec/op
50.0000% latency : 1.491062 * 1e-6 sec/op
95.0000% latency : 1.993837 * 1e-6 sec/op
96.0000% latency : 2.214813 * 1e-6 sec/op
97.0000% latency : 2.693878 * 1e-6 sec/op
98.0000% latency : 7.484638 * 1e-6 sec/op
99.0000% latency : 10.334250 * 1e-6 sec/op
99.5000% latency : 12.148008 * 1e-6 sec/op
99.9000% latency : 2444.444444 * 1e-6 sec/op
99.9500% latency : 7390.625000 * 1e-6 sec/op
99.9900% latency : 11872.340426 * 1e-6 sec/op
Avg throughput : 100150 ops/sec
BerkeleyDB GET:
Min latency : 1.641922 * 1e-6 sec/op
Avg latency : 109.959774 * 1e-6 sec/op
Max latency : 313783.429912 * 1e-6 sec/op
5.0000% latency : 4.043921 * 1e-6 sec/op
50.0000% latency : 4.540692 * 1e-6 sec/op
95.0000% latency : 5.723120 * 1e-6 sec/op
96.0000% latency : 5.936203 * 1e-6 sec/op
97.0000% latency : 6.943442 * 1e-6 sec/op
98.0000% latency : 15.289336 * 1e-6 sec/op
99.0000% latency : 3750.950570 * 1e-6 sec/op
99.5000% latency : 7750.000000 * 1e-6 sec/op
99.9000% latency : 16703.296703 * 1e-6 sec/op
99.9500% latency : 23142.076503 * 1e-6 sec/op
99.9900% latency : 37941.176471 * 1e-6 sec/op
Avg throughput : 9094 ops/sec
NessDB-LSM GET:
Min latency : 4.438916 * 1e-6 sec/op
Avg latency : 55.090945 * 1e-6 sec/op
Max latency : 100382.388919 * 1e-6 sec/op
5.0000% latency : 7.706425 * 1e-6 sec/op
50.0000% latency : 8.756409 * 1e-6 sec/op
95.0000% latency : 10.298745 * 1e-6 sec/op
96.0000% latency : 10.916754 * 1e-6 sec/op
97.0000% latency : 11.534763 * 1e-6 sec/op
98.0000% latency : 13.672530 * 1e-6 sec/op
99.0000% latency : 24.558935 * 1e-6 sec/op
99.5000% latency : 4106.250000 * 1e-6 sec/op
99.9000% latency : 9683.006536 * 1e-6 sec/op
99.9500% latency : 11492.682927 * 1e-6 sec/op
99.9900% latency : 19777.777778 * 1e-6 sec/op
Avg throughput : 18152 ops/sec
----
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment