TokyoCabinet Benchmark

Results from http://gist.github.com/167477 script.

This test is to see the performance hit on TokyoCabinet BTree DB through TokyoTyrant 
as more rows are loaded into the database.

Specifically how long it takes to insert 1000 rows one at a time as the database continues to grow.

This is what I'm seeing on an EC2 small instance.
Measurements are in the number of seconds to insert 1000 rows into TokyoCabinet.
(Batch 1 - 1,000 rows in DB)
1       0.527788162231445
2       0.519641160964966
3       0.530730009078979
... (Batch 1000 - 1,000,000 rows in DB)
1000    0.718753814697266
1001    0.734970808029175
1002    0.738662958145142
... (Batch 2000 - 2,000,000 rows in DB)
2000    0.758009910583496
2001    0.716997146606445
2002    0.744237899780273
... (Batch 3000 - 3,000,000 rows in DB)
3000    0.761407852172852
3001    0.74873423576355
3002    0.754790067672729
... (Batch 4000 - 4,000,000 rows in DB)
4000    0.745437860488892
4001    0.78002405166626
4002    2.64324307441711
... (Batch 5000 - 5,000,000 rows in DB)
5000    3.12127184867859
5001    0.776135206222534
5002    0.752912998199463
... (Batch 6000 - 6,000,000 rows in DB)
6000    0.818747997283936
6001    0.842079877853394
6002    3.01401281356812
... (Batch 7000 - 7,000,000 rows in DB)
7000    0.715446949005127
7001    0.779690027236938
7002    4.37743306159973
... (Batch 8000 - 8,000,000 rows in DB)
8000    1.78057408332825
8001    2.12995004653931
8002    0.772353887557983
... (Batch 9000 - 9,000,000 rows in DB)
9000    0.767901182174683
9001    2.54070806503296
9002    0.775713920593262
... (Batch 10000 - 10,000,000 rows in DB)
9998    0.791922807693481
9999    0.782757043838501
10000   2.83386087417603

# time ruby tokyobench.rb

real    228m52.068s
user    24m13.835s
sys     4m45.246s


Looks far more constant than what I saw with CouchDB (http://gist.github.com/166816)