Benchmarking storage engines for InfluxDB

gistfile1.txt

Magnetic

################ Benchmarking: lmdb
Writing 3000000 points in batches of 1000 points took 18.921191722s (6.307064 microsecond per point)
Querying 3000000 points took 2.606522883s (0.868841 microseconds per point)
Size: 247M
Took 4.418017259s to delete 1500000 points
Took 1.3us to compact
Querying 1500000 points took 1.271503904s (0.847669 microseconds per point)
Size: 247M
Writing 1500000 points in batches of 1000 points took 15.542766765s (10.361845 microsecond per point)
Size: 247M
################ Benchmarking: leveldb
Writing 3000000 points in batches of 1000 points took 46.14958391s (15.383195 microsecond per point)
Querying 3000000 points took 4.616855399s (1.538952 microseconds per point)
Size: 75M
Took 9.846942338s to delete 1500000 points
Took 19.870850844s to compact
Querying 1500000 points took 2.099772448s (1.399848 microseconds per point)
Size: 34M
Writing 1500000 points in batches of 1000 points took 15.28585484s (10.190570 microsecond per point)
Size: 68M
################ Benchmarking: rocksdb
Writing 3000000 points in batches of 1000 points took 23.315716316s (7.771905 microsecond per point)
Querying 3000000 points took 4.82953703s (1.609846 microseconds per point)
Size: 118M
Took 6.628933817s to delete 1500000 points
Took 24.208241462s to compact
Querying 1500000 points took 2.141044082s (1.427363 microseconds per point)
Size: 74M
Writing 1500000 points in batches of 1000 points took 11.290773432s (7.527182 microsecond per point)
Size: 142M
################ Benchmarking: hyperleveldb
Writing 3000000 points in batches of 1000 points took 30.396355835s (10.132119 microsecond per point)
Querying 3000000 points took 16.4719441s (5.490648 microseconds per point)
Size: 222M
Took 16.192459206s to delete 1500000 points
Took 1m1.505245513s to compact
Querying 1500000 points took 3.791702933s (2.527802 microseconds per point)
Size: 46M
Writing 1500000 points in batches of 1000 points took 16.380269604s (10.920180 microsecond per point)

SSD

################ Benchmarking: lmdb
Writing 3000000 points in batches of 1000 points took 11.407304025s (3.802435 microsecond per point)
Querying 3000000 points took 1.818307143s (0.606102 microseconds per point)
Size: 247M
Took 2.648555619s to delete 1500000 points
Took 13.189us to compact
Querying 1500000 points took 781.523968ms (0.521016 microseconds per point)
Size: 247M
Writing 1500000 points in batches of 1000 points took 5.005021214s (3.336681 microsecond per point)
Size: 247M
################ Benchmarking: leveldb
Writing 3000000 points in batches of 1000 points took 18.032112872s (6.010704 microsecond per point)
Querying 3000000 points took 2.782239883s (0.927413 microseconds per point)
Size: 78M
Took 2.931665417s to delete 1500000 points
Took 5.347687335s to compact
Querying 1500000 points took 1.20473762s (0.803158 microseconds per point)
Size: 34M
Writing 1500000 points in batches of 1000 points took 7.101895082s (4.734597 microsecond per point)
Size: 74M
################ Benchmarking: rocksdb
Writing 3000000 points in batches of 1000 points took 15.372282672s (5.124094 microsecond per point)
Querying 3000000 points took 2.923109244s (0.974370 microseconds per point)
Size: 100M
Took 2.140210849s to delete 1500000 points
Took 2.754855544s to compact
Querying 1500000 points took 1.5118875s (1.007925 microseconds per point)
Size: 69M
Writing 1500000 points in batches of 1000 points took 7.914530179s (5.276353 microsecond per point)
Size: 103M
################ Benchmarking: hyperleveldb
Writing 3000000 points in batches of 1000 points took 21.016659829s (7.005553 microsecond per point)
Querying 3000000 points took 8.20239997s (2.734133 microseconds per point)
Size: 206M
Took 10.567718164s to delete 1500000 points
Took 26.425438908s to compact
Querying 1500000 points took 2.198092571s (1.465395 microseconds per point)
Size: 46M
Writing 1500000 points in batches of 1000 points took 10.062310405s (6.708207 microsecond per point)
Size: 99M

################ Benchmarking: lmdb
riting 30000000 points in batches of 1000 points took 2m34.848696205s (5.161623 microsecond per point)
Querying 30000000 points took 23.132987159s (0.771100 microseconds per point)
Size: 2.4G
Took 35.769542352s to delete 15000000 points
Took 1.572us to compact
Querying 15000000 points took 8.481240427s (0.565416 microseconds per point)
Size: 2.5G
Writing 15000000 points in batches of 1000 points took 3m25.964986161s (13.730999 microsecond per point)
Size: 2.5G
################ Benchmarking: leveldb
Writing 30000000 points in batches of 1000 points took 7m9.545841923s (14.318195 microsecond per point)
Querying 30000000 points took 28.184158056s (0.939472 microseconds per point)
Size: 670M
Took 29.359300512s to delete 15000000 points
Took 43.129526752s to compact
Querying 15000000 points took 12.127253542s (0.808484 microseconds per point)
Size: 333M
Writing 15000000 points in batches of 1000 points took 3m5.285995323s (12.352400 microsecond per point)
Size: 673M
################ Benchmarking: rocksdb
Writing 30000000 points in batches of 1000 points took 3m34.205144196s (7.140171 microsecond per point)
Querying 30000000 points took 36.716736519s (1.223891 microseconds per point)
Size: 929M
Took 20.125692944s to delete 15000000 points
Took 35.179569838s to compact
Querying 15000000 points took 13.59741374s (0.906494 microseconds per point)
Size: 479M
Writing 15000000 points in batches of 1000 points took 1m26.919315558s (5.794621 microsecond per point)
Size: 993M
################ Benchmarking: hyperleveldb
Writing 30000000 points in batches of 1000 points took 4m7.992790172s (8.266426 microsecond per point)
Querying 30000000 points took 1m18.989770828s (2.632992 microseconds per point)
Size: 1.1G
Took 1m43.252030592s to delete 15000000 points
Took 3m24.333245302s to compact
Querying 15000000 points took 23.986158894s (1.599077 microseconds per point)
Size: 460M
Writing 15000000 points in batches of 1000 points took 1m54.563399593s (7.637560 microsecond per point)
Size: 928M


################ Benchmarking: lmdb
Writing 100000000 points in batches of 1000 points took 1h13m21.301276574s (44.013013 microsecond per point)
Querying 100000000 points took 5m24.806553848s (3.248066 microseconds per point)
Size: 7.6G
Took 6m15.983218085s to delete 50000000 points
Took 1.548us to compact
Querying 50000000 points took 4m9.945576927s (4.998912 microseconds per point)
Size: 7.6G
Writing 50000000 points in batches of 1000 points took 2h33m16.508721127s (183.930174 microsecond per point)
Size: 8.2G
################ Benchmarking: leveldb
Writing 100000000 points in batches of 1000 points took 36m8.298231301s (21.682982 microsecond per point)
Querying 100000000 points took 2m55.378648436s (1.753786 microseconds per point)
Size: 2.7G
Took 3m47.645126321s to delete 50000000 points
Took 3m59.87591148s to compact
Querying 50000000 points took 56.220573381s (1.124411 microseconds per point)
Size: 1.4G
Writing 50000000 points in batches of 1000 points took 15m4.898818581s (18.097976 microsecond per point)
Size: 2.6G
################ Benchmarking: rocksdb
Writing 100000000 points in batches of 1000 points took 21m18.607872281s (12.786079 microsecond per point)
Querying 100000000 points took 2m44.992188496s (1.649922 microseconds per point)
Size: 3.2G
Took 1m53.841183006s to delete 50000000 points
Took 3m20.274315268s to compact
Querying 50000000 points took 42.584478165s (0.851690 microseconds per point)
Size: 1.6G
Writing 50000000 points in batches of 1000 points took 6m41.480086898s (8.029602 microsecond per point)
Size: 3.3G
################ Benchmarking: hyperleveldb
Writing 100000000 points in batches of 1000 points took 10m45.413583776s (6.454136 microsecond per point)
Querying 100000000 points took 13m49.018238203s (8.290182 microseconds per point)
Size: 3.2G
Took 6m0.388986247s to delete 50000000 points
Took 6m33.361488732s to compact
Querying 50000000 points took 1m30.048218504s (1.800964 microseconds per point)
Size: 1.6G
Writing 50000000 points in batches of 1000 points took 5m8.604944569s (6.172099 microsecond per point)
Size: 3.4G