Neo4j benchmark optimized vs. unoptimized queries

benchmark-optimized.log

Reading Test Driver data...done
Reading query mix file: queries/explore/querymix.txt
Reading query ignore file: queries/explore/ignoreQueries.txt

Starting test...

-10: 0.00ms, total: 503ms
-9: 0.00ms, total: 300ms
-8: 0.00ms, total: 367ms
-7: 0.00ms, total: 259ms
-6: 0.00ms, total: 340ms
-5: 0.00ms, total: 255ms
-4: 0.00ms, total: 362ms
-3: 0.00ms, total: 283ms
-2: 0.00ms, total: 370ms
-1: 0.00ms, total: 242ms
0: 263.82ms, total: 284ms
1: 323.67ms, total: 341ms
2: 261.76ms, total: 278ms
3: 305.04ms, total: 321ms
4: 253.34ms, total: 270ms
5: 312.71ms, total: 328ms
6: 226.42ms, total: 241ms
7: 323.80ms, total: 340ms
8: 245.77ms, total: 261ms
9: 203.91ms, total: 219ms
10: 325.44ms, total: 340ms
11: 219.28ms, total: 234ms
12: 365.53ms, total: 381ms
13: 255.52ms, total: 272ms
14: 346.19ms, total: 361ms
15: 229.20ms, total: 244ms
16: 323.32ms, total: 339ms
17: 260.77ms, total: 276ms
18: 339.43ms, total: 354ms
19: 216.52ms, total: 232ms
20: 347.58ms, total: 363ms
21: 240.15ms, total: 255ms
22: 245.66ms, total: 261ms
23: 344.15ms, total: 359ms
24: 255.80ms, total: 271ms
25: 344.15ms, total: 365ms
26: 231.04ms, total: 246ms
27: 367.63ms, total: 383ms
28: 236.51ms, total: 251ms
29: 348.09ms, total: 363ms
30: 358.05ms, total: 373ms
31: 309.21ms, total: 325ms
32: 241.52ms, total: 256ms
33: 300.84ms, total: 316ms
34: 233.97ms, total: 249ms
35: 206.91ms, total: 221ms
36: 300.41ms, total: 315ms
37: 264.90ms, total: 280ms
38: 329.67ms, total: 344ms
39: 233.80ms, total: 248ms
40: 298.85ms, total: 313ms
41: 210.71ms, total: 224ms
42: 326.80ms, total: 342ms
43: 265.21ms, total: 279ms
44: 311.23ms, total: 326ms
45: 219.35ms, total: 234ms
46: 259.36ms, total: 274ms
47: 317.95ms, total: 332ms
48: 242.43ms, total: 257ms
49: 298.68ms, total: 313ms
50: 218.96ms, total: 233ms
51: 314.94ms, total: 330ms
52: 250.20ms, total: 264ms
53: 317.45ms, total: 331ms
54: 231.81ms, total: 246ms
55: 242.52ms, total: 257ms
56: 285.36ms, total: 299ms
57: 247.93ms, total: 262ms
58: 302.24ms, total: 317ms
59: 248.04ms, total: 262ms
60: 300.00ms, total: 314ms
61: 222.17ms, total: 236ms
62: 309.43ms, total: 323ms
63: 233.44ms, total: 248ms
64: 240.85ms, total: 254ms
65: 329.06ms, total: 343ms
66: 236.73ms, total: 251ms
67: 310.39ms, total: 324ms
68: 239.12ms, total: 253ms
69: 343.45ms, total: 358ms
70: 258.36ms, total: 273ms
71: 325.47ms, total: 339ms
72: 219.78ms, total: 238ms
73: 298.57ms, total: 313ms
74: 229.00ms, total: 242ms
75: 337.07ms, total: 350ms
76: 224.12ms, total: 238ms
77: 205.86ms, total: 219ms
78: 298.47ms, total: 312ms
79: 242.42ms, total: 256ms
80: 313.97ms, total: 327ms
81: 217.60ms, total: 231ms
82: 308.70ms, total: 323ms
83: 247.46ms, total: 262ms
84: 230.24ms, total: 244ms
85: 323.60ms, total: 336ms
86: 208.90ms, total: 222ms
87: 314.33ms, total: 328ms
88: 241.94ms, total: 255ms
89: 320.64ms, total: 334ms
90: 230.49ms, total: 244ms
91: 322.93ms, total: 337ms
92: 234.64ms, total: 248ms
93: 276.16ms, total: 289ms
94: 299.49ms, total: 314ms
95: 221.90ms, total: 235ms
96: 309.59ms, total: 323ms
97: 242.74ms, total: 256ms
98: 305.72ms, total: 319ms
99: 220.42ms, total: 234ms

Scale factor:           20
Number of warmup runs:  10
Seed:                   808080
Number of query mix runs (without warmups): 100 times
min/max Querymix runtime: 0.2039s / 0.3676s
Total runtime:          27.547 seconds
QMpH:                   13068.70 query mixes per hour
CQET:                   0.27547 seconds average runtime of query mix
CQET (geom.):           0.27172 seconds geometric mean runtime of query mix

Metrics for Query:      1
Count:                  100 times executed in whole run
AQET:                   0.003844 seconds (arithmetic mean)
AQET(geom.):            0.003821 seconds (geometric mean)
QPS:                    260.17 Queries per second
minQET/maxQET:          0.00288477s / 0.00458070s
Average result count:   0.22
min/max result count:   0 / 2
Number of timeouts:     0

Metrics for Query:      2
Count:                  600 times executed in whole run
AQET:                   0.020785 seconds (arithmetic mean)
AQET(geom.):            0.018423 seconds (geometric mean)
QPS:                    48.11 Queries per second
minQET/maxQET:          0.01310702s / 0.12958397s
Average result count:   21.52
min/max result count:   14 / 31
Number of timeouts:     0

Metrics for Query:      3
Count:                  100 times executed in whole run
AQET:                   0.004966 seconds (arithmetic mean)
AQET(geom.):            0.004284 seconds (geometric mean)
QPS:                    201.38 Queries per second
minQET/maxQET:          0.00307575s / 0.07918398s
Average result count:   0.27
min/max result count:   0 / 2
Number of timeouts:     0

Metrics for Query:      4
Count:                  100 times executed in whole run
AQET:                   0.005782 seconds (arithmetic mean)
AQET(geom.):            0.005089 seconds (geometric mean)
QPS:                    172.95 Queries per second
minQET/maxQET:          0.00347891s / 0.08152854s
Average result count:   0.00
min/max result count:   0 / 0
Number of timeouts:     0

Metrics for Query:      5
Count:                  200 times executed in whole run
AQET:                   0.022972 seconds (arithmetic mean)
AQET(geom.):            0.020172 seconds (geometric mean)
QPS:                    43.53 Queries per second
minQET/maxQET:          0.01003240s / 0.13797773s
Average result count:   0.48
min/max result count:   0 / 3
Number of timeouts:     0

Metrics for Query:      7
Count:                  400 times executed in whole run
AQET:                   0.011270 seconds (arithmetic mean)
AQET(geom.):            0.009830 seconds (geometric mean)
QPS:                    88.73 Queries per second
minQET/maxQET:          0.00469820s / 0.10021185s
Average result count:   10.35
min/max result count:   1 / 25
Number of timeouts:     0

Metrics for Query:      8
Count:                  200 times executed in whole run
AQET:                   0.007302 seconds (arithmetic mean)
AQET(geom.):            0.005875 seconds (geometric mean)
QPS:                    136.95 Queries per second
minQET/maxQET:          0.00318586s / 0.08292074s
Average result count:   1.83
min/max result count:   0 / 6
Number of timeouts:     0

Metrics for Query:      9
Count:                  400 times executed in whole run
AQET:                   0.002128 seconds (arithmetic mean)
AQET(geom.):            0.001943 seconds (geometric mean)
QPS:                    469.91 Queries per second
minQET/maxQET:          0.00157585s / 0.07961171s
Average result (Bytes): 6661.14
min/max result (Bytes): 4252 / 9363
Number of timeouts:     0

Metrics for Query:      10
Count:                  200 times executed in whole run
AQET:                   0.007128 seconds (arithmetic mean)
AQET(geom.):            0.006469 seconds (geometric mean)
QPS:                    140.29 Queries per second
minQET/maxQET:          0.00325631s / 0.09181084s
Average result count:   0.00
min/max result count:   0 / 0
Number of timeouts:     0

Metrics for Query:      11
Count:                  100 times executed in whole run
AQET:                   0.003972 seconds (arithmetic mean)
AQET(geom.):            0.002642 seconds (geometric mean)
QPS:                    251.74 Queries per second
minQET/maxQET:          0.00207924s / 0.07843787s
Average result count:   10.00
min/max result count:   10 / 10
Number of timeouts:     0

Metrics for Query:      12
Count:                  100 times executed in whole run
AQET:                   0.003797 seconds (arithmetic mean)
AQET(geom.):            0.003792 seconds (geometric mean)
QPS:                    263.36 Queries per second
minQET/maxQET:          0.00341919s / 0.00437257s
Average result (Bytes): 1589.79
min/max result (Bytes): 1570 / 1600
Number of timeouts:     0

benchmark-unoptimized.log

Reading Test Driver data...done
Reading query mix file: queries/explore/querymix.txt
Reading query ignore file: queries/explore/ignoreQueries.txt

Starting test...

-10: 0.00ms, total: 5819ms
-9: 0.00ms, total: 1778ms
-8: 0.00ms, total: 1892ms
-7: 0.00ms, total: 1559ms
-6: 0.00ms, total: 1652ms
-5: 0.00ms, total: 1610ms
-4: 0.00ms, total: 1927ms
-3: 0.00ms, total: 1783ms
-2: 0.00ms, total: 1931ms
-1: 0.00ms, total: 1427ms
0: 1667.78ms, total: 1697ms
1: 1499.88ms, total: 1518ms
2: 1602.19ms, total: 1620ms
3: 1714.76ms, total: 1732ms
4: 1881.30ms, total: 1899ms
5: 1510.56ms, total: 1528ms
6: 1292.44ms, total: 1310ms
7: 1685.38ms, total: 1702ms
8: 1810.02ms, total: 1827ms
9: 1206.21ms, total: 1223ms
10: 1503.31ms, total: 1520ms
11: 1323.73ms, total: 1341ms
12: 1697.22ms, total: 1719ms
13: 1726.59ms, total: 1743ms
14: 2016.85ms, total: 2033ms
15: 1364.91ms, total: 1382ms
16: 1298.56ms, total: 1316ms
17: 1720.69ms, total: 1738ms
18: 1793.32ms, total: 1810ms
19: 1250.68ms, total: 1267ms
20: 1915.31ms, total: 1931ms
21: 1676.17ms, total: 1693ms
22: 1426.12ms, total: 1442ms
23: 1536.81ms, total: 1559ms
24: 1439.90ms, total: 1458ms
25: 1778.14ms, total: 1794ms
26: 1431.44ms, total: 1447ms
27: 1562.94ms, total: 1578ms
28: 1638.45ms, total: 1654ms
29: 1538.20ms, total: 1555ms
30: 1595.88ms, total: 1613ms
31: 1521.24ms, total: 1538ms
32: 1550.12ms, total: 1567ms
33: 1506.77ms, total: 1523ms
34: 1487.92ms, total: 1505ms
35: 1398.04ms, total: 1420ms
36: 1604.49ms, total: 1621ms
37: 1910.02ms, total: 1926ms
38: 1765.26ms, total: 1781ms
39: 1407.32ms, total: 1424ms
40: 1292.67ms, total: 1308ms
41: 1435.72ms, total: 1452ms
42: 1481.12ms, total: 1497ms
43: 1896.44ms, total: 1913ms
44: 1558.34ms, total: 1574ms
45: 1365.64ms, total: 1381ms
46: 1628.52ms, total: 1651ms
47: 1809.61ms, total: 1826ms
48: 1371.04ms, total: 1387ms
49: 1502.49ms, total: 1518ms
50: 1300.02ms, total: 1316ms
51: 1218.96ms, total: 1235ms
52: 1479.48ms, total: 1494ms
53: 1454.09ms, total: 1470ms
54: 1487.17ms, total: 1503ms
55: 1784.86ms, total: 1800ms
56: 1695.45ms, total: 1710ms
57: 1464.25ms, total: 1480ms
58: 1733.53ms, total: 1755ms
59: 1548.92ms, total: 1563ms
60: 1464.90ms, total: 1492ms
61: 1465.22ms, total: 1479ms
62: 1428.28ms, total: 1442ms
63: 1678.60ms, total: 1694ms
64: 1494.49ms, total: 1508ms
65: 1703.44ms, total: 1718ms
66: 1461.42ms, total: 1475ms
67: 1606.30ms, total: 1621ms
68: 1590.77ms, total: 1605ms
69: 1339.92ms, total: 1354ms
70: 1450.28ms, total: 1464ms
71: 1490.50ms, total: 1504ms
72: 1495.70ms, total: 1510ms
73: 1455.39ms, total: 1469ms
74: 1402.84ms, total: 1417ms
75: 1509.10ms, total: 1523ms
76: 1356.82ms, total: 1370ms
77: 1530.93ms, total: 1545ms
78: 1457.45ms, total: 1471ms
79: 1420.21ms, total: 1436ms
80: 1488.18ms, total: 1502ms
81: 1447.77ms, total: 1461ms
82: 1563.53ms, total: 1576ms
83: 1701.91ms, total: 1716ms
84: 1450.21ms, total: 1473ms
85: 1575.22ms, total: 1589ms
86: 1189.68ms, total: 1204ms
87: 1463.83ms, total: 1477ms
88: 1441.58ms, total: 1458ms
89: 1749.46ms, total: 1763ms
90: 1181.41ms, total: 1195ms
91: 1430.69ms, total: 1444ms
92: 1376.30ms, total: 1389ms
93: 1578.39ms, total: 1592ms
94: 1361.44ms, total: 1375ms
95: 1355.12ms, total: 1369ms
96: 1129.54ms, total: 1143ms
97: 1440.31ms, total: 1454ms
98: 1416.43ms, total: 1430ms
99: 1307.95ms, total: 1321ms

Scale factor:           20
Number of warmup runs:  10
Seed:                   808080
Number of query mix runs (without warmups): 100 times
min/max Querymix runtime: 1.1295s / 2.0169s
Total runtime:          152.217 seconds
QMpH:                   2365.05 query mixes per hour
CQET:                   1.52217 seconds average runtime of query mix
CQET (geom.):           1.51218 seconds geometric mean runtime of query mix

Metrics for Query:      1
Count:                  100 times executed in whole run
AQET:                   0.036828 seconds (arithmetic mean)
AQET(geom.):            0.032253 seconds (geometric mean)
QPS:                    27.15 Queries per second
minQET/maxQET:          0.02675875s / 0.13867911s
Average result count:   0.22
min/max result count:   0 / 2
Number of timeouts:     0

Metrics for Query:      2
Count:                  600 times executed in whole run
AQET:                   0.021369 seconds (arithmetic mean)
AQET(geom.):            0.017931 seconds (geometric mean)
QPS:                    46.80 Queries per second
minQET/maxQET:          0.01225672s / 0.13284608s
Average result count:   21.52
min/max result count:   14 / 31
Number of timeouts:     0

Metrics for Query:      3
Count:                  100 times executed in whole run
AQET:                   0.036538 seconds (arithmetic mean)
AQET(geom.):            0.032540 seconds (geometric mean)
QPS:                    27.37 Queries per second
minQET/maxQET:          0.02691779s / 0.14228235s
Average result count:   0.27
min/max result count:   0 / 2
Number of timeouts:     0

Metrics for Query:      4
Count:                  100 times executed in whole run
AQET:                   0.069534 seconds (arithmetic mean)
AQET(geom.):            0.062760 seconds (geometric mean)
QPS:                    14.38 Queries per second
minQET/maxQET:          0.04966051s / 0.16842797s
Average result count:   0.00
min/max result count:   0 / 0
Number of timeouts:     0

Metrics for Query:      5
Count:                  200 times executed in whole run
AQET:                   0.569089 seconds (arithmetic mean)
AQET(geom.):            0.555848 seconds (geometric mean)
QPS:                    1.76 Queries per second
minQET/maxQET:          0.28499019s / 0.86140118s
Average result count:   0.48
min/max result count:   0 / 3
Number of timeouts:     0

Metrics for Query:      7
Count:                  400 times executed in whole run
AQET:                   0.013576 seconds (arithmetic mean)
AQET(geom.):            0.011460 seconds (geometric mean)
QPS:                    73.66 Queries per second
minQET/maxQET:          0.00558725s / 0.12910028s
Average result count:   10.35
min/max result count:   1 / 25
Number of timeouts:     0

Metrics for Query:      8
Count:                  200 times executed in whole run
AQET:                   0.008114 seconds (arithmetic mean)
AQET(geom.):            0.007815 seconds (geometric mean)
QPS:                    123.24 Queries per second
minQET/maxQET:          0.00436586s / 0.02278070s
Average result count:   1.83
min/max result count:   0 / 6
Number of timeouts:     0

Metrics for Query:      9
Count:                  400 times executed in whole run
AQET:                   0.003707 seconds (arithmetic mean)
AQET(geom.):            0.003693 seconds (geometric mean)
QPS:                    269.78 Queries per second
minQET/maxQET:          0.00310850s / 0.00601950s
Average result (Bytes): 6661.14
min/max result (Bytes): 4252 / 9363
Number of timeouts:     0

Metrics for Query:      10
Count:                  200 times executed in whole run
AQET:                   0.009203 seconds (arithmetic mean)
AQET(geom.):            0.008034 seconds (geometric mean)
QPS:                    108.67 Queries per second
minQET/maxQET:          0.00438866s / 0.11986503s
Average result count:   0.00
min/max result count:   0 / 0
Number of timeouts:     0

Metrics for Query:      11
Count:                  100 times executed in whole run
AQET:                   0.003862 seconds (arithmetic mean)
AQET(geom.):            0.003847 seconds (geometric mean)
QPS:                    258.96 Queries per second
minQET/maxQET:          0.00324631s / 0.00502019s
Average result count:   10.00
min/max result count:   10 / 10
Number of timeouts:     0

Metrics for Query:      12
Count:                  100 times executed in whole run
AQET:                   0.005249 seconds (arithmetic mean)
AQET(geom.):            0.005226 seconds (geometric mean)
QPS:                    190.51 Queries per second
minQET/maxQET:          0.00456560s / 0.00688856s
Average result (Bytes): 1589.79
min/max result (Bytes): 1570 / 1600
Number of timeouts:     0