Skip to content

Instantly share code, notes, and snippets.

@bbhavsar
Last active June 16, 2020 21:25
Show Gist options
  • Save bbhavsar/45defc689dce31b88eb646b946a65493 to your computer and use it in GitHub Desktop.
Save bbhavsar/45defc689dce31b88eb646b946a65493 to your computer and use it in GitHub Desktop.
+----------+--------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) |
+----------+--------------------+---------+------------+------------+----------------+
| TPCH(30) | kudu / none / none | 12.53 | -21.67% | 8.44 | -23.04% |
+----------+--------------------+---------+------------+------------+----------------+
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
| Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Iters | Median Diff(%) | MW Zval | Tval |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
| TPCH(30) | TPCH-Q15 | kudu / none / none | 5.98 | 4.37 | +37.03% | * 51.70% * | * 45.08% * | 5 | +19.50% | 0.87 | 0.99 |
| TPCH(30) | TPCH-Q10 | kudu / none / none | 14.23 | 10.97 | +29.67% | * 27.78% * | * 45.82% * | 5 | +16.22% | 1.15 | 1.14 |
| TPCH(30) | TPCH-Q14 | kudu / none / none | 10.31 | 7.96 | +29.52% | * 49.41% * | * 48.46% * | 5 | +15.14% | 0.87 | 0.82 |
| TPCH(30) | TPCH-Q1 | kudu / none / none | 21.71 | 19.20 | +13.10% | * 24.70% * | * 12.89% * | 5 | +10.15% | 0.29 | 0.95 |
| TPCH(30) | TPCH-Q13 | kudu / none / none | 21.21 | 23.17 | -8.45% | * 18.70% * | * 31.20% * | 5 | +9.56% | 0.29 | -0.53 |
| TPCH(30) | TPCH-Q6 | kudu / none / none | 1.38 | 1.38 | -0.19% | 1.66% | 1.54% | 5 | -0.09% | -0.58 | -0.18 |
| TPCH(30) | TPCH-Q22 | kudu / none / none | 4.81 | 4.93 | -2.50% | * 12.07% * | 9.46% | 5 | +0.38% | 0.00 | -0.37 |
| TPCH(30) | TPCH-Q12 | kudu / none / none | 9.12 | 9.17 | -0.52% | * 36.61% * | 9.61% | 5 | -14.37% | -0.87 | -0.03 |
| TPCH(30) | TPCH-Q11 | kudu / none / none | 2.19 | 2.26 | -3.21% | * 38.29% * | * 17.90% * | 5 | -13.23% | -0.29 | -0.17 |
| TPCH(30) | TPCH-Q20 | kudu / none / none | 12.92 | 15.86 | -18.54% | * 34.01% * | * 28.74% * | 5 | -15.59% | -1.15 | -1.04 |
| TPCH(30) | TPCH-Q18 | kudu / none / none | 32.67 | 40.22 | -18.77% | * 17.34% * | * 12.50% * | 5 | -26.44% | -1.44 | -2.23 |
| TPCH(30) | TPCH-Q21 | kudu / none / none | 41.73 | 51.94 | I -19.65% | 6.88% | 2.21% | 5 | I -27.22% | -2.31 | -7.38 |
| TPCH(30) | TPCH-Q16 | kudu / none / none | 3.36 | 4.34 | I -22.57% | * 10.02% * | 9.35% | 5 | I -25.59% | -2.02 | -4.15 |
| TPCH(30) | TPCH-Q9 | kudu / none / none | 28.58 | 38.10 | -24.99% | * 20.30% * | * 20.38% * | 5 | -28.39% | -1.73 | -2.20 |
| TPCH(30) | TPCH-Q3 | kudu / none / none | 9.35 | 13.02 | I -28.16% | 3.20% | 2.89% | 5 | I -37.32% | -2.31 | -17.06 |
| TPCH(30) | TPCH-Q17 | kudu / none / none | 16.79 | 26.91 | I -37.61% | 8.65% | 9.76% | 5 | I -46.83% | -2.31 | -7.54 |
| TPCH(30) | TPCH-Q19 | kudu / none / none | 10.86 | 18.19 | -40.32% | * 58.55% * | * 51.11% * | 5 | -50.08% | -1.15 | -1.46 |
| TPCH(30) | TPCH-Q7 | kudu / none / none | 6.33 | 10.38 | I -38.99% | 2.11% | 2.94% | 5 | I -65.16% | -2.31 | -27.21 |
| TPCH(30) | TPCH-Q4 | kudu / none / none | 7.58 | 18.81 | I -59.69% | * 52.06% * | 4.06% | 5 | I -73.36% | -2.31 | -6.25 |
| TPCH(30) | TPCH-Q2 | kudu / none / none | 2.63 | 5.00 | I -47.50% | * 45.29% * | 7.49% | 5 | I -102.77% | -2.31 | -4.26 |
| TPCH(30) | TPCH-Q8 | kudu / none / none | 6.01 | 12.54 | I -52.10% | 1.25% | 0.41% | 5 | I -108.26% | -2.31 | -160.62 |
| TPCH(30) | TPCH-Q5 | kudu / none / none | 6.00 | 13.33 | I -55.00% | 3.35% | 3.51% | 5 | I -118.63% | -2.31 | -32.19 |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
+----------+--------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) |
+----------+--------------------+---------+------------+------------+----------------+
| TPCH(30) | kudu / none / none | 12.06 | -29.16% | 8.01 | -33.00% |
+----------+--------------------+---------+------------+------------+----------------+
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
| Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Iters | Median Diff(%) | MW Zval | Tval |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
| TPCH(30) | TPCH-Q9 | kudu / none / none | 35.01 | 32.02 | +9.35% | * 22.12% * | 6.94% | 5 | +4.93% | 0.58 | 0.83 |
| TPCH(30) | TPCH-Q22 | kudu / none / none | 4.85 | 4.78 | +1.43% | 9.24% | * 12.14% * | 5 | +2.99% | 0.29 | 0.21 |
| TPCH(30) | TPCH-Q6 | kudu / none / none | 1.42 | 1.41 | +1.11% | 0.30% | 1.62% | 5 | +0.19% | 0.87 | 1.50 |
| TPCH(30) | TPCH-Q19 | kudu / none / none | 9.14 | 10.03 | -8.89% | * 48.59% * | * 66.23% * | 5 | +9.10% | 0.00 | -0.25 |
| TPCH(30) | TPCH-Q13 | kudu / none / none | 20.80 | 22.42 | -7.25% | * 18.61% * | 5.53% | 5 | -1.58% | -0.29 | -0.89 |
| TPCH(30) | TPCH-Q21 | kudu / none / none | 41.31 | 52.87 | I -21.87% | 3.38% | 4.02% | 5 | I -27.06% | -2.31 | -10.17 |
| TPCH(30) | TPCH-Q20 | kudu / none / none | 8.14 | 11.29 | -27.86% | * 36.42% * | * 17.55% * | 5 | -21.80% | -1.73 | -1.97 |
| TPCH(30) | TPCH-Q10 | kudu / none / none | 13.76 | 18.27 | -24.68% | * 27.77% * | * 21.90% * | 5 | -25.93% | -1.44 | -1.82 |
| TPCH(30) | TPCH-Q16 | kudu / none / none | 3.36 | 4.57 | I -26.36% | 4.32% | 6.53% | 5 | I -32.08% | -2.31 | -8.12 |
| TPCH(30) | TPCH-Q18 | kudu / none / none | 30.84 | 41.51 | I -25.70% | * 14.64% * | 9.53% | 5 | I -34.76% | -2.02 | -3.97 |
| TPCH(30) | TPCH-Q3 | kudu / none / none | 9.49 | 12.76 | I -25.59% | 3.23% | 0.44% | 5 | I -36.45% | -2.31 | -23.42 |
| TPCH(30) | TPCH-Q14 | kudu / none / none | 9.05 | 14.21 | -36.30% | * 48.81% * | * 42.90% * | 5 | -32.15% | -0.87 | -1.53 |
| TPCH(30) | TPCH-Q15 | kudu / none / none | 4.62 | 7.12 | -35.13% | * 59.80% * | * 67.38% * | 5 | -42.75% | -1.44 | -1.01 |
| TPCH(30) | TPCH-Q1 | kudu / none / none | 18.19 | 30.38 | -40.11% | * 10.29% * | * 39.36% * | 5 | -41.04% | -1.15 | -2.25 |
| TPCH(30) | TPCH-Q11 | kudu / none / none | 2.10 | 3.66 | -42.70% | * 51.26% * | * 58.85% * | 5 | -43.66% | -1.44 | -1.45 |
| TPCH(30) | TPCH-Q2 | kudu / none / none | 3.11 | 4.78 | -34.86% | * 59.81% * | 2.71% | 5 | -54.18% | -1.15 | -2.00 |
| TPCH(30) | TPCH-Q7 | kudu / none / none | 6.35 | 10.65 | I -40.33% | 1.05% | 1.38% | 5 | I -66.60% | -2.31 | -59.66 |
| TPCH(30) | TPCH-Q17 | kudu / none / none | 15.83 | 27.93 | I -43.32% | 7.54% | 6.08% | 5 | I -73.01% | -2.31 | -13.03 |
| TPCH(30) | TPCH-Q5 | kudu / none / none | 6.88 | 12.62 | I -45.48% | * 25.71% * | 3.44% | 5 | I -108.03% | -2.31 | -7.05 |
| TPCH(30) | TPCH-Q8 | kudu / none / none | 6.14 | 12.57 | I -51.14% | 0.92% | 0.62% | 5 | I -104.22% | -2.31 | -149.79 |
| TPCH(30) | TPCH-Q12 | kudu / none / none | 9.12 | 19.60 | -53.45% | * 27.00% * | * 38.91% * | 5 | -115.51% | -1.73 | -2.92 |
| TPCH(30) | TPCH-Q4 | kudu / none / none | 5.70 | 18.96 | I -69.96% | * 62.70% * | 2.69% | 5 | I -395.38% | -2.31 | -8.22 |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment