Skip to content

Instantly share code, notes, and snippets.

@bbhavsar

bbhavsar/TPCH Regression.txt

Created June 16, 2020 21:26
Show Gist options
  • Save bbhavsar/943cf8ebbab63f598353efef8f87db32 to your computer and use it in GitHub Desktop.
Save bbhavsar/943cf8ebbab63f598353efef8f87db32 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
TPCH Regression.txt
block_cache_capacity_mb = 256 (default)
+----------+--------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) |
+----------+--------------------+---------+------------+------------+----------------+
| TPCH(30) | kudu / none / none | 15.84 | -5.70% | 9.93 | -13.69% |
+----------+--------------------+---------+------------+------------+----------------+
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
| Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Iters | Median Diff(%) | MW Zval | Tval |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
| TPCH(30) | TPCH-Q9 | kudu / none / none | 62.87 | 31.97 | R +96.64% | 8.77% | 2.17% | 5 | R +48.38% | 2.31 | 12.43 |
| TPCH(30) | TPCH-Q19 | kudu / none / none | 21.45 | 14.17 | +51.44% | * 38.05% * | * 43.33% * | 5 | +31.68% | 0.87 | 1.60 |
| TPCH(30) | TPCH-Q13 | kudu / none / none | 30.08 | 23.03 | +30.63% | * 67.24% * | * 43.95% * | 5 | +2.07% | 0.87 | 0.70 |
| TPCH(30) | TPCH-Q1 | kudu / none / none | 23.10 | 21.39 | +7.98% | * 19.22% * | * 40.22% * | 5 | +23.85% | 0.87 | 0.39 |
| TPCH(30) | TPCH-Q15 | kudu / none / none | 8.60 | 6.73 | +27.77% | * 71.43% * | * 84.41% * | 5 | +3.05% | 0.29 | 0.50 |
| TPCH(30) | TPCH-Q14 | kudu / none / none | 9.51 | 8.07 | +17.84% | * 47.39% * | * 54.67% * | 5 | +9.07% | 0.58 | 0.51 |
| TPCH(30) | TPCH-Q10 | kudu / none / none | 16.21 | 15.80 | +2.59% | * 28.34% * | * 37.08% * | 5 | +10.52% | 0.58 | 0.12 |
| TPCH(30) | TPCH-Q11 | kudu / none / none | 3.21 | 2.97 | +7.83% | * 58.86% * | * 39.29% * | 5 | -4.30% | -0.29 | 0.23 |
| TPCH(30) | TPCH-Q6 | kudu / none / none | 1.38 | 1.37 | +0.72% | 0.54% | 2.31% | 5 | +1.22% | 1.15 | 0.68 |
| TPCH(30) | TPCH-Q22 | kudu / none / none | 5.11 | 5.58 | -8.31% | * 16.40% * | * 25.02% * | 5 | -0.91% | -0.29 | -0.64 |
| TPCH(30) | TPCH-Q21 | kudu / none / none | 43.87 | 54.54 | I -19.56% | 6.98% | * 11.51% * | 5 | I -19.15% | -2.31 | -3.42 |
| TPCH(30) | TPCH-Q20 | kudu / none / none | 11.30 | 16.59 | -31.88% | * 22.73% * | * 42.16% * | 5 | -15.16% | -0.58 | -1.59 |
| TPCH(30) | TPCH-Q16 | kudu / none / none | 3.20 | 4.11 | I -21.98% | 5.14% | 4.65% | 5 | I -26.12% | -2.31 | -8.00 |
| TPCH(30) | TPCH-Q18 | kudu / none / none | 41.13 | 53.75 | -23.47% | * 26.69% * | * 12.56% * | 5 | -30.20% | -1.44 | -2.19 |
| TPCH(30) | TPCH-Q3 | kudu / none / none | 9.73 | 13.37 | I -27.24% | 7.65% | 7.51% | 5 | I -33.91% | -2.31 | -6.51 |
| TPCH(30) | TPCH-Q8 | kudu / none / none | 8.10 | 11.98 | I -32.43% | 0.27% | 0.58% | 5 | I -47.68% | -2.31 | -120.04 |
| TPCH(30) | TPCH-Q12 | kudu / none / none | 8.40 | 12.67 | -33.75% | * 19.39% * | * 28.00% * | 5 | -46.69% | -1.44 | -2.45 |
| TPCH(30) | TPCH-Q7 | kudu / none / none | 7.16 | 10.55 | I -32.13% | * 12.16% * | 5.13% | 5 | I -50.12% | -2.31 | -7.40 |
| TPCH(30) | TPCH-Q17 | kudu / none / none | 14.15 | 22.47 | I -37.02% | 3.65% | 6.19% | 5 | I -53.59% | -2.31 | -12.54 |
| TPCH(30) | TPCH-Q2 | kudu / none / none | 4.37 | 6.21 | -29.54% | * 56.72% * | * 16.76% * | 5 | -62.88% | -1.15 | -1.52 |
| TPCH(30) | TPCH-Q5 | kudu / none / none | 7.88 | 13.49 | I -41.55% | * 15.25% * | 3.96% | 5 | I -76.92% | -2.31 | -9.53 |
| TPCH(30) | TPCH-Q4 | kudu / none / none | 7.69 | 18.78 | I -59.03% | * 50.48% * | 6.82% | 5 | I -80.85% | -2.31 | -6.06 |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+---------+
block_cache_capacity_mb = 1024
+----------+--------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) |
+----------+--------------------+---------+------------+------------+----------------+
| TPCH(30) | kudu / none / none | 18.08 | -3.52% | 10.81 | -15.15% |
+----------+--------------------+---------+------------+------------+----------------+
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+--------+
| Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Iters | Median Diff(%) | MW Zval | Tval |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+--------+
| TPCH(30) | TPCH-Q9 | kudu / none / none | 69.67 | 46.12 | R +51.06% | * 13.75% * | 2.73% | 5 | R +35.14% | 2.31 | 5.45 |
| TPCH(30) | TPCH-Q14 | kudu / none / none | 18.53 | 13.92 | +33.11% | * 20.75% * | * 30.33% * | 5 | +31.93% | 1.15 | 1.80 |
| TPCH(30) | TPCH-Q19 | kudu / none / none | 24.70 | 17.53 | +40.93% | * 64.64% * | * 57.51% * | 5 | +5.26% | 0.58 | 0.85 |
| TPCH(30) | TPCH-Q1 | kudu / none / none | 29.42 | 22.04 | +33.46% | * 49.94% * | * 20.23% * | 5 | +11.05% | 0.29 | 1.07 |
| TPCH(30) | TPCH-Q10 | kudu / none / none | 22.14 | 20.83 | +6.29% | * 37.85% * | * 21.35% * | 5 | +3.40% | 0.29 | 0.31 |
| TPCH(30) | TPCH-Q22 | kudu / none / none | 5.39 | 4.83 | +11.56% | * 28.80% * | * 14.18% * | 5 | -2.77% | -0.29 | 0.74 |
| TPCH(30) | TPCH-Q20 | kudu / none / none | 17.82 | 17.71 | +0.59% | * 62.33% * | * 26.82% * | 5 | +7.34% | 0.29 | 0.02 |
| TPCH(30) | TPCH-Q11 | kudu / none / none | 2.47 | 2.62 | -5.64% | * 27.91% * | * 41.56% * | 5 | +8.21% | 0.29 | -0.26 |
| TPCH(30) | TPCH-Q6 | kudu / none / none | 1.34 | 1.35 | -0.61% | 4.95% | 4.72% | 5 | +0.13% | 0.00 | -0.20 |
| TPCH(30) | TPCH-Q13 | kudu / none / none | 29.74 | 31.18 | -4.65% | * 58.01% * | * 46.71% * | 5 | +0.54% | 0.00 | -0.14 |
| TPCH(30) | TPCH-Q12 | kudu / none / none | 19.61 | 22.91 | -14.37% | * 55.50% * | * 60.16% * | 5 | -1.69% | -0.29 | -0.42 |
| TPCH(30) | TPCH-Q21 | kudu / none / none | 49.87 | 53.88 | -7.44% | * 17.59% * | 7.37% | 5 | -13.66% | -0.29 | -0.93 |
| TPCH(30) | TPCH-Q3 | kudu / none / none | 11.91 | 14.14 | -15.78% | * 20.00% * | 6.68% | 5 | -15.38% | -1.15 | -1.95 |
| TPCH(30) | TPCH-Q15 | kudu / none / none | 5.20 | 7.87 | -33.92% | * 37.39% * | * 81.78% * | 5 | +0.74% | 0.00 | -0.89 |
| TPCH(30) | TPCH-Q17 | kudu / none / none | 16.20 | 21.80 | I -25.67% | 5.68% | 2.44% | 5 | I -31.04% | -2.31 | -11.78 |
| TPCH(30) | TPCH-Q18 | kudu / none / none | 36.16 | 49.06 | I -26.28% | * 18.99% * | * 10.71% * | 5 | I -32.39% | -1.73 | -3.33 |
| TPCH(30) | TPCH-Q16 | kudu / none / none | 3.26 | 4.75 | I -31.30% | 3.78% | * 17.27% * | 5 | I -28.68% | -2.31 | -4.01 |
| TPCH(30) | TPCH-Q5 | kudu / none / none | 8.66 | 12.90 | I -32.82% | * 20.30% * | 7.60% | 5 | I -42.93% | -2.31 | -4.70 |
| TPCH(30) | TPCH-Q8 | kudu / none / none | 8.08 | 12.21 | I -33.84% | 0.56% | 0.78% | 5 | I -50.78% | -2.31 | -87.39 |
| TPCH(30) | TPCH-Q7 | kudu / none / none | 6.63 | 10.39 | I -36.12% | 2.05% | 4.10% | 5 | I -56.16% | -2.31 | -18.79 |
| TPCH(30) | TPCH-Q2 | kudu / none / none | 3.16 | 5.70 | I -44.56% | * 14.67% * | * 14.59% * | 5 | I -72.22% | -2.31 | -5.97 |
| TPCH(30) | TPCH-Q4 | kudu / none / none | 7.79 | 18.55 | I -58.01% | * 53.89% * | 3.11% | 5 | I -62.15% | -2.31 | -5.68 |
+----------+----------+--------------------+--------+-------------+------------+------------+----------------+-------+----------------+---------+--------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment