Skip to content

Instantly share code, notes, and snippets.

@xhochy

xhochy/gist:60538f43b5d8fc4dce46ff8a76d28a9e Secret

Created January 8, 2021 20:59
Show Gist options
  • Save xhochy/60538f43b5d8fc4dce46ff8a76d28a9e to your computer and use it in GitHub Desktop.
Save xhochy/60538f43b5d8fc4dce46ff8a76d28a9e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile0.txt
---------------------------------------------------------------------------------------------------------
Non-regressions: (163)
---------------------------------------------------------------------------------------------------------
benchmark baseline contender change % counters
BufferBuilderLargeWrites/real_time 1.293 GiB/sec 9.917 GiB/sec 666.874 {}
BuildIntArrayNoNulls 1.174 GiB/sec 8.350 GiB/sec 610.976 {}
BM_ReadColumn<false,DoubleType>/-1/0 2.160 GiB/sec 12.020 GiB/sec 456.481 {}
BM_ReadStructColumn/0 1.310 GiB/sec 6.192 GiB/sec 372.569 {}
BM_ReadStructOfStructColumn/0 1.335 GiB/sec 6.118 GiB/sec 358.185 {}
BufferBuilderSmallWrites/real_time 1.284 GiB/sec 5.714 GiB/sec 345.124 {}
TableSortIndicesInt64Narrow/1048576/0/1/4 21.885m items/sec 93.051m items/sec 325.188 {}
TableSortIndicesInt64Narrow/1048576/100/1/4 18.263m items/sec 73.609m items/sec 303.043 {}
ChunkedArraySortIndicesInt64Narrow/8388608/100 95.013 MiB/sec 372.800 MiB/sec 292.368 {}
BuildAdaptiveIntNoNulls 3.484 GiB/sec 13.660 GiB/sec 292.060 {}
BM_ReadColumn<false,Int64Type>/-1/1 1.737 GiB/sec 6.749 GiB/sec 288.496 {}
BuildBinaryArray 256.022 MiB/sec 988.465 MiB/sec 286.086 {}
BufferBuilderTinyWrites/real_time 661.088 MiB/sec 2.347 GiB/sec 263.549 {}
BM_ReadColumn<false,Int64Type>/-1/50 1.699 GiB/sec 6.082 GiB/sec 258.021 {}
BuildChunkedBinaryArray 230.284 MiB/sec 816.986 MiB/sec 254.773 {}
BM_ReadColumn<false,Int32Type>/-1/1 1.413 GiB/sec 4.912 GiB/sec 247.603 {}
TableSortIndicesInt64Narrow/1048576/0/1/32 14.014m items/sec 46.198m items/sec 229.668 {}
BM_ReadColumn<false,Int32Type>/-1/50 1.319 GiB/sec 4.170 GiB/sec 216.132 {}
TableSortIndicesInt64Narrow/1048576/100/1/32 11.726m items/sec 36.583m items/sec 211.989 {}
BuildFixedSizeBinaryArray 567.905 MiB/sec 1.697 GiB/sec 206.038 {}
BuildDecimalArray 878.931 MiB/sec 2.514 GiB/sec 192.889 {}
BM_ReadColumn<false,DoubleType>/-1/20 1.406 GiB/sec 4.064 GiB/sec 189.071 {}
BM_ReadColumn<false,Int64Type>/-1/10 1.252 GiB/sec 3.326 GiB/sec 165.586 {}
RecordBatchSortIndicesInt64Narrow/1048576/0/1 151.511m items/sec 398.077m items/sec 162.737 {}
TableSortIndicesInt64Narrow/1048576/0/1/1 154.052m items/sec 401.642m items/sec 160.718 {}
ArraySortIndicesInt64Narrow/8388608/100 904.837 MiB/sec 2.218 GiB/sec 150.975 {}
TableSortIndicesInt64Narrow/1048576/100/8/32 710.173k items/sec 1.775m items/sec 149.939 {}
RecordBatchSortIndicesInt64Narrow/1048576/100/1 118.507m items/sec 296.062m items/sec 149.826 {}
BM_ReadColumn<true,Int64Type>/99/0 1.193 GiB/sec 2.977 GiB/sec 149.663 {}
BM_ReadColumn<true,Int64Type>/99/50 1.214 GiB/sec 3.030 GiB/sec 149.532 {}
BM_ReadStructOfStructColumn/99 983.850 MiB/sec 2.373 GiB/sec 146.989 {}
BM_ReadColumn<true,Int64Type>/1/1 1.250 GiB/sec 3.079 GiB/sec 146.286 {}
TableSortIndicesInt64Narrow/1048576/100/1/1 122.150m items/sec 298.227m items/sec 144.148 {}
TableSortIndicesInt64Narrow/1048576/0/8/32 791.426k items/sec 1.887m items/sec 138.439 {}
BM_ReadColumn<true,Int32Type>/1/1 796.281 MiB/sec 1.803 GiB/sec 131.903 {}
BM_ReadColumn<false,Int32Type>/-1/10 880.195 MiB/sec 1.984 GiB/sec 130.794 {}
BuildInt64DictionaryArrayRandom 424.583 MiB/sec 977.491 MiB/sec 130.224 {}
BM_ReadStructColumn/1 733.390 MiB/sec 1.629 GiB/sec 127.457 {}
BuildInt64DictionaryArraySequential 448.177 MiB/sec 1016.895 MiB/sec 126.896 {}
TableSortIndicesInt64Narrow/1048576/100/16/1 1.052m items/sec 2.387m items/sec 126.886 {}
BM_ReadStructColumn/99 1.102 GiB/sec 2.494 GiB/sec 126.357 {}
TableSortIndicesInt64Narrow/1048576/100/8/1 1.064m items/sec 2.391m items/sec 124.791 {}
BM_ReadColumn<false,BooleanType>/-1/0 747.919 MiB/sec 1.626 GiB/sec 122.634 {}
ArraySortIndicesInt64Narrow/1048576/100 1.087 GiB/sec 2.399 GiB/sec 120.811 {}
TableSortIndicesInt64Narrow/1048576/100/16/32 805.537k items/sec 1.778m items/sec 120.760 {}
BM_ReadStructOfStructColumn/1 678.640 MiB/sec 1.449 GiB/sec 118.628 {}
TableSortIndicesInt64Narrow/1048576/0/8/4 1.105m items/sec 2.413m items/sec 118.262 {}
RecordBatchSortIndicesInt64Narrow/1048576/100/16 1.453m items/sec 3.162m items/sec 117.541 {}
BM_ReadColumn<true,Int64Type>/5/5 999.102 MiB/sec 2.100 GiB/sec 115.235 {}
ChunkedArraySortIndicesInt64Narrow/1048576/100 220.949 MiB/sec 462.335 MiB/sec 109.250 {}
TableSortIndicesInt64Narrow/1048576/0/16/32 901.990k items/sec 1.883m items/sec 108.776 {}
BM_ReadStructOfStructColumn/50 609.733 MiB/sec 1.235 GiB/sec 107.389 {}
BM_ReadColumn<true,Int64Type>/35/10 907.209 MiB/sec 1.835 GiB/sec 107.148 {}
BM_ReadColumn<true,Int32Type>/99/0 856.185 MiB/sec 1.728 GiB/sec 106.613 {}
BM_ReadColumn<true,Int32Type>/99/50 866.899 MiB/sec 1.737 GiB/sec 105.121 {}
TableSortIndicesInt64Narrow/1048576/0/16/1 1.245m items/sec 2.536m items/sec 103.674 {}
TableSortIndicesInt64Narrow/1048576/0/8/1 1.250m items/sec 2.528m items/sec 102.314 {}
BM_ReadColumn<true,Int64Type>/45/25 921.083 MiB/sec 1.816 GiB/sec 101.928 {}
BM_ReadColumn<true,Int64Type>/75/1 911.098 MiB/sec 1.796 GiB/sec 101.840 {}
BM_ReadColumn<true,Int64Type>/10/5 922.697 MiB/sec 1.818 GiB/sec 101.801 {}
BM_ReadColumn<true,DoubleType>/10/50 711.309 MiB/sec 1.402 GiB/sec 101.794 {}
TableSortIndicesInt64Narrow/1048576/100/2/1 1.570m items/sec 3.164m items/sec 101.501 {}
BM_ReadColumn<true,Int64Type>/50/1 917.164 MiB/sec 1.803 GiB/sec 101.357 {}
TableSortIndicesInt64Narrow/1048576/0/16/4 1.196m items/sec 2.397m items/sec 100.399 {}
BM_ReadColumn<true,DoubleType>/25/25 936.027 MiB/sec 1.825 GiB/sec 99.601 {}
BM_ReadColumn<true,Int64Type>/30/10 934.027 MiB/sec 1.820 GiB/sec 99.516 {}
RecordBatchSortIndicesInt64Narrow/1048576/0/2 4.086m items/sec 8.147m items/sec 99.416 {}
BM_ReadColumn<true,Int64Type>/50/50 927.657 MiB/sec 1.805 GiB/sec 99.239 {}
TableSortIndicesInt64Narrow/1048576/100/2/32 1.220m items/sec 2.430m items/sec 99.121 {}
BM_ReadColumn<true,Int64Type>/25/10 927.203 MiB/sec 1.800 GiB/sec 98.815 {}
RecordBatchSortIndicesInt64Narrow/1048576/100/2 4.086m items/sec 8.117m items/sec 98.645 {}
TableSortIndicesInt64Narrow/1048576/100/2/4 1.524m items/sec 3.026m items/sec 98.615 {}
TableSortIndicesInt64Narrow/1048576/100/8/4 1.148m items/sec 2.273m items/sec 97.986 {}
RecordBatchSortIndicesInt64Narrow/1048576/100/8 2.649m items/sec 5.210m items/sec 96.690 {}
TableSortIndicesInt64Narrow/1048576/0/2/4 1.620m items/sec 3.182m items/sec 96.421 {}
BM_ReadStructColumn/50 579.132 MiB/sec 1.109 GiB/sec 96.086 {}
TableSortIndicesInt64Narrow/1048576/100/16/4 1.163m items/sec 2.251m items/sec 93.513 {}
TableSortIndicesInt64Narrow/1048576/0/2/32 1.339m items/sec 2.531m items/sec 89.097 {}
ChunkedArraySortIndicesInt64Wide/8388608/100 29.774 MiB/sec 55.913 MiB/sec 87.787 {}
RecordBatchSortIndicesInt64Narrow/1048576/0/8 2.835m items/sec 5.320m items/sec 87.661 {}
BM_WriteColumn<false,Int32Type> 366.062 MiB/sec 675.455 MiB/sec 84.519 {}
RecordBatchSortIndicesInt64Narrow/1048576/0/16 1.886m items/sec 3.471m items/sec 84.011 {}
TableSortIndicesInt64Narrow/1048576/0/2/1 1.797m items/sec 3.304m items/sec 83.796 {}
BM_ReadIndividualRowGroups 1.344 GiB/sec 2.445 GiB/sec 81.933 {}
BM_WriteColumn<false,Int64Type> 709.345 MiB/sec 1.257 GiB/sec 81.445 {}
BM_ReadMultipleRowGroups 1.354 GiB/sec 2.457 GiB/sec 81.442 {}
TableSortIndicesInt64Wide/1048576/100/8/1 2.975m items/sec 5.385m items/sec 81.031 {}
BM_ReadListOfStructColumn/0 380.932 MiB/sec 686.539 MiB/sec 80.226 {}
TableSortIndicesInt64Wide/1048576/100/1/32 3.288m items/sec 5.879m items/sec 78.816 {}
BM_ReadStructOfListColumn/1 300.129 MiB/sec 536.519 MiB/sec 78.763 {}
BM_ReadColumn<false,BooleanType>/1/20 286.937 MiB/sec 512.691 MiB/sec 78.677 {}
BuildInt64DictionaryArraySimilar 322.763 MiB/sec 575.527 MiB/sec 78.313 {}
TableSortIndicesInt64Wide/1048576/100/16/4 2.841m items/sec 5.044m items/sec 77.545 {}
BM_ReadListOfStructColumn/1 338.184 MiB/sec 599.959 MiB/sec 77.406 {}
BM_ReadStructOfListColumn/0 332.894 MiB/sec 590.428 MiB/sec 77.362 {}
TableSortIndicesInt64Wide/1048576/0/1/4 5.105m items/sec 9.032m items/sec 76.920 {}
TableSortIndicesInt64Wide/1048576/0/1/32 3.403m items/sec 6.020m items/sec 76.902 {}
BM_ReadListColumn/1 421.711 MiB/sec 744.959 MiB/sec 76.652 {}
BM_ReadColumn<true,Int32Type>/10/10 581.167 MiB/sec 1023.814 MiB/sec 76.165 {}
BM_ReadListColumn/0 471.777 MiB/sec 823.412 MiB/sec 74.534 {}
BM_ReadColumn<true,Int32Type>/25/5 584.226 MiB/sec 1018.353 MiB/sec 74.308 {}
TableSortIndicesInt64Wide/1048576/100/1/4 5.087m items/sec 8.866m items/sec 74.281 {}
TableSortIndicesInt64Wide/1048576/0/16/4 2.960m items/sec 5.140m items/sec 73.669 {}
BM_ReadListColumn/50 318.370 MiB/sec 550.784 MiB/sec 73.001 {}
BM_ReadColumn<true,Int64Type>/-1/0 726.800 MiB/sec 1.225 GiB/sec 72.645 {}
BM_ReadColumn<true,DoubleType>/-1/0 724.680 MiB/sec 1.220 GiB/sec 72.348 {}
TableSortIndicesInt64Wide/1048576/100/8/4 2.942m items/sec 5.057m items/sec 71.899 {}
TableSortIndicesInt64Wide/1048576/100/16/1 3.133m items/sec 5.386m items/sec 71.888 {}
BM_ReadListOfListColumn/1 389.979 MiB/sec 668.243 MiB/sec 71.354 {}
TableSortIndicesInt64Wide/1048576/0/16/1 3.187m items/sec 5.438m items/sec 70.616 {}
BM_ReadColumn<true,Int32Type>/50/0 589.124 MiB/sec 1002.462 MiB/sec 70.161 {}
TableSortIndicesInt64Wide/1048576/0/2/1 3.183m items/sec 5.410m items/sec 70.000 {}
TableSortIndicesInt64Wide/1048576/100/2/1 3.168m items/sec 5.380m items/sec 69.838 {}
TableSortIndicesInt64Wide/1048576/0/8/4 3.021m items/sec 5.116m items/sec 69.344 {}
BM_ReadColumn<true,Int32Type>/50/50 590.403 MiB/sec 998.181 MiB/sec 69.068 {}
TableSortIndicesInt64Wide/1048576/0/2/32 2.300m items/sec 3.878m items/sec 68.601 {}
BM_ReadListOfListColumn/50 301.850 MiB/sec 508.647 MiB/sec 68.510 {}
TableSortIndicesInt64Wide/1048576/0/16/32 2.307m items/sec 3.887m items/sec 68.486 {}
ChunkCSVEscapedBlock 713.053 MiB/sec 1.171 GiB/sec 68.188 {}
BM_ReadColumn<true,BooleanType>/-1/1 146.607 MiB/sec 245.812 MiB/sec 67.667 {}
BM_ReadListOfListColumn/0 434.750 MiB/sec 728.656 MiB/sec 67.603 {}
TableSortIndicesInt64Wide/1048576/100/2/4 3.028m items/sec 5.071m items/sec 67.435 {}
TableSortIndicesInt64Wide/1048576/100/8/32 2.300m items/sec 3.848m items/sec 67.325 {}
TableSortIndicesInt64Wide/1048576/0/8/32 2.331m items/sec 3.892m items/sec 66.939 {}
BM_ReadListOfStructColumn/50 303.070 MiB/sec 505.904 MiB/sec 66.926 {}
TableSortIndicesInt64Wide/1048576/0/2/4 3.081m items/sec 5.142m items/sec 66.868 {}
BM_WriteColumn<false,DoubleType> 648.228 MiB/sec 1.056 GiB/sec 66.768 {}
TableSortIndicesInt64Wide/1048576/100/16/32 2.297m items/sec 3.820m items/sec 66.263 {}
TableSortIndicesInt64Wide/1048576/100/2/32 2.315m items/sec 3.834m items/sec 65.610 {}
BM_ReadListOfListColumn/99 495.231 MiB/sec 810.118 MiB/sec 63.584 {}
BM_ReadStructOfListColumn/50 255.635 MiB/sec 416.461 MiB/sec 62.912 {}
BM_ReadColumn<true,Int32Type>/-1/0 412.987 MiB/sec 670.168 MiB/sec 62.274 {}
TableSortIndicesInt64Wide/1048576/0/8/1 3.226m items/sec 5.196m items/sec 61.028 {}
BM_ReadColumn<true,BooleanType>/5/10 149.522 MiB/sec 238.203 MiB/sec 59.309 {}
ArraySortIndicesInt64Wide/8388608/100 49.920 MiB/sec 78.489 MiB/sec 57.230 {}
BuildStringDictionaryArray 219.948 MiB/sec 344.487 MiB/sec 56.622 {}
BM_ReadListColumn/99 566.447 MiB/sec 886.547 MiB/sec 56.510 {}
TableSortIndicesInt64Wide/1048576/0/1/1 6.616m items/sec 10.237m items/sec 54.727 {}
RecordBatchSortIndicesInt64Wide/1048576/0/8 6.343m items/sec 9.775m items/sec 54.116 {}
BuildBooleanArrayNoNulls 2.117 GiB/sec 3.263 GiB/sec 54.088 {}
RecordBatchSortIndicesInt64Wide/1048576/100/8 6.280m items/sec 9.657m items/sec 53.786 {}
BM_WriteColumn<true,Int32Type> 168.001 MiB/sec 258.337 MiB/sec 53.771 {}
BM_WriteColumn<true,Int64Type> 332.287 MiB/sec 509.959 MiB/sec 53.470 {}
TableSortIndicesInt64Wide/1048576/100/1/1 6.648m items/sec 10.185m items/sec 53.207 {}
RecordBatchSortIndicesInt64Wide/1048576/0/2 6.374m items/sec 9.760m items/sec 53.118 {}
BM_ReadStructOfListColumn/99 415.166 MiB/sec 631.341 MiB/sec 52.070 {}
RecordBatchSortIndicesInt64Wide/1048576/100/2 6.365m items/sec 9.647m items/sec 51.566 {}
BM_ReadListOfStructColumn/99 513.249 MiB/sec 772.313 MiB/sec 50.475 {}
RecordBatchSortIndicesInt64Wide/1048576/100/16 5.437m items/sec 8.116m items/sec 49.276 {}
RecordBatchSortIndicesInt64Wide/1048576/0/1 6.942m items/sec 10.314m items/sec 48.570 {}
ArraySortIndicesInt64Wide/1048576/100 63.910 MiB/sec 93.497 MiB/sec 46.296 {}
RecordBatchSortIndicesInt64Wide/1048576/0/16 5.546m items/sec 8.109m items/sec 46.230 {}
BM_WriteColumn<true,DoubleType> 315.962 MiB/sec 459.860 MiB/sec 45.543 {}
RecordBatchSortIndicesInt64Wide/1048576/100/1 7.033m items/sec 10.103m items/sec 43.666 {}
ChunkedArraySortIndicesInt64Wide/1048576/100 48.478 MiB/sec 69.132 MiB/sec 42.604 {}
ParseCSVFlightsExample 342.515 MiB/sec 486.588 MiB/sec 42.063 {}
BM_WriteColumn<true,BooleanType> 48.873 MiB/sec 64.632 MiB/sec 32.246 {}
ParseCSVEscapedBlock 408.185 MiB/sec 538.355 MiB/sec 31.890 {}
ChunkCSVQuotedBlock 1.078 GiB/sec 1.401 GiB/sec 29.968 {}
ParseCSVQuotedBlock 411.220 MiB/sec 455.145 MiB/sec 10.682 {}
BuildAdaptiveIntNoNullsScalarAppend 2.413 GiB/sec 2.639 GiB/sec 9.380 {}
BM_WriteColumn<false,BooleanType> 249.169 MiB/sec 221.663 MiB/sec -11.039 {}
ParseCSVStocksExample 583.968 MiB/sec 464.093 MiB/sec -20.528 {}
-----------------------------------------------------------------------------
Regressions: (3)
-----------------------------------------------------------------------------
benchmark baseline contender change % counters
ParseCSVVehiclesExample 610.407 MiB/sec 454.401 MiB/sec -25.558 {}
ArrayDataConstructDestruct 230411.946447 103864.305907 -54.922 {}
ChunkCSVNoNewlinesBlock 315.637107 111.170483 -64.779 {}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment