Created
May 29, 2024 15:25
-
-
Save JerAguilon/68568525f3818f60dc2ffcfe5eb6aba2 to your computer and use it in GitHub Desktop.
arrow-acero-asof-join-benchmark before/after
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| Benchmark Time CPU Iterations UserCounters... | |
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| AsOfJoinOverhead/left_freq:200/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:200/right_cols:20/right_ids:500/real_time 86953291 ns 477875 ns 8 bytes_per_second=318.47M/s maximum_peak_memory=29.0547M rows_per_second=1.85157M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 44263943 ns 307500 ns 16 bytes_per_second=314.748M/s maximum_peak_memory=29.0547M rows_per_second=1.82993M/s | |
| AsOfJoinOverhead/left_freq:1000/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:1000/right_cols:20/right_ids:500/real_time 18011824 ns 184737 ns 38 bytes_per_second=315.126M/s maximum_peak_memory=29.0547M rows_per_second=1.83213M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:10/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:10/right_ids:500/real_time 29811033 ns 230292 ns 24 bytes_per_second=249.975M/s maximum_peak_memory=29.0547M rows_per_second=2.71711M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 44000122 ns 305187 ns 16 bytes_per_second=316.635M/s maximum_peak_memory=29.0547M rows_per_second=1.8409M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:100/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:100/right_ids:500/real_time 159673771 ns 762000 ns 4 bytes_per_second=411.915M/s maximum_peak_memory=72.2598M rows_per_second=507.284k/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:100/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:100/real_time 9056190 ns 133026 ns 77 bytes_per_second=307.679M/s maximum_peak_memory=72.2598M rows_per_second=1.78883M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 44853875 ns 333687 ns 16 bytes_per_second=310.609M/s maximum_peak_memory=72.2598M rows_per_second=1.80586M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:1000/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:1000/real_time 88941015 ns 491625 ns 8 bytes_per_second=313.286M/s maximum_peak_memory=72.2598M rows_per_second=1.82143M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 43866396 ns 306687 ns 16 bytes_per_second=317.601M/s maximum_peak_memory=72.2598M rows_per_second=1.84652M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:10/right_freq:400/right_cols:20/right_ids:500/real_time 222148597 ns 1595333 ns 3 bytes_per_second=344.931M/s maximum_peak_memory=83.9027M rows_per_second=2.00541M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:50/right_freq:400/right_cols:20/right_ids:500/real_time 1054017416 ns 7868000 ns 1 bytes_per_second=337.059M/s maximum_peak_memory=388.827M rows_per_second=1.95965M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:1000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 42805268 ns 751812 ns 16 bytes_per_second=325.474M/s maximum_peak_memory=388.827M rows_per_second=1.89229M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 43806492 ns 303625 ns 16 bytes_per_second=318.035M/s maximum_peak_memory=388.827M rows_per_second=1.84904M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:32000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 45215409 ns 145938 ns 16 bytes_per_second=308.125M/s maximum_peak_memory=388.827M rows_per_second=1.79142M/s |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| Benchmark Time CPU Iterations UserCounters... | |
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| AsOfJoinOverhead/left_freq:200/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:200/right_cols:20/right_ids:500/real_time 63487699 ns 584667 ns 9 bytes_per_second=436.179M/s maximum_peak_memory=29.0547M rows_per_second=2.53592M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 31790917 ns 349261 ns 23 bytes_per_second=438.238M/s maximum_peak_memory=29.0547M rows_per_second=2.5479M/s | |
| AsOfJoinOverhead/left_freq:1000/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:1000/right_cols:20/right_ids:500/real_time 13236391 ns 232396 ns 53 bytes_per_second=428.818M/s maximum_peak_memory=29.0547M rows_per_second=2.49313M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:10/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:10/right_ids:500/real_time 24917818 ns 272107 ns 28 bytes_per_second=299.063M/s maximum_peak_memory=29.0547M rows_per_second=3.25069M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 32574575 ns 358952 ns 21 bytes_per_second=427.696M/s maximum_peak_memory=29.0547M rows_per_second=2.4866M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:100/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:100/right_ids:500/real_time 96366381 ns 849857 ns 7 bytes_per_second=682.52M/s maximum_peak_memory=72.2598M rows_per_second=840.542k/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:100/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:100/real_time 6767402 ns 181452 ns 104 bytes_per_second=411.739M/s maximum_peak_memory=72.2598M rows_per_second=2.39383M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 33157780 ns 374190 ns 21 bytes_per_second=420.173M/s maximum_peak_memory=72.2598M rows_per_second=2.44287M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:1000/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:1000/real_time 66012265 ns 580182 ns 11 bytes_per_second=422.103M/s maximum_peak_memory=72.2598M rows_per_second=2.45409M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 32623331 ns 373524 ns 21 bytes_per_second=427.056M/s maximum_peak_memory=72.2598M rows_per_second=2.48289M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:10/right_freq:400/right_cols:20/right_ids:500/real_time 223404111 ns 1989333 ns 3 bytes_per_second=342.993M/s maximum_peak_memory=83.9027M rows_per_second=1.99414M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:50/right_freq:400/right_cols:20/right_ids:500/real_time 1140098042 ns 9571000 ns 1 bytes_per_second=311.61M/s maximum_peak_memory=388.827M rows_per_second=1.81169M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:1000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 31393605 ns 857739 ns 23 bytes_per_second=443.785M/s maximum_peak_memory=388.827M rows_per_second=2.58014M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 33079567 ns 360952 ns 21 bytes_per_second=421.166M/s maximum_peak_memory=388.827M rows_per_second=2.44864M/s | |
| AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/batch_size:32000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time 33174482 ns 181571 ns 21 bytes_per_second=419.961M/s maximum_peak_memory=388.827M rows_per_second=2.44164M/s |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment