Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-15176: Fix various issues introduced in the asof-join benchmark by ARROW-17980 and ARROW-15732 #15190

Conversation

@github-actions
Copy link

github-actions bot commented Jan 4, 2023

⚠️ GitHub issue #15176 has been automatically assigned in GitHub to PR creator.

@github-actions
Copy link

github-actions bot commented Jan 4, 2023

⚠️ GitHub issue #15176 has no components, please add labels for components.

AsofJoinNodeOptions options =
GetRepeatedOptions(int(state.range(4)), kTimeCol, {kKeyCol}, tolerance);
auto options = std::make_shared<AsofJoinNodeOptions>(
GetRepeatedOptions(int(state.range(4) + 1), kTimeCol, {kKeyCol}, tolerance));
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rtpsw can you verify this change? state.range(4) is the # of right tables but it seems we need a Keys element for each of the right tables as well as 1 for the left table.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I somehow missed this. The fix seems right to me.

@westonpace
Copy link
Member Author

@ursabot please benchmark lang=C++

@ursabot
Copy link

ursabot commented Jan 4, 2023

Benchmark runs are scheduled for baseline = ec9a8a3 and contender = 987a9ca. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Skipped ⚠️ Only ['Python'] langs are supported on ec2-t3-xlarge-us-east-2] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.0% ⬆️0.0%] test-mac-arm
[Skipped ⚠️ Only ['JavaScript', 'Python', 'R'] langs are supported on ursa-i9-9960x] ursa-i9-9960x
[Failed ⬇️0.0% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 987a9ca1 test-mac-arm
[Finished] 987a9ca1 ursa-thinkcentre-m75q
[Finished] ec9a8a32 ec2-t3-xlarge-us-east-2
[Failed] ec9a8a32 test-mac-arm
[Finished] ec9a8a32 ursa-i9-9960x
[Failed] ec9a8a32 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

@westonpace
Copy link
Member Author

Odd...ursabot scheduled the runs but gave me links to old buildkite builds. Here are the correct links:

test-mac-arm: https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/builds/2134
ursa-thinkcentre-m75q: https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-thinkcentre-m75q/builds/2126

@ElenaHenderson is this a known issue?

@westonpace
Copy link
Member Author

Both benchmark builds passed so I think this addresses the issue.

@ElenaHenderson
Copy link
Contributor

@westonpace Great! Thank you!

ursabot gives links to baseline runs in addition to the contender runs:

These are runs for the PR commit (contender):
[Finished] 987a9ca1 test-mac-arm
[Finished] 987a9ca1 ursa-thinkcentre-m75q
[Finished] ec9a8a32 ec2-t3-xlarge-us-east-2
These are runs for baseline:
[Failed] ec9a8a32 test-mac-arm
[Finished] ec9a8a32 ursa-i9-9960x
[Failed] ec9a8a32 ursa-thinkcentre-m75q

@westonpace
Copy link
Member Author

Ah, that makes sense. Just a matter of reading more closely. I'm going to go ahead and merge this so CI can be unblocked. @rtpsw , if you have any concerns let's address in a follow-up.

@westonpace westonpace merged commit 773b5d8 into apache:master Jan 5, 2023
EpsilonPrime pushed a commit to EpsilonPrime/arrow that referenced this pull request Jan 5, 2023
…ark by ARROW-17980 and ARROW-15732 (apache#15190)

* Closes: apache#15176

Authored-by: Weston Pace <weston.pace@gmail.com>
Signed-off-by: Weston Pace <weston.pace@gmail.com>
@ursabot
Copy link

ursabot commented Jan 5, 2023

Benchmark runs are scheduled for baseline = 2410d36 and contender = 773b5d8. 773b5d8 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.13% ⬆️0.0%] test-mac-arm
[Finished ⬇️1.02% ⬆️0.0%] ursa-i9-9960x
[Failed ⬇️0.0% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 773b5d81 ec2-t3-xlarge-us-east-2
[Finished] 773b5d81 test-mac-arm
[Finished] 773b5d81 ursa-i9-9960x
[Finished] 773b5d81 ursa-thinkcentre-m75q
[Finished] 2410d367 ec2-t3-xlarge-us-east-2
[Failed] 2410d367 test-mac-arm
[Finished] 2410d367 ursa-i9-9960x
[Failed] 2410d367 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

vibhatha pushed a commit to vibhatha/arrow that referenced this pull request Jan 9, 2023
…ark by ARROW-17980 and ARROW-15732 (apache#15190)

* Closes: apache#15176

Authored-by: Weston Pace <weston.pace@gmail.com>
Signed-off-by: Weston Pace <weston.pace@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants