-
Notifications
You must be signed in to change notification settings - Fork 28k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-38923][TESTS] Regenerate benchmark results #36225
Conversation
Array: Int with unsafe:true 3 3 0 336.3 3.0 88.9X | ||
Array: Long with unsafe:true 5 5 0 205.6 4.9 54.4X | ||
Array: Float with unsafe:true 3 3 0 324.1 3.1 85.7X | ||
Array: Double with unsafe:true 5 5 0 207.2 4.8 54.8X |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Seems obvious performance regression?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Given that we change Java version and OS, this small change look okay to me~
- Array: Double with unsafe:true 5 5 0 210.6 4.7 57.1X
+ Array: Double with unsafe:true 5 5 0 207.2 4.8 54.8X
Without nested predicate Pushdown 60692 61231 403 1.7 578.8 1.0X | ||
With nested predicate Pushdown 126 159 37 834.5 1.2 483.0X | ||
Without nested predicate Pushdown 7005 7074 78 15.0 66.8 1.0X | ||
With nested predicate Pushdown 44 53 9 2378.0 0.4 158.9X |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
here too
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, this could be. Since this is a simple regeneration, we can revisit them one by one.
Thank you, @viirya . Since this is a regeneration of benchmark result, I'll merge first. |
Thank you @dongjoon-hyun ! |
What changes were proposed in this pull request?
This aims to regenerate benchmark results on
master
branch to compare with Apache Spark 3.3.0 release.Why are the changes needed?
This is a new reference value.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Manually verified.