Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-38923][TESTS] Regenerate benchmark results #36225

Closed
wants to merge 1 commit into from
Closed

[SPARK-38923][TESTS] Regenerate benchmark results #36225

wants to merge 1 commit into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Apr 16, 2022

What changes were proposed in this pull request?

This aims to regenerate benchmark results on master branch to compare with Apache Spark 3.3.0 release.

Why are the changes needed?

This is a new reference value.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manually verified.

@dongjoon-hyun
Copy link
Member Author

cc @viirya and @MaxGekk

Comment on lines +13 to +16
Array: Int with unsafe:true 3 3 0 336.3 3.0 88.9X
Array: Long with unsafe:true 5 5 0 205.6 4.9 54.4X
Array: Float with unsafe:true 3 3 0 324.1 3.1 85.7X
Array: Double with unsafe:true 5 5 0 207.2 4.8 54.8X
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems obvious performance regression?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given that we change Java version and OS, this small change look okay to me~

- Array: Double with unsafe:true                           5              5           0        210.6           4.7      57.1X
+ Array: Double with unsafe:true                           5              5           0        207.2           4.8      54.8X

Without nested predicate Pushdown 60692 61231 403 1.7 578.8 1.0X
With nested predicate Pushdown 126 159 37 834.5 1.2 483.0X
Without nested predicate Pushdown 7005 7074 78 15.0 66.8 1.0X
With nested predicate Pushdown 44 53 9 2378.0 0.4 158.9X
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here too

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this could be. Since this is a simple regeneration, we can revisit them one by one.

@dongjoon-hyun
Copy link
Member Author

Thank you, @viirya . Since this is a regeneration of benchmark result, I'll merge first.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-38923 branch April 16, 2022 17:47
@viirya
Copy link
Member

viirya commented Apr 16, 2022

Thank you @dongjoon-hyun !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants