-
Notifications
You must be signed in to change notification settings - Fork 28.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-27034][SPARK-27123][SQL][FOLLOWUP] Update Nested Schema Pruning BM result with EC2 #24078
Conversation
cc @viirya |
Thank you for review, @viirya . |
Thanks for updating it. @dongjoon-hyun |
Test build #103411 has finished for PR 24078 at commit
|
retest this please |
Sorry if I missed something, @dongjoon-hyun. Does this PR simply updates the results against EC2 or updates outdated results? I think it's also fine to use Mac if it's the former. In any event, I guess it's fine to go ahead but wanted to be sure if there'a any reason for it. |
Test build #103417 has finished for PR 24078 at commit
|
@HyukjinKwon . This is an update to make the baseline for the other PR. Also, there is another PR which landed on the master at the same time |
Top-level column 263 315 36 3.8 263.2 1.0X | ||
Nested column 2111 2622 613 0.5 2111.1 0.1X | ||
Top-level column 434 508 108 2.3 434.3 1.0X | ||
Nested column 625 647 23 1.6 624.8 0.7X |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is the result of #24049 .
Hi, @dbtsai . Could you review this please when you have some time? |
LGTM. Thanks! |
…g BM result with EC2 ## What changes were proposed in this pull request? This is a follow up PR for #23943 in order to update the benchmark result with EC2 `r3.xlarge` instance. ## How was this patch tested? N/A. (Manually compare the diff) Closes #24078 from dongjoon-hyun/SPARK-27034. Authored-by: Dongjoon Hyun <dhyun@apple.com> Signed-off-by: DB Tsai <d_tsai@apple.com>
Thank you so much, @dbtsai , @viirya , @HyukjinKwon , @dilipbiswal ! |
What changes were proposed in this pull request?
This is a follow up PR for #23943 in order to update the benchmark result with EC2
r3.xlarge
instance.How was this patch tested?
N/A. (Manually compare the diff)