Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-46987][CONNECT] ProtoUtils.abbreviate avoid unnecessary setField operation #45045

Closed

Conversation

zhengruifeng
Copy link
Contributor

@zhengruifeng zhengruifeng commented Feb 6, 2024

What changes were proposed in this pull request?

ProtoUtils.abbreviate avoid unnecessary setField operation

Why are the changes needed?

according to the API reference:

Message.Builder toBuilder()
Constructs a builder initialized with the current message. Use this to derive a new message from the current one.

the builder we used already has all the fields, so we only need to update the truncated fields.

Does this PR introduce any user-facing change?

no

How was this patch tested?

ci

Was this patch authored or co-authored using generative AI tooling?

no

Copy link
Contributor

@LuciferYang LuciferYang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Although this PR looks safe, could you re-trigger the failed pipeline because it's connect -related module, @zhengruifeng ?

ERROR [38.613s]: test_crossvalidator_with_fold_col (pyspark.ml.tests.connect.test_connect_tuning.CrossValidatorTestsOnConnect)

@xinrong-meng
Copy link
Member

xinrong-meng commented Feb 6, 2024

LGTM once tests passed, thanks!
Retrrigered builder

@LuciferYang
Copy link
Contributor

All test passed. Merged into master for Spark 4.0. Thanks @zhengruifeng @dongjoon-hyun @xinrong-meng

@zhengruifeng zhengruifeng deleted the connect_redaction_nit branch February 7, 2024 02:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants