Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-40420][SQL] Sort error message parameters by names in the JSON formats #37875

Closed
wants to merge 3 commits into from

Conversation

MaxGekk
Copy link
Member

@MaxGekk MaxGekk commented Sep 14, 2022

What changes were proposed in this pull request?

In the PR, I propose to sort error message parameters in the MINIMAL and STANDARD formats (JSON formats) by parameter names.

Why are the changes needed?

To make the output in JSON format stable.

Does this PR introduce any user-facing change?

Yes.

How was this patch tested?

By running the modified test suites:

$ build/sbt "sql/testOnly org.apache.spark.sql.SQLQueryTestSuite"

@MaxGekk MaxGekk changed the title [WIP][SPARK-40420][SQL] Sort error message parameters by names in the JSON formats [SPARK-40420][SQL] Sort error message parameters by names in the JSON formats Sep 14, 2022
@MaxGekk MaxGekk marked this pull request as ready for review September 14, 2022 08:14
@MaxGekk
Copy link
Member Author

MaxGekk commented Sep 14, 2022

@cloud-fan @gengliangwang @srielau @anchovYu @HyukjinKwon Could you review this PR, please. I have faced to an issue while slightly changing the implementation in #37871 - the output in the JSON formats is not stable and depends on Map's impls (actually Scala's map cannot guarantee the order obviously).

@MaxGekk
Copy link
Member Author

MaxGekk commented Sep 14, 2022

The failure Run / Scala 2.13 build with SBT is not related to the PR but I will re-trigger it just in case.

@MaxGekk
Copy link
Member Author

MaxGekk commented Sep 14, 2022

Run / Scala 2.13 build with SBT passed successfully. Merging to master. Thank you, @cloud-fan for review.

@MaxGekk MaxGekk closed this in 801faba Sep 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants