Skip to content

Conversation

@jiwen624
Copy link

@jiwen624 jiwen624 commented Nov 25, 2025

What changes were proposed in this pull request?

In the method org.apache.spark.status.LiveEntityHelpers.makeNegative, it calls createMetrics with a wrong arguments order which passes values to wrong positions. The order is wrong starting from the shufflePushReadMetrics. corruptMergedBlockChunks

Why are the changes needed?

Passing argument values to wrong positions messes up the method call and negates metrics with wrong values.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Added a test case.

Was this patch authored or co-authored using generative AI tooling?

No

@github-actions github-actions bot added the CORE label Nov 25, 2025
@jiwen624 jiwen624 force-pushed the makeNegative-arg-order branch 2 times, most recently from 44ec6e2 to 36067cd Compare November 25, 2025 20:43
@jiwen624 jiwen624 force-pushed the makeNegative-arg-order branch from 36067cd to 7a23a9b Compare November 26, 2025 06:18
@jiwen624 jiwen624 changed the title [WIP][SPARK-54505][UI][SHUFFLE] Correct the arg order of createMetrics call in makeNegative [WIP][SPARK-54505][UI][SHUFFLE] Correct the arguments order of createMetrics call in makeNegative Nov 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant