Skip to content

[SPARK-47364][CORE] Make PluginEndpoint warn when plugins reply for one-way message#45478

Closed
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-47364
Closed

[SPARK-47364][CORE] Make PluginEndpoint warn when plugins reply for one-way message#45478
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-47364

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Mar 12, 2024

What changes were proposed in this pull request?

This PR aims to make PluginEndpoint warn when plugins reply for one-way message.

Why are the changes needed?

Previously, it logs INFO level messages. Sometimes, it look 66% driver INFO logs. We had better increase the log level to make the users fix the issues.

Does this PR introduce any user-facing change?

No. Only a log level.

How was this patch tested?

Manually.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the CORE label Mar 12, 2024
@mridulm
Copy link
Contributor

mridulm commented Mar 12, 2024

Why move it to warn @dongjoon-hyun ? Was it causing some issues to help debug ?

@dongjoon-hyun
Copy link
Member Author

We want to higher the log level to enforce the developers to fix it instead of ignoring it.

@mridulm
Copy link
Contributor

mridulm commented Mar 12, 2024

Sounds good, thanks for the change.

@dongjoon-hyun
Copy link
Member Author

Thank you, @mridulm . Merged to master for Apache Spark 4.0.0.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-47364 branch March 12, 2024 19:44
snmvaughan pushed a commit to snmvaughan/spark that referenced this pull request Mar 26, 2024
… one-way message

### What changes were proposed in this pull request?

This PR aims to make `PluginEndpoint` warn when plugins reply for one-way message.

### Why are the changes needed?

Previously, it logs `INFO` level messages. Sometimes, it look 66% driver INFO logs. We had better increase the log level to make the users fix the issues.

### Does this PR introduce _any_ user-facing change?

No. Only a log level.

### How was this patch tested?

Manually.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#45478 from dongjoon-hyun/SPARK-47364.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants