-
Notifications
You must be signed in to change notification settings - Fork 28k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-47921][CONNECT] Fix ExecuteJobTag creation in ExecuteHolder #46140
[SPARK-47921][CONNECT] Fix ExecuteJobTag creation in ExecuteHolder #46140
Conversation
dd6636b
to
2a64b70
Compare
We may want to rather fix the arguments of Lines 296 to 304 in 2a64b70
Lines 312 to 321 in 2a64b70
|
Also cc @gengliangwang @juliuszsompolski |
@@ -37,7 +37,7 @@ class SparkConnectServerListenerSuite | |||
|
|||
private var kvstore: ElementTrackingStore = _ | |||
|
|||
private val jobTag = ExecuteJobTag("sessionId", "userId", "operationId") | |||
private val jobTag = ExecuteJobTag("userId", "sessionId", "operationId") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
From the code changes, there does seem to be a bug. All the callers are using the correct order. This PR seems just to unify the usages for such functions.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The original fix is dd6636b.
I'm fine with it too, but I asked #46140 (comment) because I worried the inconsistency with the similar API.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks for spotting this.
Thanks! merging to master/3.5. |
### What changes were proposed in this pull request? This PR fixes a bug in the ExecuteJobTag creation in ExecuteHolder. The sessionId and userId are reversed. https://github.com/apache/spark/blob/8aa8ad6be7b3eeceafa2ad1e9211fb8133bb675c/connector/connect/server/src/main/scala/org/apache/spark/sql/connect/service/ExecuteHolder.scala#L296-L299 ### Why are the changes needed? To fix a bug ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Existing test ### Was this patch authored or co-authored using generative AI tooling? No Closes #46140 from allisonwang-db/spark-47921-execute-job-tag. Authored-by: allisonwang-db <allison.wang@databricks.com> Signed-off-by: Takuya UESHIN <ueshin@databricks.com> (cherry picked from commit 5a1559a) Signed-off-by: Takuya UESHIN <ueshin@databricks.com>
### What changes were proposed in this pull request? This PR fixes a bug in the ExecuteJobTag creation in ExecuteHolder. The sessionId and userId are reversed. https://github.com/apache/spark/blob/8aa8ad6be7b3eeceafa2ad1e9211fb8133bb675c/connector/connect/server/src/main/scala/org/apache/spark/sql/connect/service/ExecuteHolder.scala#L296-L299 ### Why are the changes needed? To fix a bug ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Existing test ### Was this patch authored or co-authored using generative AI tooling? No Closes apache#46140 from allisonwang-db/spark-47921-execute-job-tag. Authored-by: allisonwang-db <allison.wang@databricks.com> Signed-off-by: Takuya UESHIN <ueshin@databricks.com>
What changes were proposed in this pull request?
This PR fixes a bug in the ExecuteJobTag creation in ExecuteHolder. The sessionId and userId are reversed.
spark/connector/connect/server/src/main/scala/org/apache/spark/sql/connect/service/ExecuteHolder.scala
Lines 296 to 299 in 8aa8ad6
Why are the changes needed?
To fix a bug
Does this PR introduce any user-facing change?
No
How was this patch tested?
Existing test
Was this patch authored or co-authored using generative AI tooling?
No