-
Notifications
You must be signed in to change notification settings - Fork 28k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-47589][SQL]Hive-Thriftserver: Migrate logError with variables to structured logging framework #45936
[SPARK-47589][SQL]Hive-Thriftserver: Migrate logError with variables to structured logging framework #45936
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, LGTM (Pending CIs).
Oh, should this be |
Just for my knowledge, may I ask why this should be different from the GitHub Action label, @gengliangwang ? |
@dongjoon-hyun ok, I just changed back to |
Oh, I didn't mean it was wrong here. I want to understand the organization of this log migration workitem. :) |
I am trying to split the tasks as per the "project" definition in SBT. For example, we got project Connectors are special. We can have 3 PRs to cover all of them, instead of migration for each connector. There are around 30 migration tasks from https://issues.apache.org/jira/browse/SPARK-47240. The size seems reasonable. It is neither too large nor too small. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Left one question, but not a LGTM blocker.
@@ -142,7 +144,9 @@ private[hive] class SparkExecuteStatementOperation( | |||
} catch { | |||
case NonFatal(e) => | |||
setOperationException(new HiveSQLException(e)) | |||
logError(s"Error cancelling the query after timeout: $timeout seconds") | |||
val timeout_ms = timeout * MILLIS_PER_SECOND |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
qq, just for my personal understanding: why do we convert second to millisecond here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@dongjoon-hyun @itholic Thanks for the review. Merging to master |
+1, LGTM. Thank you! |
What changes were proposed in this pull request?
Migrate logError with variables of Hive-thriftserver module to the structured logging framework.
Why are the changes needed?
To enhance Apache Spark's logging system by implementing structured logging.
Does this PR introduce any user-facing change?
No
How was this patch tested?
Existing UT
Was this patch authored or co-authored using generative AI tooling?
No