New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FLINK-14336][DataStream] Log Exception for failed checkpoint on TaskExecutor side #9873
Conversation
Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community Automated ChecksLast check on commit d62e6da (Thu Oct 24 18:05:11 UTC 2019) Warnings:
Mention the bot in a comment to re-run the automated checks. Review Progress
Please see the Pull Request Review Guide for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commandsThe @flinkbot bot supports the following commands:
|
@@ -1115,6 +1115,12 @@ public void run() { | |||
checkpointMetaData.getCheckpointId()); | |||
} | |||
} catch (Exception e) { | |||
if (LOG.isDebugEnabled()) { | |||
LOG.debug("{} - asynchronous part of checkpoint {} could not be completed.", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
IMO, it could be an INFO level Log.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
First, I want to use WARN or even ERROR level, but the frequency of checkpoint may be too small, we may have logging flood if use INFO or above log level, so I used debug here. If we do not have so frequent checkpoints, we can configure the log level of log-4j properties to show this log. what do you think about this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Make sense. +1 for merge.
kindly ping @zentol |
What is the purpose of the change
Exceptions that are thrown in
AsyncCheckpointRunnable#run
and subsequently being handled inAsyncCheckpointRunnable#handleExecutionException
are never logged on the TaskExecutor side, and are only forwarded to the JobMaster. This PR will log the Exception on TaskExecutor side.Brief change log
Log Exception for failed checkpoint on TaskExecutor side.
Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:
@Public(Evolving)
: (no)Documentation
cc @zentol