-
Notifications
You must be signed in to change notification settings - Fork 13.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FLINK-31993][runtime] Initialize and pass down FailureEnrichers #22516
Conversation
74fbcfa
to
bdae163
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM overall, minus a few cosmetic comments. I think the commit message is also misleading
Fail fast on bad FailureEnricher JM startup as given by the user
since we still have filterInvalidEnrichers
in the codepath
flink-runtime/src/main/java/org/apache/flink/runtime/minicluster/MiniCluster.java
Outdated
Show resolved
Hide resolved
...c/main/java/org/apache/flink/runtime/jobmaster/factories/DefaultJobMasterServiceFactory.java
Show resolved
Hide resolved
flink-runtime/src/main/java/org/apache/flink/runtime/entrypoint/ClusterEntrypoint.java
Outdated
Show resolved
Hide resolved
flink-runtime/src/main/java/org/apache/flink/runtime/entrypoint/ClusterEntrypoint.java
Outdated
Show resolved
Hide resolved
flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherServices.java
Outdated
Show resolved
Hide resolved
flink-runtime/src/main/java/org/apache/flink/runtime/failure/FailureEnricherUtils.java
Outdated
Show resolved
Hide resolved
* Init FailureEnrichers as part of ClusterEntrypoint
Awesome! Thanks @dmvk ! Updated |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 LGTM, good job; we should probably follow-up on the MiniCluster support
@@ -561,6 +561,7 @@ private void setupDispatcherResourceManagerComponents( | |||
metricRegistry, | |||
new MemoryExecutionGraphInfoStore(), | |||
metricQueryServiceRetriever, | |||
Collections.emptySet(), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What's the reason for not supporting the minicluster?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will be done as part of FLINK-31895
https://issues.apache.org/jira/browse/FLINK-31993
The set of Enrichers is then passed down to JM and Scheduler implementations as needed.