Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SPARK-26530][CORE] Validate heartheat arguments in HeartbeatReceiver
## What changes were proposed in this pull request? Currently, heartbeat related arguments is not validated in spark, so if these args are inproperly specified, the Application may run for a while and not failed until the max executor failures reached(especially with spark.dynamicAllocation.enabled=true), thus may incurs resources waste. This PR is to precheck these arguments in HeartbeatReceiver to fix this problem. ## How was this patch tested? NA-just validation changes Closes #23445 from liupc/validate-heartbeat-arguments-in-SparkSubmitArguments. Authored-by: Liupengcheng <liupengcheng@xiaomi.com> Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
- Loading branch information