New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-26588][CORE] Idle executor should properly be removed when no job is su… #23509
Conversation
CC @jerryshao |
Test build #4502 has finished for PR 23509 at commit
|
Can you please describe how to reproduce your problem? |
Execute the following command and waiting for 60 seconds. The problem can be observed from Spark Web UI under the Executors Tab.
|
|
Hi @jerryshao I guess this problem was introduced by the patch SPARK-21656. |
CC @tgravescs |
Jenkins, retest this please. |
I can reproduce this issue, will spend time on it. Thanks. |
Test build #101223 has finished for PR 23509 at commit
|
Jenkins, retest this please. |
The change itself looks fine to me. @tgravescs @vanzin would you please also take a look. |
Test build #101284 has finished for PR 23509 at commit
|
Already fixed by SPARK-26758. |
What changes were proposed in this pull request?
I enable dynamic allocation feature with spark-shell and do not submit any task. After spark.dynamicAllocation.executorIdleTimeout seconds(default 60s), there is still one active executor, which is abnormal. All idle executors are timeout and should be removed.(default spark.dynamicAllocation.minExecutors=0). The spark-shell command show below:
spark-shell --master=yarn --conf spark.ui.port=8040 --conf spark.dynamicAllocation.enabled=true --conf spark.dynamicAllocation.maxExecutors=8 --conf spark.dynamicAllocation.initialExecutors=4 --conf spark.shuffle.service.enabled=true
How was this patch tested?
unit tests