-
Notifications
You must be signed in to change notification settings - Fork 13.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Can we add configable debug settings for delay pod delete when there is a Error
state of pods ?
#8564
Comments
Thanks for opening your first issue here! Be sure to follow the issue template! |
Hi gwind, There is an option to keep / not delete worker pods: |
I've solved it by hack the airflow code.
👍 Indeed, there is a option in https://github.com/apache/airflow/blob/master/airflow/config_templates/default_airflow.cfg#L828
But for the guys who use Thanks ! |
AIRFLOW__KUBERNETES__RUN_AS_USER: "50000" |
Hi guys! How did you solve the problem ?
is there any setting etc to fix it??? |
This bug caused by wrong user environment in the airflow POD mostly. You can use |
Hi! I've setup it as proposed: And it worked. :) |
Description
Add configable debug settings for delay pod delete when there is a
Error
state of pods.Use case / motivation
In
apache/airflow:1.10.10
image.I'm deploy a airflow in k8s, want to use Kubernetes Executor for task excute.
If the pod got Error state, airflow scheduler would delete pod immediately.
So we can not see what happend, pod is deleted in some seconds.
When I add
time.sleep()
inkubernetes_executor.py:896
, like this:When trigger execute manully, I can see pod got
Error
state soon.Watch pod's log:
It's a error in container. It's easy to debug now.
The text was updated successfully, but these errors were encountered: