Deploy a sweeper pod to clear completed pod histories #4500
Conversation
kube/resources/pod-sweeper.yaml
Outdated
| command: | ||
| - /bin/sh | ||
| - -c | ||
| - while :; do kubectl get pod | grep Completed | awk '{print $1}' | xargs --no-run-if-empty kubectl delete pod | xargs --no-run-if-empty echo `date "+%Y-%m-%d %H:%M:%S"`; sleep 300; done |
There was a problem hiding this comment.
This doesn't handle namespaced airbyte deployments. It also doesn't limit itself to just pods that were created as part of Airbyte.
Probably the easiest way to do this is to add a label to all connector pods / command fetcher pods that makes it easy to kubectl get them by this label. Then you can also insert the namespace used in a similar way that we pulled it in as an env variable before, and use that to scope the search for pods.
There is a grep on Completed, is it possible for them to be completed and running at the same time? |
|
Pods might be stuck in an |
ChristopheDuong
force-pushed
the
chris/pod-sweeper
branch
from
156e7a2
to
104d2dc
Compare
github-actions
bot
added
the
area/documentation
What
Closes #3634
How
Deploy a separate pod sweeper using shell command