-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Prow is dropping too many webhooks #1163
Comments
PR kubernetes/kubernetes#37312 appears to be blocked by this issue? Is there a workaround? |
You can just ask for a retest manually. |
Got it thanks. |
This is the same symptom that lead to kubernetes/kubernetes#32415. |
Temporary fix: I have a VM running a very simple proxy on GCE that does retries on transport failure. We should be getting webhooks now every time, but there's still a real problem. |
OK, something was borked in the cluster. I recreated it in a new project and we're back to not dropping hooks. |
Produced via: `prettier --write --prose-wrap=always $(find -name '*.md' | grep -v vendor | grep -v .github)` /assign @adrcunha
I was previously dropping 1 webhook every few hours. After yesterday, when I switched certain simple pods to run on the same nodes as my webhook listening pods the rate of dropped webhooks skyrocketed. This is unacceptable, and likely it's a kubernetes bug again. Next week I'll look into a repro and fix.
The text was updated successfully, but these errors were encountered: