Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UpdateLog calls from watcher intermittently fail with canceled context; no UpdateLog call error from watcher are re-reconciled #720

Open
gabemontero opened this issue Mar 4, 2024 · 0 comments · May be fixed by #715
Labels
kind/bug Categorizes issue or PR as related to a bug.

Comments

@gabemontero
Copy link
Contributor

Expected Behavior

UpdateLog calls from the watcher should not suffer from accidental canceled context errors when the timing is as such that contexts used for the UpdatLog call are canceled / cleaned up before the call finishes on the API server side.

Actual Behavior

Prior to #712 we saw as much as 100s per hour of UpdateLog calls canceled for context in our production and stress test envs

After using #712 the number reduced, but still occurred with some frequency (maybe single to double digits per hour

Steps to Reproduce the Problem

  1. Run tests under any sort of load where results stores logs for pipelineruns or taskrns

Additional Info

  • Kubernetes version:

various versions

  • Tekton Pipeline version:

various versions

@gabemontero gabemontero added the kind/bug Categorizes issue or PR as related to a bug. label Mar 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
1 participant