Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The conformance test ContainerExitingMsg is very flaky and currently dependant on a custom progressDeadline #13465

Open
norman465 opened this issue Nov 14, 2022 · 2 comments
Labels
area/API API objects and controllers area/test-and-release It flags unit/e2e/conformance/perf test issues for product features kind/bug Categorizes issue or PR as related to a bug. triage/accepted Issues which should be fixed (post-triage)

Comments

@norman465
Copy link
Member

The conformance test ContainerExitingMsg seems to be very flaky. From what I understand the test wants to hit this code here to set the revision to False if the pod crashes repeatedly. However, this is almost never reached since the deployment is reconciled every time (#13204) and may run into a race condition while trying to update it preventing it from ever reaching that code.

In what area(s)?

/area API
/area test-and-release

What version of Knative?

1.6+

Expected Behavior

Conformance test ContainerExitingMsg passes.

Actual Behavior

Conformance test ContainerExitingMsg is not passed with knative defaults.
https://github.com/knative/serving/actions/runs/3444537426/jobs/5747350496
PASS test/conformance/api/v1.TestContainerExitingMsg (121.05s) this is using customized values in the knative pipeline and passes only because the custom progressDeadline is set to 120s (https://github.com/knative/serving/blob/main/test/config/ytt/core/overlay-config-deployment.yaml). The actual default ProgressDealine is set to 10m (the same as the default timeout of the conformance tests) which would prevent this test from passing most of the time.

Steps to Reproduce the Problem

Run the conformance tests with a 10m timeout on a knative installation with a default progressDeadline of 10m.

@norman465 norman465 added the kind/bug Categorizes issue or PR as related to a bug. label Nov 14, 2022
@knative-prow knative-prow bot added area/API API objects and controllers area/test-and-release It flags unit/e2e/conformance/perf test issues for product features labels Nov 14, 2022
@norman465 norman465 changed the title The conformance test ContainerExitingMsg is very flaky and currently dependend on a custom progressDeadline The conformance test ContainerExitingMsg is very flaky and currently dependant on a custom progressDeadline Nov 14, 2022
@psschwei
Copy link
Contributor

psschwei commented Dec 5, 2022

I wonder if a simple solution would be to increase the default timeout to 11 minutes?

PollTimeout = 10 * time.Minute

@github-actions
Copy link

github-actions bot commented Mar 6, 2023

This issue is stale because it has been open for 90 days with no
activity. It will automatically close after 30 more days of
inactivity. Reopen the issue with /reopen. Mark the issue as
fresh by adding the comment /remove-lifecycle stale.

@github-actions github-actions bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Mar 6, 2023
@ReToCode ReToCode added triage/accepted Issues which should be fixed (post-triage) and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Mar 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/API API objects and controllers area/test-and-release It flags unit/e2e/conformance/perf test issues for product features kind/bug Categorizes issue or PR as related to a bug. triage/accepted Issues which should be fixed (post-triage)
Projects
None yet
Development

No branches or pull requests

3 participants