Skip to content

TestContinuousEventsPropagationWithProber failing on waiting for forwarder scales to zero: wathola-forwarder: timed out waiting for the condition #297

@houshengbo

Description

@houshengbo

If we set E2E_UPGRADE_TESTS_SERVING_USE to true, eventing installed by operator will end up with the following test case failing:

 === FAIL: test/upgrade TestContinuousEventsPropagationWithProber (177.16s)
    test_runner.go:151: namespace is : "test-continuous-events-propagation-with-prober-lmddv"
2020-10-06T03:05:50.261Z	INFO	prober/prober.go:140	Using namespace for probe testing: test-continuous-events-propagation-with-prober-lmddv
    creation.go:294: Creating v1beta1 broker default
2020-10-06T03:05:50.394Z	INFO	prober/configuration.go:78	Deploying config map: "test-continuous-events-propagation-with-prober-lmddv/wathola-config"
2020-10-06T03:05:50.395Z	DEBUG	prober/configuration.go:61	Fetching default broker URL for ns test-continuous-events-propagation-with-prober-lmddv
2020-10-06T03:05:51.589Z	DEBUG	prober/configuration.go:72	default broker URL for ns test-continuous-events-propagation-with-prober-lmddv is http://broker-ingress.knative-eventing.svc.cluster.local/test-continuous-events-propagation-with-prober-lmddv/default
    creation.go:253: Creating configmap wathola-config
    creation.go:329: Creating v1beta1 trigger wathola-trigger-step
    creation.go:329: Creating v1beta1 trigger wathola-trigger-finished
2020-10-06T03:05:51.886Z	INFO	prober/receiver.go:42	Deploy of receiver pod: wathola-receiver
2020-10-06T03:05:52.001Z	INFO	prober/receiver.go:94	Deploy of receiver service: wathola-receiver
2020-10-06T03:05:52.259Z	DEBUG	prober/receiver.go:129	Node port for service: wathola-receiver is 30152
2020-10-06T03:05:52.259Z	INFO	prober/forwarder.go:36	Deploy forwarder knative service: wathola-forwarder
    tracker.go:153: Waiting for all KResources to become ready
2020-10-06T03:06:44.370Z	INFO	prober/sender.go:32	Deploy sender pod: wathola-sender
2020-10-06T03:06:44.478Z	INFO	lib/await.go:44	Wait for receiver be ready: wathola-receiver
2020-10-06T03:06:44.478Z	INFO	lib/await.go:44	Wait for forwarder ksvc be ready: wathola-forwarder
2020-10-06T03:06:44.478Z	INFO	lib/await.go:44	Wait for forwarder scales to zero: wathola-forwarder
2020-10-06T03:06:44.478Z	INFO	lib/await.go:44	Wait for sender pod be ready: wathola-sender
2020-10-06T03:06:44.489Z	INFO	lib/await.go:51	Successful wait for receiver be ready: wathola-receiver, took 10.97592ms to complete
2020-10-06T03:06:44.506Z	INFO	lib/await.go:51	Successful wait for forwarder ksvc be ready: wathola-forwarder, took 27.885287ms to complete
2020-10-06T03:06:47.513Z	INFO	lib/await.go:51	Successful wait for sender pod be ready: wathola-sender, took 3.035237442s to complete
2020-10-06T03:08:44.603Z	ERROR	lib/await.go:49	Error while waiting for forwarder scales to zero: wathola-forwarder: timed out waiting for the condition
knative.dev/eventing/test/lib.AwaitForAll.func1
	/home/prow/go/src/knative.dev/eventing/test/lib/await.go:49
golang.org/x/sync/errgroup.(*Group).Go.func1
	/home/prow/go/src/knative.dev/eventing/vendor/golang.org/x/sync/errgroup/errgroup.go:57
    test_runner.go:196: EVENT: {{ } {default-wathola-trigger-finishe1adc8afcde3df4ad058859184634d4ad.163b484e0f499a45  test-continuous-events-propagation-with-prober-lmddv /api/v1/namespaces/test-continuous-events-propagation-with-prober-lmddv/events/default-wathola-trigger-finishe1adc8afcde3df4ad058859184634d4ad.163b484e0f499a45 8a32f312-a820-4ab1-b8b6-00fe67f266e7 1437 0 2020-10-06 03:06:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Subscription test-continuous-events-propagation-with-prober-lmddv default-wathola-trigger-finishe1adc8afcde3df4ad058859184634d4ad 7430f529-248f-4f48-a677-d26c4f199e32 messaging.knative.dev/v1 25187 } FinalizerUpdate Updated "default-wathola-trigger-finishe1adc8afcde3df4ad058859184634d4ad" finalizers {subscription-controller } 2020-10-06 03:06:32 +0000 UTC 2020-10-06 03:06:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
    tracker.go:137: Waiting for wathola-trigger-step to be deleted
    tracker.go:131: Cleaning resource: "wathola-config"
    tracker.go:137: Waiting for wathola-config to be deleted
    tracker.go:131: Cleaning resource: "default"
    tracker.go:137: Waiting for default to be deleted
panic: unexpected error: timed out waiting for the condition [recovered]
	panic: unexpected error: timed out waiting for the condition
[signal SIGSEGV: segmentation violation code=0xc000942878 addr=0x5821b5 pc=0xcac826] 

Metadata

Metadata

Assignees

Labels

kind/bugCategorizes issue or PR as related to a bug.lifecycle/staleDenotes an issue or PR has remained open with no activity and has become stale.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions