Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

integration test is very flaky #3213

Closed
tnqn opened this issue Jan 20, 2022 · 0 comments · Fixed by #3357 or #3797
Closed

integration test is very flaky #3213

tnqn opened this issue Jan 20, 2022 · 0 comments · Fixed by #3357 or #3797
Assignees
Labels
area/test Issues or PRs related to unit and integration tests. help wanted Extra attention is needed kind/bug Categorizes issue or PR as related to a bug. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.

Comments

@tnqn
Copy link
Member

tnqn commented Jan 20, 2022

Describe the bug

It has more than 50% possibilities to fail on unrelated changes, while testing it locally always succeed. I suspect it's related to the performance of testbed.

To Reproduce
See https://jenkins.antrea-ci.rocks/job/antrea-manual-integration-for-pull-request/

@tnqn tnqn added help wanted Extra attention is needed area/test Issues or PRs related to unit and integration tests. kind/bug Categorizes issue or PR as related to a bug. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Jan 20, 2022
tnqn added a commit to tnqn/antrea that referenced this issue Feb 24, 2022
The single flow/group add/modify/delete methods are asynchronous. It
may not take effect immediately after the methods return. The
integration test should take it into consideration and check the
operations eventually take effect.

Fixes antrea-io#3213

Signed-off-by: Quan Tian <qtian@vmware.com>
tnqn added a commit that referenced this issue Feb 25, 2022
…ect (#3357)

The single flow/group add/modify/delete methods are asynchronous. It
may not take effect immediately after the methods return. The
integration test should take it into consideration and check the
operations eventually take effect.

Fixes #3213

Signed-off-by: Quan Tian <qtian@vmware.com>
bangqipropel pushed a commit to bangqipropel/antrea that referenced this issue Mar 2, 2022
…ect (antrea-io#3357)

The single flow/group add/modify/delete methods are asynchronous. It
may not take effect immediately after the methods return. The
integration test should take it into consideration and check the
operations eventually take effect.

Fixes antrea-io#3213

Signed-off-by: Quan Tian <qtian@vmware.com>
tnqn added a commit to tnqn/antrea that referenced this issue Mar 7, 2022
The single flow/group add/modify/delete methods are asynchronous. It
may not take effect immediately after the methods return. The
integration test should take it into consideration and check the
operations eventually take effect.

Fixes antrea-io#3213

Signed-off-by: Quan Tian <qtian@vmware.com>
tnqn added a commit that referenced this issue Mar 7, 2022
…ect (#3407)

The single flow/group add/modify/delete methods are asynchronous. It
may not take effect immediately after the methods return. The
integration test should take it into consideration and check the
operations eventually take effect.

Fixes #3213

Signed-off-by: Quan Tian <qtian@vmware.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/test Issues or PRs related to unit and integration tests. help wanted Extra attention is needed kind/bug Categorizes issue or PR as related to a bug. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
Projects
None yet
2 participants