Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: Conformance tests flakiness fix #3451

Merged
merged 1 commit into from
Feb 2, 2023
Merged

Conversation

mlavacca
Copy link
Member

@mlavacca mlavacca commented Jan 30, 2023

What this PR does / why we need it:

Which issue this PR fixes:

Fixes #2939

Special notes for your reviewer:

How the lack of flakiness has been proven:

No flaky test has been observed in 256 runs. Note that every conformance test run was executed in a fresh cluster, with no influence coming from the previous iterations.

PR Readiness Checklist:

Complete these before marking the PR as ready to review:

  • [ ] the CHANGELOG.md release notes have been updated to reflect any significant (and particularly user-facing) changes introduced by this PR

@codecov
Copy link

codecov bot commented Jan 30, 2023

Codecov Report

Base: 73.8% // Head: 73.9% // Increases project coverage by +0.1% 🎉

Coverage data is based on head (7e5ba8f) compared to base (3e174e8).
Patch coverage: 100.0% of modified lines in pull request are covered.

❗ Current head 7e5ba8f differs from pull request most recent head 68fc2aa. Consider uploading reports for the commit 68fc2aa to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##            main   #3451     +/-   ##
=======================================
+ Coverage   73.8%   73.9%   +0.1%     
=======================================
  Files        115     118      +3     
  Lines      13971   13986     +15     
=======================================
+ Hits       10313   10348     +35     
+ Misses      2999    2978     -21     
- Partials     659     660      +1     
Impacted Files Coverage Δ
...ternal/controllers/gateway/httproute_controller.go 69.7% <100.0%> (+9.6%) ⬆️
internal/adminapi/client.go 13.3% <0.0%> (-42.5%) ⬇️
internal/manager/config_validation.go 90.6% <0.0%> (-9.4%) ⬇️
...nternal/controllers/gateway/tlsroute_controller.go 71.4% <0.0%> (-2.1%) ⬇️
internal/manager/setup.go 52.6% <0.0%> (-1.9%) ⬇️
internal/manager/run.go 45.6% <0.0%> (-0.4%) ⬇️
internal/dataplane/kong_client.go 87.1% <0.0%> (ø)
internal/util/test/controller_manager.go 59.3% <0.0%> (ø)
internal/manager/utils/kongconfig/root.go 49.5% <0.0%> (ø)
... and 8 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@pull-request-size pull-request-size bot added size/L and removed size/M labels Jan 30, 2023
@mlavacca mlavacca force-pushed the confomance-flakiness branch 17 times, most recently from 35dec60 to 7e5ba8f Compare February 2, 2023 09:33
@mlavacca mlavacca marked this pull request as ready for review February 2, 2023 10:15
@mlavacca mlavacca requested a review from a team as a code owner February 2, 2023 10:15
@mlavacca
Copy link
Member Author

mlavacca commented Feb 2, 2023

Details about how the lack of flakiness has been verified in the PR description ☝️

Copy link
Member

@pmalek pmalek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎖️ 👍

One question though left in review and one suggestion: can we change the PR title to be more specific and adhere to conventional commits with prefix and all that? 🙏

pmalek
pmalek previously approved these changes Feb 2, 2023
Copy link
Member

@pmalek pmalek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please just make sure the PR title and commit message are renamed to follow conventional commits

Signed-off-by: Mattia Lavacca <lavacca.mattia@gmail.com>
@mlavacca mlavacca changed the title Conformance tests flakiness test: Conformance tests flakiness fix Feb 2, 2023
@mlavacca mlavacca requested a review from pmalek February 2, 2023 18:05
@mlavacca
Copy link
Member Author

mlavacca commented Feb 2, 2023

The rebase invalidated your review, PTAL @pmalek

@mlavacca mlavacca enabled auto-merge (squash) February 2, 2023 19:08
@mlavacca mlavacca merged commit 094cbd1 into main Feb 2, 2023
@mlavacca mlavacca deleted the confomance-flakiness branch February 2, 2023 19:35
mlavacca added a commit that referenced this pull request Feb 6, 2023
Signed-off-by: Mattia Lavacca <lavacca.mattia@gmail.com>
mlavacca added a commit that referenced this pull request Feb 6, 2023
Signed-off-by: Mattia Lavacca <lavacca.mattia@gmail.com>
mlavacca added a commit that referenced this pull request Feb 6, 2023
Signed-off-by: Mattia Lavacca <lavacca.mattia@gmail.com>
@pmalek pmalek added the fix label Mar 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Flaky conformance tests
2 participants