Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add improvements in Conformance Runtime #25797

Merged
merged 3 commits into from Jun 1, 2023

Conversation

aanm
Copy link
Member

@aanm aanm commented May 31, 2023

Add some improvements in the Conformance runtime tests to make it easier to understand which test failed.

An example of such output can be found here

image

@aanm aanm added area/CI Continuous Integration testing issue or flake area/CI-improvement Topic or proposal to improve the Continuous Integration workflow release-note/ci This PR makes changes to the CI. labels May 31, 2023
@aanm aanm requested a review from pchaigno May 31, 2023 13:46
@aanm aanm requested review from a team as code owners May 31, 2023 13:46
@aanm aanm force-pushed the pr/add-visibility-tests-failures branch from 23ca18b to 758b0dc Compare May 31, 2023 13:58
aanm added 3 commits June 1, 2023 13:49
To help navigate the tests in case of a failure, we can present a
summary from the junit files into the GitHub summary page.

Signed-off-by: André Martins <andre@cilium.io>
This test was removed and it's not running anymore. We can safely remove
it from the list of tests matched by the regex.

Signed-off-by: André Martins <andre@cilium.io>
There was one occurrence where the "Runtime Test (agent)" failed. This
commit will hopefully help to determine to cause of this flakiness.

Signed-off-by: André Martins <andre@cilium.io>
@aanm aanm force-pushed the pr/add-visibility-tests-failures branch from 758b0dc to ddaae5c Compare June 1, 2023 11:49
@aanm aanm merged commit 5693d41 into cilium:main Jun 1, 2023
48 checks passed
@aanm aanm deleted the pr/add-visibility-tests-failures branch June 1, 2023 12:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/CI Continuous Integration testing issue or flake area/CI-improvement Topic or proposal to improve the Continuous Integration workflow release-note/ci This PR makes changes to the CI.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants