Skip to content

[WIP]: Revamp CI reporting #4367

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

apostasie
Copy link
Contributor

@apostasie apostasie commented Jun 24, 2025

This is an exploratory PR, looking into:

  • providing downloadable daemon logs (to allow post-debugging of containerd/etc)
  • annotate source code on PRs:
    • provide the list of all failures, linked to their corresponding file
    • if a failing test is known to be flaky (eg: there is an issue named "[Flaky] TestXYZ"), inform the user that it may be ignored - if not, warn the user / reviewer that this failure should not be ignored
  • on merge, write a complete report of the run as a comment to a specific collecting ticket, including:
    • list of all failing tests
    • list of tests that did not run
    • pie chart of time spent by packages
    • list of top slow tests
    • split of flaky / not-flaky
    • etc?
  • on merge, collate all existing reports from the previous time period (up to the day before), and generate an aggregate report (TODO: figure out concurrency - again)

Fix #4365 and #4370

@apostasie apostasie force-pushed the 2025-06-ci-collect-logs branch 5 times, most recently from a52f598 to e80d7f3 Compare June 24, 2025 18:19
@apostasie
Copy link
Contributor Author

.

@apostasie apostasie force-pushed the 2025-06-ci-collect-logs branch 18 times, most recently from bd1b5fc to d93bbd0 Compare June 26, 2025 03:26
Signed-off-by: apostasie <spam_blackhole@farcloser.world>
@apostasie apostasie force-pushed the 2025-06-ci-collect-logs branch 5 times, most recently from 48111c8 to 58443cd Compare June 26, 2025 19:46
@apostasie apostasie changed the title [WIP]: Collect system logs from CI failing runs [WIP]: Revamp CI reporting Jun 26, 2025
@apostasie apostasie force-pushed the 2025-06-ci-collect-logs branch 22 times, most recently from 6c61f28 to 74d6e29 Compare June 27, 2025 02:34
Signed-off-by: apostasie <spam_blackhole@farcloser.world>
@apostasie apostasie force-pushed the 2025-06-ci-collect-logs branch from 74d6e29 to ad88087 Compare June 27, 2025 22:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI] CI runs should output containerd / buildkitd logs
1 participant