Stabilization of automated tests, infrastructure and CI

[odockal]

Epic domain

Placeholder for issues aimed at flaky tests, infrastructure work and maintenance, automation stabilization.

Additional context

• GitHub API rate limit exceeded on CI - contour file download limit - Make contour file offline: Download contour on tests making CI fail / exceed our rate limits. #2248
• Flaky e2e.spec.ts - Flaky test in e2e.spec.ts #2312
• Podman version used on GHA ubuntu runner is flaky - Stopping an alpine container on GHA ubuntu (22.04) runner shows an error during e2e test implementation #3434
• Fix e2e smoke test instability - Fix e2e smoke test suite instability #3581
• [bug] On windows 10 a reboot is need after install wsl podman-desktop-e2e#32
• [Bug] pdPath is treated as a base path instead of full pd path  podman-desktop-e2e#29
• Podman installation fails with an opensuse mirror outage and so the workflows are broken #4814
• Error (HTTP 500 - unauthenticated) while running Pull Image test for quay.io/podman/hello in images-smoke tests on PR check #4817
• E2E smoke test on PR check are failing on starting an alpine container #5303
• Add extension installation from OCI image tests  #5067
• E2E smoke suite is flaky due to a timeout on the after test hook #5325
• Test flake due to featured extension rotation #4929
• Fix Podman Extension E2E test method descriptions that use invalid character when saving the artifacts #4866
• Podman Extension E2E test checks Featured Extensions grid, but there mightbe a disambiguity in showed extensions resulting in failed test case #4877
• Transfer characters in test method names that are marked as invalid by GHA archive artifacts action #4905
• Close Dev Tools window for all E2E tests #4968
• E2E tests instability: electronApplication.browserWindow: Execution context was destroyed, most likely because of a navigation #4983
• Include missing npx playwright install in postinstall to fix failing e2e-test-main workflow #5032
• fix(tests): fixed mac port issue in smoke tests #5304
• E2E smoke test on PR check are failing on starting an alpine container #5303
• Cannot compile podman desktop repo on windows on our CI podman-desktop-e2e#81

[odockal]

I have linked all stability related issues that were resolved in 2023 and I am closing this epic placeholder. Will open new to hold a list of stability issues in the 2024.