E2E tests and infra stabilization and maintenance

[odockal]

Epic domain

Placeholder epic to keep together similar issue that were addressed during Q1 2024.

Filter for podman-desktop, label tests: is:issue closed:2024-01-01..2024-03-31 label:"area/tests 🚦"

Maintenance - test failure fixes

• https://github.com/containers/podman-desktop-internal/issues/189
• e2e-tests main workflow is failing on GHA CI with test failures #6479
• E2E Test Main workflow fails on registry e2e tests #5713
• Rewrite aria-labels for status element in ConnectionStatus, etc. into human readable form #5566
• Play Yaml E2E Test failure/error on windows workflows (pod deletion causes timeout) #5514
• Pulling an image E2E test on windows fails (No Containers Engine) #5512
• E2E tests instability: electronApplication.browserWindow: Execution context was destroyed, most likely because of a navigation #4983
• Error (HTTP 500 - unauthenticated) while running Pull Image test for quay.io/podman/hello in images-smoke tests on PR check #4817
• Onboarding e2e tests should not be run on linux platform #6327
• Fix Podman extension e2e test failures/errors on windows workflows #5511
• Test flake due to featured extension rotation #4929
• Add Playwright tracing functionality to e2e tests #5518

New e2e tests, updates:

• Add build image test case to the e2e image smoke test #3553
• Extend Pod E2E testing scenario with application deployment check #5042
• Implement E2E test case using Playwright to verify Play Kubernetes Yaml scenario #5440
• Implement E2E test case using Playwright to verify Prune images, containers, pods, volumes #5545

podman-desktop-e2e repository maintenance and patches

• Find better naming for various project's e2e tests and workflows podman-desktop-e2e#72
• Unstable Podman Desktop Playwright E2E tests on windows workflow podman-desktop-e2e#74
• Windows Workflow with E2E tests that are run against a podman machine with a --user-mode-networking flag set podman-desktop-e2e#83
• Incorporate right qemu binary on path when installing podman from zip archive on Mac OS podman-desktop-e2e#114
• Podman Installation via Podman Desktop using GOAX is failing on windows podman-desktop-e2e#119
• Add a way to pass env.variable via GHA inputs of the workflows into a pde2e image's scripts podman-desktop-e2e#129
• Propagate a secret from GHA workflows into an image and its script podman-desktop-e2e#130
• Update Node Version in the PDe2e images podman-desktop-e2e#131
• Update the base images to a newer published version podman-desktop-e2e#132
• We are again missing a C++ redistributable library on windows CI and the podman-desktop build fails podman-desktop-e2e#140
• Fix default env. vars in the workflow that have schedule trigger podman-desktop-e2e#147
• Align collecting of the test results and any update possible places of a failure after e2e tests refactoring podman-desktop-e2e#152
• Upversion Podman in windows nightly workflow to use latest dev branch notation podman-desktop-e2e#156

Additional context

Substantial work is being done in matter of test stabilization, necessary updates to related artifacts in new version released, adding new patches and smaller tests. This should be tracked as well.