Skip to content

fix: fix version mismatch and SSL errors in UI tests#869

Merged
averevki merged 1 commit intoKuadrant:mainfrom
emmaaroche:fix-playwright-version-mismatch
Feb 16, 2026
Merged

fix: fix version mismatch and SSL errors in UI tests#869
averevki merged 1 commit intoKuadrant:mainfrom
emmaaroche:fix-playwright-version-mismatch

Conversation

@emmaaroche
Copy link
Copy Markdown
Contributor

Description

This PR pins Playwright to 1.57.0 and adds SSL certificate bypass to fix test failures in UI image.

Without pinning, Poetry installs the latest Playwright (1.58.0) which doesn't match the browser binaries in mcr.microsoft.com/playwright/python:v1.57.0-noble, causing: BrowserType.launch: Executable doesn't exist at /ms-playwright/firefox-1509/firefox

We're staying on 1.57.0 for now because it works reliably. Playwright 1.58.0 has an issue with JS redirects in headless mode that I need to investigate more.

Also, as there is no CA certificates in the UI image, this is causing SSL errors when using the image. Adding ignore_https_errors=True flag bypasses certificate validation during both login and test execution. This will also need to be added to image at a later stage.

Changes

  • pyproject.toml: Pin playwright = "1.57.0" to match Docker base image
  • conftest.py: Add ignore_https_errors=True to browser contexts

Verification Steps

  docker run --rm \                                                                                                                                                                                        
    -v ~/.kube/config:/run/kubeconfig:ro \                                                                                                                                                                 
    -v $(pwd)/config/settings.local.yaml:/run/secrets.yaml:ro \                                                                                                                                            
    -v $(pwd)/test-run-results:/test-run-results \                                                                                                                                                         
    quay.io/rh-ee-eroche/testsuite-ui:unstable`

Signed-off-by: emmaaroche <eroche@redhat.com>
@emmaaroche emmaaroche self-assigned this Feb 16, 2026
@emmaaroche emmaaroche added the refactor Refactor with same functionality label Feb 16, 2026
@azgabur
Copy link
Copy Markdown
Member

azgabur commented Feb 16, 2026

Wont updating base image in https://github.com/Kuadrant/testsuite/blob/main/ui.Dockerfile#L1 help? mcr.microsoft.com/playwright/python:v1.58.0-noble seems to exist. But I agree for the future we can pin the version of Playwright to be same as used in ui.Dockerfile

@emmaaroche
Copy link
Copy Markdown
Contributor Author

emmaaroche commented Feb 16, 2026

@azgabur, mentioned in PR description that I will need to investigate it more as tests are failing with redirect issues using v1.58 base image, I will look into this soon but don't want tests failing in nightlies due to version mismatch for now.

Copy link
Copy Markdown
Member

@azgabur azgabur left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay got it, so for now this is fine 👍

Comment thread testsuite/tests/singlecluster/ui/console_plugin/conftest.py
@averevki averevki merged commit 3f45acd into Kuadrant:main Feb 16, 2026
4 checks passed
@emmaaroche emmaaroche deleted the fix-playwright-version-mismatch branch February 16, 2026 11:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

refactor Refactor with same functionality

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants