Skip to content

CONSOLE-5197: Add ci job for playright#78021

Open
vikram-raj wants to merge 1 commit into
openshift:mainfrom
vikram-raj:playwright-ci-config
Open

CONSOLE-5197: Add ci job for playright#78021
vikram-raj wants to merge 1 commit into
openshift:mainfrom
vikram-raj:playwright-ci-config

Conversation

@vikram-raj
Copy link
Copy Markdown
Member

@vikram-raj vikram-raj commented Apr 20, 2026

Summary by CodeRabbit

  • Tests
    • Added Playwright end-to-end testing to the CI pipeline with configurable resource allocation and timeout settings.

@openshift-ci openshift-ci Bot requested review from rhamilto and spadgett April 20, 2026 10:13
@vikram-raj vikram-raj changed the title Add ci job for playright CONSOLE-5197: Add ci job for playright Apr 20, 2026
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Apr 20, 2026
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

openshift-ci-robot commented Apr 20, 2026

@vikram-raj: This pull request references CONSOLE-5197 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "5.0.0" version, but no target version was set.

Details

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@vikram-raj
Copy link
Copy Markdown
Member Author

/cc @jhadvig

@openshift-ci openshift-ci Bot requested a review from jhadvig April 20, 2026 10:14
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Apr 20, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Repository: openshift/coderabbit/.coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: 10c1a641-0d43-4339-9fd2-8f4bb8bf132b

📥 Commits

Reviewing files that changed from the base of the PR and between fc4c32b and 7c529c2.

📒 Files selected for processing (1)
  • ci-operator/config/openshift/console/openshift-console-main.yaml

Walkthrough

A new CI test entry e2e-playwright has been added to the OpenShift Console main configuration, configured to run Playwright E2E tests on GCP infrastructure with specified resource constraints and conditional skip rules.

Changes

Cohort / File(s) Summary
CI Test Configuration
ci-operator/config/openshift/console/openshift-console-main.yaml
Added new test entry e2e-playwright running under ipi-gcp workflow with 4 CPU/10Gi memory allocation, 2h timeout, and skip_if_only_changed rules matching documentation/ignore patterns. Test is optional and disabled by default.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

🚥 Pre-merge checks | ✅ 10
✅ Passed checks (10 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title 'Add ci job for playright' directly describes the main change: adding a new Playwright e2e CI test job. It is concise, clear, and accurately reflects the primary modification in the changeset.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Stable And Deterministic Test Names ✅ Passed PR modifies CI configuration YAML, not Ginkgo test definitions in Go code. The check for stable test names is not applicable.
Test Structure And Quality ✅ Passed The PR modifies a CI configuration file, not Ginkgo test code. The custom check for Ginkgo test quality patterns is not applicable.
Microshift Test Compatibility ✅ Passed PR modifies CI configuration referencing shell script but does not include Ginkgo e2e test code; custom check only evaluates Ginkgo tests and is not applicable.
Single Node Openshift (Sno) Test Compatibility ✅ Passed The custom check assesses new Ginkgo e2e tests for SNO compatibility. This PR only adds a CI configuration entry referencing an existing Playwright test, not new Ginkgo test code, so the check is not applicable.
Topology-Aware Scheduling Compatibility ✅ Passed CI test configuration addition does not introduce scheduling constraints assuming standard HA topology; applies only to isolated CI environments.
Ote Binary Stdout Contract ✅ Passed PR modifies only YAML configuration for CI/CD metadata; contains no Go code, OTE binary implementations, or process-level code that could violate stdout contract requirements.
Ipv6 And Disconnected Network Test Compatibility ✅ Passed This PR adds a CI configuration entry to run a Playwright e2e test script, not new Ginkgo e2e tests. No Go test code with Ginkgo patterns (It, Describe, Context, When) is being added.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@openshift-merge-bot openshift-merge-bot Bot added the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label Apr 20, 2026
@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 7c529c2 to e3e8f3b Compare April 27, 2026 14:53
@openshift-merge-bot openshift-merge-bot Bot removed the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label Apr 27, 2026
@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from e3e8f3b to 4f5567d Compare April 28, 2026 06:17
@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 4f5567d to 11e00bb Compare May 5, 2026 13:48
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 11e00bb to c96025b Compare May 13, 2026 13:51
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj
Copy link
Copy Markdown
Member Author

/retest

@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from c96025b to 5f85dd1 Compare May 13, 2026 14:56
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 5f85dd1 to 8655cad Compare May 14, 2026 09:57
@openshift-ci
Copy link
Copy Markdown
Contributor

openshift-ci Bot commented May 14, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: vikram-raj
Once this PR has been reviewed and has the lgtm label, please assign therealjon for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 8655cad to 64bd708 Compare May 14, 2026 10:31
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 64bd708 to 1041a92 Compare May 14, 2026 10:42
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 1041a92 to 1ec8190 Compare May 14, 2026 11:27
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@stefanonardo
Copy link
Copy Markdown

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@stefanonardo: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vikram-raj vikram-raj force-pushed the playwright-ci-config branch from 1ec8190 to dcce98b Compare May 15, 2026 14:52
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

[REHEARSALNOTIFIER]
@vikram-raj: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
pull-ci-openshift-console-main-e2e-playwright openshift/console presubmit Presubmit changed
pull-ci-openshift-console-main-analyze openshift/console presubmit Ci-operator config changed
pull-ci-openshift-console-main-backend openshift/console presubmit Ci-operator config changed
pull-ci-openshift-console-main-e2e-gcp-console openshift/console presubmit Ci-operator config changed
pull-ci-openshift-console-main-frontend openshift/console presubmit Ci-operator config changed
pull-ci-openshift-console-main-images openshift/console presubmit Ci-operator config changed
pull-ci-openshift-console-main-okd-scos-e2e-aws-ovn openshift/console presubmit Ci-operator config changed
pull-ci-openshift-console-main-okd-scos-images openshift/console presubmit Ci-operator config changed
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse ack

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-merge-bot openshift-merge-bot Bot added the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label May 15, 2026
@vikram-raj
Copy link
Copy Markdown
Member Author

/pj-rehearse pull-ci-openshift-console-main-e2e-gcp-console

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@vikram-raj: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci
Copy link
Copy Markdown
Contributor

openshift-ci Bot commented May 16, 2026

@vikram-raj: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. rehearsals-ack Signifies that rehearsal jobs have been acknowledged

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants