Skip to content

CNTRLPLANE-2589: update cases to execute as parallel#833

Open
ropatil010 wants to merge 2 commits intoopenshift:masterfrom
ropatil010:update-makefile
Open

CNTRLPLANE-2589: update cases to execute as parallel#833
ropatil010 wants to merge 2 commits intoopenshift:masterfrom
ropatil010:update-makefile

Conversation

@ropatil010
Copy link
Contributor

Hi @p0lyn0mial

Can you PTAL on this PR.
Current PR is blocked bec of this: openshift/origin#30735

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Feb 2, 2026
@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Feb 2, 2026

@ropatil010: This pull request references CNTRLPLANE-2589 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the epic to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Hi @p0lyn0mial

Can you PTAL on this PR.
Current PR is blocked bec of this: openshift/origin#30735

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@coderabbitai
Copy link

coderabbitai bot commented Feb 2, 2026

Walkthrough

Relabels tests from [Serial] to [Parallel] and renames the suite path from "serial" to "parallel". README usage examples updated to show a parallel run (4 workers) and adjusted JUnit output/suite listing. One test runner binary change updates the tag predicate to match "[Parallel]" (parallelism flag unchanged in that binary).

Changes

Cohort / File(s) Summary
Documentation
README.md
Switched usage examples from the serial suite to the parallel suite, shows running with 4 workers, updated JUnit output and suite listing examples.
Test runner binary
cmd/cluster-authentication-operator-tests-ext/main.go
Changed test-suite tag and suite path from "Serial" / .../serial to "Parallel" / .../parallel; updated qualifier predicate to filter on "[Parallel]". Parallelism flag in this binary remains 1.
End-to-end tests
test/e2e/certs.go, test/e2e/custom_route.go, test/e2e/gitlab.go, test/e2e/keycloak.go, test/e2e/templates.go, test/e2e/tokentimeout.go
Updated Ginkgo It block labels from [...][Serial] to [...][Parallel] only; no functional or control-flow changes.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

✨ Finishing touches
  • 📝 Generate docstrings
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment

Comment @coderabbitai help to get the list of available commands and usage tips.

@openshift-ci openshift-ci bot requested review from ibihim and liouk February 2, 2026 11:53
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 2, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: ropatil010
Once this PR has been reviewed and has the lgtm label, please assign liouk for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Makefile Outdated
test-e2e: GO_TEST_FLAGS += -v
test-e2e: GO_TEST_FLAGS += -timeout 1h
test-e2e: GO_TEST_FLAGS += -count 1
test-e2e: GO_TEST_FLAGS += -p 1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that we should make the test suite parallel instead of serial

running test in parallel is better because it usually requires less time to complete the test suite.

Copy link
Contributor Author

@ropatil010 ropatil010 Feb 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure,
As per analysis of the cases : openshift/origin#30735 (comment)
i have added serial tag. Let me update to parallel and monitor the case results.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As per earlier suggestion openshift/origin#30735 (comment) used serial execution of cases.
But per latest suggestion #833 (comment), added parallel execution things.

Changes:
- Remove serial test suite from main.go, keep only parallel suite with Parallelism: 4
- Update all e2e test tags from [Serial] to [Parallel]:
  - certs.go: [Operator][Certs][Parallel]
  - custom_route.go: [Operator][Routes][Parallel]
  - gitlab.go: [OIDC][Parallel]
  - keycloak.go: [OIDC][Parallel]
  - templates.go: [Templates][Parallel]
  - tokentimeout.go: [Tokens][Parallel]
- Update README.md to reference parallel suite instead of serial

This enables parallel test execution with 4 workers for better performance.

Co-Authored-By: Rohit Patil <ropatil@redhat.com>
@ropatil010 ropatil010 changed the title CNTRLPLANE-2589: update makefile with parameter p 1 for serial execution of cases CNTRLPLANE-2589: update cases to execute as parallel Feb 2, 2026
Copy link

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Fix all issues with AI agents
In `@cmd/cluster-authentication-operator-tests-ext/main.go`:
- Around line 63-68: The suite defined via
extension.AddSuite(oteextension.Suite) with Name
"openshift/cluster-authentication-operator/operator/parallel" uses Parallelism:
4 and a Qualifiers filter that includes cluster-mutating specs (e.g.,
TestTokenInactivityTimeout, TestTemplatesConfig, TestCustomRouterCerts,
TestRouterCerts), which risks races; fix by removing stateful tests from this
parallel suite and either (A) create a new serial suite (oteextension.Suite with
Parallelism: 1 and a distinct Name like ".../serial") whose Qualifiers select
those specific tests, or (B) reduce Parallelism to 1 and/or add Ginkgo
SerialSynchronized/Serial labels on the stateful tests to ensure exclusive
access to cluster-wide resources; update the Qualifiers string or test labels
accordingly so parallel workers no longer run read-modify-write cluster tests
concurrently.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 2, 2026

@ropatil010: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@p0lyn0mial
Copy link
Contributor

which Ci job runs the tests via OTE ?

@ropatil010
Copy link
Contributor Author

which Ci job runs the tests via OTE ?

This is the PR: openshift/release#73999 wrt the CI job for OTE execution.
Added comment here: openshift/release#73999 (comment)

@p0lyn0mial
Copy link
Contributor

This is the PR: openshift/release#73999 wrt the CI job for OTE execution.

Before migrating the tests, we should have this job running in this repository.
Otherwise we don't know if the tests work after the migration.

I would update 73999 to use openshift/cluster-authentication-operator/operator/parallel - it will fail but the job is optional and then run it on this pr to show the tests work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

jira/valid-reference Indicates that this PR references a valid Jira ticket of any type.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants