Skip to content

CMP-4147: Run tls-scanner on CO parallel jobs - #78651

Open
rhmdnd wants to merge 1 commit into
openshift:mainfrom
rhmdnd:CMP-4147-add-pqc-check-to-ci
Open

CMP-4147: Run tls-scanner on CO parallel jobs#78651
rhmdnd wants to merge 1 commit into
openshift:mainfrom
rhmdnd:CMP-4147-add-pqc-check-to-ci

Conversation

@rhmdnd

@rhmdnd rhmdnd commented Apr 30, 2026

Copy link
Copy Markdown
Contributor

The compliance operator already provisions an AWS cluster for CI on each
PR. Let's add the tls-scanner-run step here so that we're also scanning
all the available TLS endpoints in the openshift-compliance namespace to
ensure they're aligned with PQC and TLS consistency goals for OpenShift.

This updates the ComplianceAsCode/compliance-operator CI configuration in openshift/release to run the TLS scanner as part of the AWS e2e deployment job so TLS endpoints in the openshift-compliance namespace are scanned during CI.

Practical changes:

  • Adds a base_images entry tls-scanner-tool (name: "4.22", namespace: ocp, tag: tls-scanner-tool).
  • Adds a releases entry latest-4-22 (integration name: "4.22", namespace: ocp) and uses it via OPENSHIFT_INSTALL_RELEASE_IMAGE_OVERRIDE: release:latest-4-22 for the e2e-aws-deployment job.
  • Updates e2e-aws-deployment test case:
    • cluster_profile: quay-aws
    • dependencies: OPENSHIFT_INSTALL_RELEASE_IMAGE_OVERRIDE: release:latest-4-22
    • env: BASE_DOMAIN, COMPUTE_NODE_TYPE: m5.2xlarge, PQC_CHECK: "true", SCAN_NAMESPACE: openshift-compliance
    • test step runs make e2e-deployment in a cli: latest-4-22 container with the compliance-operator, testcontent, and testopenscap image dependencies and modest CPU requests
    • appends a workflow step ref: tls-scanner-run and selects workflow: openshift-e2e-aws-ovn-tls-13 so the TLS scanner executes as part of the job

Notes from PR discussion:

  • Author ran rehearsals and requested larger node sizes so the tls-scanner can schedule (COMPUTE_NODE_TYPE is set to m5.2xlarge).
  • Rehearsals may fail on older OCP clusters; the TLS/PQC checks target newer OCP (4.22+) which is why latest-4-22 was added.

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Apr 30, 2026
@openshift-ci-robot

openshift-ci-robot commented Apr 30, 2026

Copy link
Copy Markdown
Contributor

@rhmdnd: This pull request references CMP-4147 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "5.0.0" version, but no target version was set.

Details

In response to this:

The compliance operator already provisions an AWS cluster for CI on each
PR. Let's add the tls-scanner-run step here so that we're also scanning
all the available TLS endpoints in the openshift-compliance namespace to
ensure they're aligned with PQC and TLS consistency goals for OpenShift.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci Bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 30, 2026
@coderabbitai

coderabbitai Bot commented Apr 30, 2026

Copy link
Copy Markdown
Contributor

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 25f5978e-c8dc-453b-a476-0f36e728382b

📥 Commits

Reviewing files that changed from the base of the PR and between 28b6710 and fd6f126.

⛔ Files ignored due to path filters (1)
  • ci-operator/jobs/ComplianceAsCode/compliance-operator/ComplianceAsCode-compliance-operator-master-presubmits.yaml is excluded by !ci-operator/jobs/**
📒 Files selected for processing (1)
  • ci-operator/config/ComplianceAsCode/compliance-operator/ComplianceAsCode-compliance-operator-master.yaml

Walkthrough

Adds a tls-scanner-tool base image entry (ocp:4.22), registers a latest-4-22 release integration, and adds an e2e-aws-deployment test targeting quay-aws that sets deployment/TLS env vars, overrides the install release image, runs make e2e-deployment, and appends a TLS workflow step. (YAML-only changes.)

Changes

CI Configuration Update

Layer / File(s) Summary
Base Image Declaration
ci-operator/config/ComplianceAsCode/compliance-operator/ComplianceAsCode-compliance-operator-master.yaml
Adds base_images.base.tls-scanner-tool with namespace: ocp, name: "4.22", tag: tls-scanner-tool.
Release Integration
ci-operator/config/.../ComplianceAsCode-compliance-operator-master.yaml
Adds releases.latest-4-22 mapping with integration.name: "4.22" and integration.namespace: ocp.
Test Definition
ci-operator/config/.../ComplianceAsCode-compliance-operator-master.yaml
Introduces tests[as=e2e-aws-deployment] for cluster_profile: quay-aws; sets env vars COMPUTE_NODE_TYPE, PQC_CHECK, SCAN_NAMESPACE, BASE_DOMAIN; overrides install release to release:latest-4-22; runs make e2e-deployment with cli: latest-4-22.
Workflow Wiring
ci-operator/config/.../ComplianceAsCode-compliance-operator-master.yaml
Appends extra workflow step referencing ref: tls-scanner-run with workflow: openshift-e2e-aws-ovn-tls-13 to the e2e-aws-deployment test.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

🚥 Pre-merge checks | ✅ 12
✅ Passed checks (12 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly references the main objective: adding a tls-scanner to run on compliance-operator parallel jobs, which matches the core change of introducing a new e2e-aws-deployment test with tls-scanner functionality.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names ✅ Passed Test names are static: e2e-aws-deployment, test, and tls-scanner-run. No dynamic pod names, timestamps, UUIDs, node names, or variable substitution.
Test Structure And Quality ✅ Passed PR contains only CI configuration changes (YAML) in openshift/release repo, no Ginkgo test code. The custom check for test structure/quality is not applicable to CI config files.
Microshift Test Compatibility ✅ Passed PR adds CI config, not Ginkgo tests. The check applies only to PRs adding new Ginkgo test code. This PR adds CI infrastructure referencing external tests in other repos.
Single Node Openshift (Sno) Test Compatibility ✅ Passed PR adds CI configuration (YAML) only, not Ginkgo test code. The custom check applies to new Ginkgo tests which are in ComplianceAsCode/compliance-operator PR #1124, not here.
Topology-Aware Scheduling Compatibility ✅ Passed PR only modifies CI config files, not deployment manifests or operator code. No scheduling constraints introduced.
Ote Binary Stdout Contract ✅ Passed The PR only modifies a YAML CI configuration file. The OTE Binary Stdout Contract check applies to Go code violations (logging, stdout writes in main/init/tests). This PR contains no Go code changes.
Ipv6 And Disconnected Network Test Compatibility ✅ Passed PR only modifies CI configuration files. No new Ginkgo e2e tests are added - it configures test orchestration and adds a tls-scanner shell script step. The check applies only to new Ginkgo test code.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Tip

💬 Introducing Slack Agent: The best way for teams to turn conversations into code.

Slack Agent is built on CodeRabbit's deep understanding of your code, so your team can collaborate across the entire SDLC without losing context.

  • Generate code and open pull requests
  • Plan features and break down work
  • Investigate incidents and troubleshoot customer tickets together
  • Automate recurring tasks and respond to alerts with triggers
  • Summarize progress and report instantly

Built for teams:

  • Shared memory across your entire org—no repeating context
  • Per-thread sandboxes to safely plan and execute work
  • Governance built-in—scoped access, auditability, and budget controls

One agent for your entire SDLC. Right inside Slack.

👉 Get started


Comment @coderabbitai help to get the list of available commands and usage tips.

@rhmdnd
rhmdnd force-pushed the CMP-4147-add-pqc-check-to-ci branch from 355b7c6 to 8d73bde Compare April 30, 2026 16:46
@rhmdnd

rhmdnd commented Apr 30, 2026

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-parallel

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rhmdnd: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@rhmdnd

rhmdnd commented Apr 30, 2026

Copy link
Copy Markdown
Contributor Author

/pj-rehearse

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rhmdnd: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@rhmdnd
rhmdnd force-pushed the CMP-4147-add-pqc-check-to-ci branch from 8d73bde to 3722459 Compare April 30, 2026 20:38
@rhmdnd

rhmdnd commented Apr 30, 2026

Copy link
Copy Markdown
Contributor Author

Need to bump node sizes so that the scanner will schedule.

@rhmdnd

rhmdnd commented Apr 30, 2026

Copy link
Copy Markdown
Contributor Author

/pj-rehearse

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rhmdnd: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@rhmdnd

rhmdnd commented May 1, 2026

Copy link
Copy Markdown
Contributor Author

These rehearsals might be failing because we're attempting to run them on 4.17 clusters. The TLS consistency work is relatively new, and we should consider using newer versions of OCP for this (4.22+).

@rhmdnd

rhmdnd commented May 7, 2026

Copy link
Copy Markdown
Contributor Author

Rehearsals here should fail because the new test target hasn't landed, yet.

ComplianceAsCode/compliance-operator#1124

@rhmdnd

rhmdnd commented May 7, 2026

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-deployment

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rhmdnd: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In
`@ci-operator/config/ComplianceAsCode/compliance-operator/ComplianceAsCode-compliance-operator-master.yaml`:
- Around line 130-157: The test step uses a mismatched CLI version ("cli:
latest") against the install override OPENSHIFT_INSTALL_RELEASE_IMAGE_OVERRIDE:
release:latest-4-22; update the test step (the block starting with "- as: test"
/ "cli") to pin the CLI to the 4.22 release (e.g., "cli: 4.22" or the equivalent
release:latest-4-22 identifier) so the CLI version aligns with
OPENSHIFT_INSTALL_RELEASE_IMAGE_OVERRIDE and avoids skew-related CI failures.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: d7a408a7-fa41-4780-8efc-6db5c198a9fa

📥 Commits

Reviewing files that changed from the base of the PR and between 3722459 and 28b6710.

📒 Files selected for processing (1)
  • ci-operator/config/ComplianceAsCode/compliance-operator/ComplianceAsCode-compliance-operator-master.yaml

The compliance operator already provisions an AWS cluster for CI on each
PR. Let's add a new CI job that provisions the operator on a 4.22
cluster so we can test that it adheres to the OpenShift API server TLS
settings.
@rhmdnd
rhmdnd force-pushed the CMP-4147-add-pqc-check-to-ci branch from 28b6710 to fd6f126 Compare May 7, 2026 14:04
@rhmdnd

rhmdnd commented May 7, 2026

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-deployment

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rhmdnd: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@rhmdnd

rhmdnd commented May 7, 2026

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-deployment

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rhmdnd: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci

openshift-ci Bot commented May 7, 2026

Copy link
Copy Markdown
Contributor

@rhmdnd: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/rehearse/ComplianceAsCode/compliance-operator/master/e2e-rosa 3722459 link unknown /pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-rosa
ci/rehearse/ComplianceAsCode/compliance-operator/master/e2e-aws-parallel-arm 3722459 link unknown /pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-parallel-arm
ci/rehearse/ComplianceAsCode/compliance-operator/master/e2e-aws-parallel 3722459 link unknown /pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-parallel
ci/rehearse/ComplianceAsCode/compliance-operator/master/e2e-aws-serial-arm 3722459 link unknown /pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-serial-arm
ci/rehearse/ComplianceAsCode/compliance-operator/master/e2e-aws-serial 3722459 link unknown /pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-serial
ci/rehearse/ComplianceAsCode/compliance-operator/master/e2e-aws-deployment fd6f126 link unknown /pj-rehearse pull-ci-ComplianceAsCode-compliance-operator-master-e2e-aws-deployment

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-ci openshift-ci Bot added lgtm Indicates that a PR is ready to be merged. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. labels Jul 21, 2026
@openshift-ci

openshift-ci Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

ugiordan added a commit to ugiordan/release that referenced this pull request Jul 28, 2026
Adds tls-scanner-run as a test step to the opendatahub-operator-rhoai-e2e
job to enforce TLS compliance scanning on deployed RHOAI components.

Configuration:
- Runs as final test step (blocks PR on failure, can be overridden)
- PQC_CHECK: true (enable post-quantum crypto checks)
- SCAN_NAMESPACE: redhat-ods-operator,redhat-ods-applications

Follows the pattern from compliance-operator (PR openshift#78651).

Reference: https://steps.ci.openshift.org/reference/tls-scanner-run
Related: RHOAIENG-61076

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

@Vincent056 Vincent056 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci

openshift-ci Bot commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: rhmdnd, vickeybrown, Vincent056

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

ugiordan added a commit to ugiordan/release that referenced this pull request Jul 28, 2026
Adds tls-scanner-run as a test step to the opendatahub-operator-rhoai-e2e
job to enforce TLS compliance scanning on deployed RHOAI components.

Configuration:
- tls-scanner-tool base image from OCP 4.22
- Runs as final test step (blocks PR on failure, can be overridden)
- PQC_CHECK: true (enable post-quantum crypto checks)
- SCAN_NAMESPACE: redhat-ods-operator,redhat-ods-applications

Follows the pattern from compliance-operator (PR openshift#78651).

Reference: https://steps.ci.openshift.org/reference/tls-scanner-run
Related: RHOAIENG-61076

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
ugiordan added a commit to ugiordan/release that referenced this pull request Jul 29, 2026
Adds tls-scanner-run as a test step to the opendatahub-operator-rhoai-e2e
job to enforce TLS compliance scanning on deployed RHOAI components.

Configuration:
- tls-scanner-tool base image from OCP 4.22
- Runs as final test step (blocks PR on failure, can be overridden)
- PQC_CHECK: true (enable post-quantum crypto checks)
- SCAN_NAMESPACE: redhat-ods-operator,redhat-ods-applications

Follows the pattern from compliance-operator (PR openshift#78651).

Reference: https://steps.ci.openshift.org/reference/tls-scanner-run
Related: RHOAIENG-61076

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
openshift-merge-bot Bot pushed a commit that referenced this pull request Jul 29, 2026
Adds tls-scanner-run as a test step to the opendatahub-operator-rhoai-e2e
job to enforce TLS compliance scanning on deployed RHOAI components.

Configuration:
- tls-scanner-tool base image from OCP 4.22
- Runs as final test step (blocks PR on failure, can be overridden)
- PQC_CHECK: true (enable post-quantum crypto checks)
- SCAN_NAMESPACE: redhat-ods-operator,redhat-ods-applications

Follows the pattern from compliance-operator (PR #78651).

Reference: https://steps.ci.openshift.org/reference/tls-scanner-run
Related: RHOAIENG-61076

Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants