Skip to content

Add cloud integration CI test foundation#39

Merged
sdairs merged 12 commits intobump-v0.1.12from
codex/issue-29-ci-testing-foundation
Mar 16, 2026
Merged

Add cloud integration CI test foundation#39
sdairs merged 12 commits intobump-v0.1.12from
codex/issue-29-ci-testing-foundation

Conversation

@sdairs
Copy link
Copy Markdown
Collaborator

@sdairs sdairs commented Mar 14, 2026

Summary

Build out the initial cloud integration CI testing foundation for clickhousectl.

This adds a live-cloud Rust integration test harness that exercises the built CLI binary, a dedicated GitHub Actions workflow, and an expanded service lifecycle flow with structured output and capability checks.

What changed

  • add a cloud integration workflow for manual/nightly runs
  • add a Rust integration test harness under tests/
  • exercise the built clickhousectl binary rather than internal handlers
  • add a service lifecycle flow covering:
    • org checks
    • service create/get/list
    • rename + readback verification
    • stop/start
    • explicit delete
    • scaling transitions
  • add non-blocking capability checks with CONTINUE_ON_NON_BLOCKING_FAILURES=1
  • improve output so runs are readable and easier to inspect from CI logs
  • redact org/service identifiers from the harness logs
  • document how to run the cloud integration suite locally

Verification

cargo test --test cloud_cli -- --ignored --list

Live test runs were also used during development to validate the harness behavior.

Known follow-ups

Issues raised from live runs:

@sdairs sdairs requested a review from iskakaushik March 14, 2026 22:05
@sdairs sdairs had a problem deploying to cloud-integration March 16, 2026 16:34 — with GitHub Actions Failure
@sdairs sdairs had a problem deploying to cloud-integration March 16, 2026 16:40 — with GitHub Actions Failure
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a real-cloud integration testing foundation for clickhousectl, including an ignored Rust test harness that exercises the built CLI binary, plus a scheduled/manual GitHub Actions workflow to run it against live ClickHouse Cloud.

Changes:

  • Added a Rust integration test harness under tests/cloud_cli/ with structured step logging, polling helpers, and best-effort cleanup.
  • Added a live service CRUD lifecycle test that provisions, updates, scales, and deletes a cloud service via the clickhousectl cloud --json CLI.
  • Added a dedicated Cloud Integration GitHub Actions workflow and documented how to run the suite locally.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
tests/cloud_cli/support.rs Implements the CLI runner, step/failure recording, polling, cleanup, and redaction helpers for the live-cloud harness.
tests/cloud_cli/service_crud.rs Adds the end-to-end service lifecycle integration test (ignored by default) using the support harness.
tests/cloud_cli.rs Wires the integration test modules into a single integration test target.
README.md Documents required env vars and how to run the cloud integration suite locally.
.github/workflows/cloud-integration.yml Adds scheduled/manual CI workflow to build the binary and run the ignored live-cloud test.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

@sdairs sdairs changed the base branch from main to bump-v0.1.12 March 16, 2026 16:49
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@sdairs sdairs merged commit dc61b3d into bump-v0.1.12 Mar 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants