Skip to content

feat(testing): add test methodology and report tooling#823

Open
kvinwang wants to merge 8 commits into
masterfrom
docs/test-methodology-tool
Open

feat(testing): add test methodology and report tooling#823
kvinwang wants to merge 8 commits into
masterfrom
docs/test-methodology-tool

Conversation

@kvinwang

Copy link
Copy Markdown
Collaborator

Summary

  • document the dstack test methodology, test-case authoring rules, and report output contract
  • add dstack-test commands with consistent subcommand naming for running cases/plans, finalizing, validating, packaging, and rendering reports
  • preserve each Codex or Claude execution as native JSONL while requiring only a shallow atomic result.json from the agent
  • render a searchable, filterable, self-contained HTML report with explicit cross-reference anchors and collapsible raw evidence
  • include a Proxy Protocol sample plan and automated tests

Validation

  • git diff --cached --check
  • python3 -m unittest discover -s tools/dstack-test/tests -v
  • prek run --all-files
  • reuse lint

Copilot AI review requested due to automatic review settings July 23, 2026 09:40

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants