Skip to content

feat(delivery): add phase orchestration workflow - #113

Merged
aryeko merged 4 commits into
mainfrom
feat/phase-delivery-orchestration
Jul 29, 2026
Merged

feat(delivery): add phase orchestration workflow#113
aryeko merged 4 commits into
mainfrom
feat/phase-delivery-orchestration

Conversation

@aryeko

@aryeko aryeko commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add the Codex-discoverable repository-local orchestrate-phase-delivery skill under .agents/skills/, including authored evals, validation, packaging guidance, and recovery protocol
  • define one phase integration worktree, one registered worktree plus continuous implementer/reviewer pair per story, declared-DAG ready-set scheduling, bounded parallelism, and one final phase PR
  • replace the retired custom-sealer/detached-clone gate with exact committed-candidate, base, required-check, and same-reviewer verdict evidence in the external phase ledger
  • require local Git worktrees for delivery, verification, review, and recovery while retaining product/design authority, activation, DoR/DoD, read-only review, required CI, and declared tracker dependencies
  • remove the obsolete sealer scripts and package commands without adding or changing any track.json dependency edge

Validation

  • pnpm check
  • authored skill eval validator: 3 output cases and 20 trigger cases
  • open-skill-creator skill validation and package build
  • candidate package, active repository, documentation-link, formatting, boundary, runtime, and repository test gates

Transition

This intentionally supersedes the custom candidate sealer as a required delivery or review prerequisite. Historical seal evidence remains historical only; ordinary committed-candidate evidence plus continuous independent review and normal hosted CI govern this workflow.

Summary by CodeRabbit

  • New Features

    • Added an operational “phase delivery” orchestration skill with end-to-end workflow guidance, recovery/stop rules, and ledger-backed phase PR creation.
  • Documentation

    • Updated delivery policy, verification rules, and reviewer boundary guidance to enforce fail-closed, frozen-candidate evidence handling and bounded review/integration behavior.
    • Revised greenfield story specs to prohibit suffixed story splits and keep changes within a single work boundary.
  • Chores

    • Removed the candidate sealing step from the primary repository check flow.
    • Expanded validation fixtures/coverage for the new orchestration materials and tightened delivery-track/stopping rules.

@coderabbitai

coderabbitai Bot commented Jul 29, 2026

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: da0561e5-920e-4131-ac5d-89b362454fe5

📥 Commits

Reviewing files that changed from the base of the PR and between 27a98a9 and 1bad0b9.

📒 Files selected for processing (8)
  • .agents/skills/orchestrate-phase-delivery/README.md
  • .agents/skills/orchestrate-phase-delivery/SKILL.md
  • .agents/skills/orchestrate-phase-delivery/references/phase-protocol.md
  • .agents/skills/orchestrate-phase-delivery/scripts/validate_evals.py
  • docs/delivery/greenfield/reviewer/review-checklist.md
  • docs/delivery/greenfield/story-contract.md
  • scripts/check-delivery-track.mjs
  • scripts/check-delivery-track.test.mjs
🚧 Files skipped from review as they are similar to previous changes (8)
  • .agents/skills/orchestrate-phase-delivery/references/phase-protocol.md
  • .agents/skills/orchestrate-phase-delivery/README.md
  • .agents/skills/orchestrate-phase-delivery/SKILL.md
  • .agents/skills/orchestrate-phase-delivery/scripts/validate_evals.py
  • scripts/check-delivery-track.mjs
  • scripts/check-delivery-track.test.mjs
  • docs/delivery/greenfield/story-contract.md
  • docs/delivery/greenfield/reviewer/review-checklist.md

📝 Walkthrough

Walkthrough

Adds an orchestration skill and phase-delivery documentation, formalizes worktree and candidate-evidence rules, adds skill evaluation assets, and replaces candidate sealing with registered-worktree and manifest validation.

Changes

Phase orchestration contract

Layer / File(s) Summary
Orchestration contract and recovery
.agents/skills/orchestrate-phase-delivery/*, docs/delivery/greenfield/phase-*.md, docs/delivery/greenfield/dependency-dag.md, docs/delivery/AGENTS.md, docs/delivery/README.md
Defines DAG inspection, external-ledger state, registered worktrees, bounded story execution, candidate review, integration, recovery, closure, and handoff rules.

Evidence and review contract

Layer / File(s) Summary
Evidence and review contract
docs/delivery/greenfield/delivery-policy.md, story-contract.md, verification.md, reviewer/*, risks-and-owner-decisions.md
Replaces sealing-centered evidence with candidate-bound checks, read-only review, worktree registration, deterministic verification, drift handling, and phase-closure requirements.

Single-story boundary constraints

Layer / File(s) Summary
Single-story boundary constraints
docs/delivery/greenfield/stories/GF-*.md
Restricts staged slices to each story’s existing worktree, continuous pair, review, and integration flow, without creating suffixed stories, tracker edges, separate subjects, or additional PRs.

Skill evaluation validation

Layer / File(s) Summary
Skill evaluation validation
.agents/skills/orchestrate-phase-delivery/evals/*, .agents/skills/orchestrate-phase-delivery/scripts/validate_evals.py
Adds three output evaluations, twenty trigger queries, and validation for schemas, counts, balance, uniqueness, and split coverage.

Repository checks and package transition

Layer / File(s) Summary
Repository checks and package transition
package.json, scripts/check-active-repository.*, scripts/check-delivery-track.*
Removes candidate-sealing execution requirements, registers orchestration assets in active-path and candidate-package checks, and adds coverage for unexpected skill paths, manifest binding, and suffixed story IDs.

Estimated code review effort: 4 (Complex) | ~45 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 0.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title accurately summarizes the main change: adding the delivery phase orchestration workflow and related skill assets.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches 💡 1
📝 Generate docstrings 💡
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feat/phase-delivery-orchestration

Comment @coderabbitai help to get the list of available commands.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b0c85e3c22

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread docs/delivery/greenfield/delivery-policy.md Outdated
Comment thread docs/delivery/greenfield/delivery-policy.md Outdated
Comment thread docs/delivery/greenfield/delivery-policy.md

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 7

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.agents/skills/orchestrate-phase-delivery/README.md:
- Line 20: Update the skill-validator instruction in the
orchestrate-phase-delivery README to replace the unresolved <open-skill-creator>
placeholder with either a documented prerequisite that defines its location or a
concrete command runnable from the repository. Keep the validation target and
intended validator invocation unchanged.

In @.agents/skills/orchestrate-phase-delivery/references/phase-protocol.md:
- Around line 57-61: Update the reattach command in the worktree recovery
procedure to use the force option when invoking git worktree add. Keep the
existing prerequisites for verifying the recorded branch/object, registered
path, ledger, base, evidence, and clean state before reattaching.

In @.agents/skills/orchestrate-phase-delivery/scripts/validate_evals.py:
- Around line 36-50: Update the output-case validation in the cases loop to
require nonempty strings for id, prompt, and expected_output, rather than only
truthy values; keep the existing assertions and files checks intact. Validate
IDs before constructing case_ids or deduplicating with set so malformed or
unhashable IDs produce the existing validation failure instead of a TypeError.

In @.agents/skills/orchestrate-phase-delivery/SKILL.md:
- Around line 8-10: Update the required-input step in the phase orchestration
skill to resolve the current approved product package from docs/product/ and
approved architecture package from docs/redesign/design/ before reading or
relying on delivery-policy.md, story-contract.md, track.json, or
phase-orchestration.md. Preserve the existing checks for external activation and
ledger records, and ensure track or Git evidence cannot override product intent
or approved design.

In `@docs/delivery/greenfield/reviewer/review-checklist.md`:
- Around line 105-106: The Q/R/P refresh rule in the “Approved P = Q + durable R
identifier + PASS” checklist bullet is too broad. Qualify the
add/remove/rename/mode/byte drift requirement to changes in the approved package
Q/P, preserving the later rule for source, configuration, and evidence changes
that creates a new candidate with affected checks and review.
- Around line 149-151: Update the post-“Accepted” continuation-evidence
checklist wording so that drift requires affected checks, replacing “any drift
received affected checks” with clear mandatory-response language while
preserving the surrounding conditions and same-reviewer incremental review
guidance.

In `@scripts/check-delivery-track.mjs`:
- Around line 762-770: Update candidatePackagePaths() to include
scripts/check-active-repository.test.mjs alongside the existing validator tests,
adjust the manifest’s exact path count and uniqueness validation to the new
total, and add the same path to the corresponding test fixture so
active-repository test changes invalidate approved Q/P.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: a0e5dc2b-f32f-479e-98e5-1f47ca622f87

📥 Commits

Reviewing files that changed from the base of the PR and between 4b067f4 and b0c85e3.

📒 Files selected for processing (25)
  • .agents/skills/orchestrate-phase-delivery/README.md
  • .agents/skills/orchestrate-phase-delivery/SKILL.md
  • .agents/skills/orchestrate-phase-delivery/evals/evals.json
  • .agents/skills/orchestrate-phase-delivery/evals/trigger_queries.json
  • .agents/skills/orchestrate-phase-delivery/references/phase-protocol.md
  • .agents/skills/orchestrate-phase-delivery/scripts/validate_evals.py
  • docs/delivery/AGENTS.md
  • docs/delivery/README.md
  • docs/delivery/greenfield/README.md
  • docs/delivery/greenfield/delivery-policy.md
  • docs/delivery/greenfield/dependency-dag.md
  • docs/delivery/greenfield/phase-handoff-template.md
  • docs/delivery/greenfield/phase-orchestration.md
  • docs/delivery/greenfield/reviewer/README.md
  • docs/delivery/greenfield/reviewer/review-checklist.md
  • docs/delivery/greenfield/risks-and-owner-decisions.md
  • docs/delivery/greenfield/story-contract.md
  • docs/delivery/greenfield/verification.md
  • package.json
  • scripts/check-active-repository.mjs
  • scripts/check-active-repository.test.mjs
  • scripts/check-delivery-track.mjs
  • scripts/check-delivery-track.test.mjs
  • scripts/seal-candidate.mjs
  • scripts/seal-candidate.test.mjs
💤 Files with no reviewable changes (2)
  • scripts/seal-candidate.mjs
  • scripts/seal-candidate.test.mjs

Comment thread .agents/skills/orchestrate-phase-delivery/README.md Outdated
Comment thread .agents/skills/orchestrate-phase-delivery/references/phase-protocol.md Outdated
Comment thread .agents/skills/orchestrate-phase-delivery/scripts/validate_evals.py Outdated
Comment thread .agents/skills/orchestrate-phase-delivery/SKILL.md Outdated
Comment thread docs/delivery/greenfield/reviewer/review-checklist.md Outdated
Comment thread docs/delivery/greenfield/reviewer/review-checklist.md Outdated
Comment thread scripts/check-delivery-track.mjs Outdated

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.agents/skills/orchestrate-phase-delivery/SKILL.md:
- Around line 20-23: Update the phase delivery workflow around the pre-check
residue capture to add a final post-review snapshot before merge. Record
tracked/untracked status and the exact output of git ls-files --others --ignored
--exclude-standard, binding this residue evidence to the reviewed candidate
alongside the existing inventories and allowlist decisions.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 3bd043d6-b42a-46f2-89e5-604b1cec08e5

📥 Commits

Reviewing files that changed from the base of the PR and between b0c85e3 and 27a98a9.

📒 Files selected for processing (28)
  • .agents/skills/orchestrate-phase-delivery/SKILL.md
  • .agents/skills/orchestrate-phase-delivery/evals/evals.json
  • .agents/skills/orchestrate-phase-delivery/references/phase-protocol.md
  • docs/delivery/greenfield/delivery-policy.md
  • docs/delivery/greenfield/phase-handoff-template.md
  • docs/delivery/greenfield/phase-orchestration.md
  • docs/delivery/greenfield/reviewer/README.md
  • docs/delivery/greenfield/reviewer/review-checklist.md
  • docs/delivery/greenfield/stories/GF-001.md
  • docs/delivery/greenfield/stories/GF-002.md
  • docs/delivery/greenfield/stories/GF-005.md
  • docs/delivery/greenfield/stories/GF-015.md
  • docs/delivery/greenfield/stories/GF-021.md
  • docs/delivery/greenfield/stories/GF-024.md
  • docs/delivery/greenfield/stories/GF-025.md
  • docs/delivery/greenfield/stories/GF-026.md
  • docs/delivery/greenfield/stories/GF-030.md
  • docs/delivery/greenfield/stories/GF-040.md
  • docs/delivery/greenfield/stories/GF-041.md
  • docs/delivery/greenfield/stories/GF-043.md
  • docs/delivery/greenfield/stories/GF-044.md
  • docs/delivery/greenfield/stories/GF-046.md
  • docs/delivery/greenfield/stories/GF-050.md
  • docs/delivery/greenfield/stories/GF-053.md
  • docs/delivery/greenfield/story-contract.md
  • docs/delivery/greenfield/verification.md
  • scripts/check-delivery-track.mjs
  • scripts/check-delivery-track.test.mjs
🚧 Files skipped from review as they are similar to previous changes (10)
  • .agents/skills/orchestrate-phase-delivery/evals/evals.json
  • docs/delivery/greenfield/phase-handoff-template.md
  • .agents/skills/orchestrate-phase-delivery/references/phase-protocol.md
  • docs/delivery/greenfield/verification.md
  • scripts/check-delivery-track.test.mjs
  • scripts/check-delivery-track.mjs
  • docs/delivery/greenfield/phase-orchestration.md
  • docs/delivery/greenfield/delivery-policy.md
  • docs/delivery/greenfield/reviewer/README.md
  • docs/delivery/greenfield/reviewer/review-checklist.md

Comment thread .agents/skills/orchestrate-phase-delivery/SKILL.md Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant