Skip to content

docs: Phase 2 design — local whole-codebase review#6

Merged
smartwatermelon merged 1 commit into
mainfrom
claude/phase2-design-7a2c4e
Apr 3, 2026
Merged

docs: Phase 2 design — local whole-codebase review#6
smartwatermelon merged 1 commit into
mainfrom
claude/phase2-design-7a2c4e

Conversation

@smartwatermelon

Copy link
Copy Markdown
Owner

Summary

  • Design doc for replacing all remote AI review (Claude CI + Sentry/Seer) with local whole-codebase review
  • New --mode=codebase in run-review.sh gives agents full tool access (Read, Grep, Glob) at pre-push
  • Non-blocking findings auto-filed as GitHub issues via shared library extracted from pre-merge-review.sh
  • Based on analysis of what Seer catches across repos that local review currently misses

Test plan

  • Design review and approval
  • Implementation follows in subsequent PRs

🤖 Generated with Claude Code

Replace remote AI review (Claude CI + Sentry/Seer) with local
whole-codebase review. New --mode=codebase gives agents full tool
access at pre-push to catch cross-file semantic bugs that Seer
was catching. Non-blocking findings auto-filed as GitHub issues
via shared library extracted from pre-merge-review.sh.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@smartwatermelon
smartwatermelon force-pushed the claude/phase2-design-7a2c4e branch from 737e697 to 9de2b65 Compare April 3, 2026 01:29
@claude

claude Bot commented Apr 3, 2026

Copy link
Copy Markdown

PR Review: Phase 2 Design — Local Whole-Codebase Review

Scope: Documentation-only addition of docs/plans/2026-04-02-phase2-local-whole-codebase-review.md. No code, hooks, or scripts are changed in this PR.


Summary

This design doc is well-structured and internally consistent. The motivation is clearly grounded in observed evidence (the table of Seer-caught bug classes), and the implementation plan follows a safe, step-by-step approach with validation before cutover. No code regressions are possible from this change.


Observations (non-blocking, ordered by maintenance impact)

1. Step 1 validation claim is circular without a test harness reference
docs/plans/2026-04-02-phase2-local-whole-codebase-review.md (Implementation plan, Step 1): "Verify pre-merge behavior unchanged" — this implies a test or replay mechanism exists for pre-merge-review.sh, but none is referenced. If the shared library extraction (Step 1) is validated only by manual observation, a silent behavioral change could pass through. Consider linking to or defining the validation method before implementation begins.

2. Parallelism section omits failure handling semantics
Lines in the "Parallelism" section describe both modes running in parallel and "Both must pass for push to proceed," but the plan doesn't address what happens when one finishes and BLOCKs before the other completes — should the second be cancelled, or always run to completion to collect all findings? Clarifying this will affect how run-review.sh and the pre-push hook are wired together.

3. "Ralph burndown" is undefined for future readers
The Risks table references "Ralph burndown" as the mitigation for non-blocking issue spam. This term is not explained anywhere in the doc. Adding a one-line note (e.g., "Ralph: the automated issue-triage agent") would make the doc self-contained.

4. --mode=full-diff described as existing but not yet documented in this plan's scope
The pipeline diagram shows run-review.sh --mode=full-diff as pre-existing, but the parent plan (2026-03-25-infrastructure-consolidation-design.md) is referenced without confirming that mode already exists in the live infrastructure. If that mode is also aspirational or partially implemented, Step 3's parallel wiring could arrive before its dependency. Worth a note clarifying current implementation status.

5. Minor: success criterion 5 cost estimate uses a range with no baseline
"~$0.001-0.005/PR" is a rough estimate with no source or comparison point. Not blocking, but future-Andrew will find it useful to know what the current CI cost is to measure against.


Security / Reliability

No concerns. This is a design document with no executable content.

VERDICT: PASS

@smartwatermelon
smartwatermelon merged commit 3e2defa into main Apr 3, 2026
1 check passed
@smartwatermelon
smartwatermelon deleted the claude/phase2-design-7a2c4e branch April 3, 2026 01:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant