Run the review auto-merge gate in shadow mode (Stage 4 calibration) - #28
Merged
Conversation
Records the would-auto-merge decision (verdict block, run notice, action output) without acting on it. Part of Stage 4 of the human-review optimisation program, QuantEcon/project-translation#15; merging starts this edition's calibration window. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
This PR enables “shadow mode” for the review auto-merge gate by passing auto-merge-mode: shadow to QuantEcon/action-translation in the review workflow, so the workflow records would-auto-merge decisions without changing routing, labeling, or merge behavior in this repository.
Changes:
- Add
auto-merge-mode: shadowto the review workflow’sQuantEcon/action-translationstep. - Document the purpose and non-effect of shadow mode in inline workflow comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
📖 Netlify Preview Ready!Preview URL: https://pr-28--verdant-toffee-3261a8.netlify.app Commit: Build Info
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
One-line workflow change: review mode now passes
auto-merge-mode: shadowto action-translation.Nothing observable changes for this repo. Shadow computes the would-auto-merge decision on every review and records it in three places — the
translation-review-verdictblock (wouldAutoMerge: true|false), a workflow notice in the run log, and awould-auto-mergeaction output — and acts on none of them. No PR is merged by machine, no label or routing changes; sync PRs keep going to editors exactly as today.Why: Stage 4 of the human-review optimisation program (QuantEcon/project-translation#15) needs ≥4 weeks of recorded decisions on real sync traffic to measure the gate's base rate (how often it would fire) and precision (whether it would have been right) before the per-criterion floors are set — the floors shipped in verdict v2 are provisional placeholders, and shadow data is what replaces them. Merging this PR starts this edition's calibration window.
Safety: the mechanism shipped in v0.22.0 default-off, is fail-closed throughout (a malformed verdict gates to
editor, never to merge), and was field-validated on the test harness at v0.25.0 on 2026-08-04 — the deployed-path run recordedwouldAutoMerge: trueand took no action (validation record on QuantEcon/project-translation#15).activeis deliberately unimplemented and fails loudly. Reverting is deleting one input line.🤖 Generated with Claude Code