tools: real-repository regression validation script - #67
Conversation
scripts/validate-real-repos.sh clones outline/cargo/uv shallow, sweeps all 51 workflow files asserting: no panics on audit, empty-value produces no false positives, explain --debug resolves with the correct layer on real multi-layer workflows, outline CI keeps flagging its embedded test credentials, and the production compose config audits clean. Validated this turn against the current code: all checks passed. The script always rebuilds the default release binary — a stale target/release (binary predating the actions subcommand) initially produced 9 spurious failures.
|
Warning Review limit reached
Next review available in: 44 minutes You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. How can I continue?After more reviews become available, a review can be triggered using the To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews. How do review limits work?CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability. For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window. Please refer docs for additional details. Review details⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (3)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
1 participant
One-command regression guard:
scripts/validate-real-repos.shsweeps 51 live workflow files from outline/cargo/uv for panics, empty-value noise, --debug trace correctness, and pins known-good findings. Ran clean this turn. (Also fixes the stale-binary trap: the default release binary is always rebuilt.)