Skip to content

chore(coderabbit): focus reviews on core content — close Workflows blind spot + release filter + core-path guidance - #2739

Merged
stranske merged 2 commits into
mainfrom
chore/coderabbit-core-focus
Jul 9, 2026
Merged

chore(coderabbit): focus reviews on core content — close Workflows blind spot + release filter + core-path guidance#2739
stranske merged 2 commits into
mainfrom
chore/coderabbit-core-focus

Conversation

@stranske

@stranske stranske commented Jul 9, 2026

Copy link
Copy Markdown
Owner

What

Follow-up to #2706, from a 30-day review of CodeRabbit's PR engagement. Closes the gaps that #2706 (consumer-template only) didn't cover, and adds guidance that deepens review on core content.

Two files:

Why (measured, 30 days, org-wide)

  • CodeRabbit commented on 1,741 / 2,309 PRs (75%); ~63% of that engagement was maintenance — renovate (460) + sync workflow templates (634) + release (9).
  • chore(coderabbit): skip maintenance-bot PRs fleet-wide via synced .coderabbit.yaml #2706 suppresses renovate + sync in consumer repos, but the Workflows repo was a blind spot: 343 PRs, 226 CR-reviewed, incl. ~35 renovate + 9 release + chore/pins still leaking — in the repo where the most core pipeline work happens.
  • chore(main): release (release-please, 26/mo) wasn't ignored anywhere.

Changes

Reduce maintenance:

  • Root config now ignores renovate[bot], dependabot[bot], github-actions[bot], stranske-keepalive[bot] (agents-workflows-bot deliberately kept — it authors real code; its release PRs are caught by title).
  • Both configs add chore(main): release to ignore_title_keywords.

Increase core-review depth (path_instructions):

  • **/*.py — prioritize correctness, error handling, test coverage; flag untested behavior, swallowed exceptions, unguarded NaN/None in numeric/scoring code.
  • **/alembic/**, **/migrations/** (template) — SQLite-CI-vs-Postgres-prod portability: 63-char identifier limit, op.f() for auto-named constraints, reversible downgrade(). (Targets a repeatedly-observed fleet failure class.)
  • .github/scripts/** (root) — elevated-token JS safety: unhandled rejections, payload validation, injection, spoofable actor checks.

profile: assertive and advisory/non-gating (request_changes_workflow: false) are unchanged — no blocking gate, per the fleet rule.

Rollout

Root config applies to Workflows on merge. Template rides the daily 05:00 UTC maint-68 sync to all 13 consumers (same path as #2706).

🤖 Generated with Claude Code

Copilot AI review requested due to automatic review settings July 9, 2026 10:31
@coderabbitai

coderabbitai Bot commented Jul 9, 2026

Copy link
Copy Markdown

Warning

Review limit reached

You’ve reached a temporary PR review limit under our Fair Usage Limits Policy.

Your recent review volume is higher than typical usage, so adaptive limits are currently applied.

Next review available in: 37 minutes

Your organization has reached its usage spending cap. Adjust your spending cap in the billing tab.

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro

Run ID: ca2f0334-d31e-406c-bf50-537389b4a214

📥 Commits

Reviewing files that changed from the base of the PR and between 8ae71a9 and 221486b.

📒 Files selected for processing (2)
  • .coderabbit.yaml
  • templates/consumer-repo/.coderabbit.yaml
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch chore/coderabbit-core-focus

Comment @coderabbitai help to get the list of available commands.

@agents-workflows-bot

Copy link
Copy Markdown
Contributor

Automated Status Summary

Head SHA: feb841f
Latest Runs: ⏳ pending — Gate
Required contexts: Gate / gate, Health 45 Agents Guard / guard
Required: core tests (3.12): ⏳ pending, core tests (3.13): ⏳ pending, docker smoke: ⏳ pending, gate: ⏳ pending

Workflow / Job Result Logs
(no jobs reported) ⏳ pending

Coverage Overview

  • Coverage history entries: 0

Updated automatically; will refresh on subsequent CI/Docker completions.


Keepalive checklist

Scope

No scope information available

Tasks

  • No tasks defined

Acceptance criteria

  • No acceptance criteria defined

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates CodeRabbit configuration so automated reviews focus on core/workflow-critical changes while reducing review budget spend on maintenance/release PRs, covering both the Workflows repo itself and synced consumer templates.

Changes:

  • Add/extend reviews.auto_review filters to ignore common maintenance bots and ignore release PRs by title (chore(main): release).
  • Add path_instructions guidance to deepen review focus on core areas (workflows, scripts, Python, and migrations in templates).

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
.coderabbit.yaml Adds Workflows-repo-local ignore filters and core-path review instructions (including .github/scripts/** and **/*.py).
templates/consumer-repo/.coderabbit.yaml Extends template config with release-title ignore and additional core/migration-focused path_instructions.

@stranske
stranske merged commit cb498d7 into main Jul 9, 2026
40 checks passed
@stranske
stranske deleted the chore/coderabbit-core-focus branch July 9, 2026 10:36

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 221486b176

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread .coderabbit.yaml
ignore_usernames:
- "renovate[bot]"
- "dependabot[bot]"
- "github-actions[bot]"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Keep auto-pilot PRs reviewable

When the Workflows auto-pilot reaches its create-pr step, .github/workflows/agents-auto-pilot.yml:2296-2314 uses the default actions/github-script client and .github/workflows/agents-auto-pilot.yml:2947 opens [Auto-pilot] PRs, so those substantial agent-authored PRs are authored by github-actions[bot]. Adding that username here makes CodeRabbit skip them silently regardless of labels or other controls (CodeRabbit docs: https://docs.coderabbit.ai/configuration/auto-review), which removes the core review coverage this root config is trying to preserve; prefer excluding maintenance by title/label or creating auto-pilot PRs with the app bot before ignoring this author globally.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants