Skip to content

ci: don't block PRs when CodeRabbit is rate limited#4175

Merged
QuantumExplorer merged 1 commit into
v4.1-devfrom
claude/coderabbit-rate-limit-block-a46f1b
Jul 21, 2026
Merged

ci: don't block PRs when CodeRabbit is rate limited#4175
QuantumExplorer merged 1 commit into
v4.1-devfrom
claude/coderabbit-rate-limit-block-a46f1b

Conversation

@QuantumExplorer

@QuantumExplorer QuantumExplorer commented Jul 21, 2026

Copy link
Copy Markdown
Member

Issue being fixed or feature implemented

When CodeRabbit is rate limited it posts a failing CodeRabbit commit status ("Review rate limited"), which turns the PR checks rollup red (e.g. #4171) even when thepastaclaw has already reviewed the PR. The desired policy is: either a CodeRabbit or a thepastaclaw review must happen — a rate-limited CodeRabbit should not block a PR on its own.

What was done?

  • Added .coderabbit.yaml with reviews.fail_commit_status: false so CodeRabbit no longer fails its commit status when a review can't be performed (this checked-in config overrides the org/UI setting where the failing status is currently enabled).
  • Added an AI Review workflow check (.github/workflows/pr-ai-review.yml) that passes once either coderabbitai or thepastaclaw has submitted a review on the PR. It re-runs automatically on pull_request_review events, so it flips green as soon as the first review lands. Because either reviewer satisfies it, a rate-limited CodeRabbit never blocks a PR that thepastaclaw reviewed (and vice versa).

Note: the CodeRabbit status was never a required check in branch protection — the failing status was cosmetic but made PRs look blocked. If we want the new gate to be enforced, the context AI Review / CodeRabbit or PastaClaw review can be added to the required status checks on the dev branches after this merges.

How Has This Been Tested?

  • Validated both YAML files parse.
  • Verified reviews.fail_commit_status exists (default false) in the CodeRabbit v2 config schema.
  • Confirmed via the GitHub API that the failing CodeRabbit status on feat(platform)!: document history system contract with per-doctype opt-in #4171 is not a required check, and that this workflow's review query matches the reviews present there (thepastaclaw has reviewed → gate would pass).

Breaking Changes

None.

Checklist:

  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have added or updated relevant unit/integration/functional/e2e tests
  • I have added "!" to the title and described breaking changes in the corresponding section if my code contains any
  • I have made corresponding changes to the documentation if needed

For repository code-owners and collaborators only

  • I have assigned this pull request to a milestone

🤖 Generated with Claude Code

Summary by CodeRabbit

  • New Features

    • Added an automated pull request review check that passes when an approved automated or designated reviewer submits a review.
    • The check reruns automatically when pull requests are updated or new reviews are submitted.
  • Chores

    • Updated review status handling so temporary review failures, such as rate limiting, do not incorrectly fail the commit status.

CodeRabbit posts a failing "CodeRabbit" commit status ("Review rate
limited") when it can't review a PR, which turns the checks rollup red
even when thepastaclaw has already reviewed.

- Add .coderabbit.yaml with reviews.fail_commit_status: false so a
  rate-limited review no longer fails the commit status (overrides the
  org/UI setting).
- Add an "AI Review" workflow check that passes once either CodeRabbit
  or thepastaclaw has submitted a review, and re-runs when a review is
  submitted. Either reviewer satisfies it, so a rate-limited CodeRabbit
  doesn't block a PR that thepastaclaw reviewed.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@github-actions github-actions Bot added this to the v4.1.0 milestone Jul 21, 2026
@coderabbitai

coderabbitai Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Warning

Ignoring CodeRabbit configuration file changes. For security, only the configuration from the base branch is applied for open source repositories.

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 1925720e-ef0e-4575-abbb-218c80f0053f

📥 Commits

Reviewing files that changed from the base of the PR and between e8ea6ea and f2b13e8.

📒 Files selected for processing (2)
  • .coderabbit.yaml
  • .github/workflows/pr-ai-review.yml

📝 Walkthrough

Walkthrough

Changes

AI review enforcement

Layer / File(s) Summary
Workflow entrypoint
.github/workflows/pr-ai-review.yml
Adds the “AI Review” workflow for pull request activity and review submissions, with read-only permissions and per-PR concurrency.
Review identity gate
.github/workflows/pr-ai-review.yml, .coderabbit.yaml
Checks paginated, non-pending reviews for approved identities and disables CodeRabbit commit-status failure when review execution is unavailable.

Estimated code review effort: 2 (Simple) | ~15 minutes

Sequence Diagram(s)

sequenceDiagram
  participant PullRequest
  participant AIReviewWorkflow
  participant GitHubReviews
  PullRequest->>AIReviewWorkflow: Trigger on PR activity or review submission
  AIReviewWorkflow->>GitHubReviews: Paginate pull request reviews
  GitHubReviews-->>AIReviewWorkflow: Return non-pending reviews
  AIReviewWorkflow-->>PullRequest: Pass or fail the AI Review check
Loading
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title matches the main goal of preventing PR checks from blocking when CodeRabbit cannot review due to rate limiting.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch claude/coderabbit-rate-limit-block-a46f1b

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@thepastaclaw

Copy link
Copy Markdown
Collaborator

🕓 Ready for review — 19 ahead in queue (commit f2b13e8)
Queue position: 20/20

@QuantumExplorer
QuantumExplorer merged commit b4044d1 into v4.1-dev Jul 21, 2026
19 of 20 checks passed
@QuantumExplorer
QuantumExplorer deleted the claude/coderabbit-rate-limit-block-a46f1b branch July 21, 2026 05:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants