feat: Add closed-pr-review-auto-improver agent#1750
Closed
nick-inkeep wants to merge 2 commits intomainfrom
Closed
feat: Add closed-pr-review-auto-improver agent#1750nick-inkeep wants to merge 2 commits intomainfrom
nick-inkeep wants to merge 2 commits intomainfrom
Conversation
Automated system that analyzes human reviewer feedback after PRs are merged to identify generalizable improvements for the pr-review-* subagent system. Architecture: - GitHub Actions workflow triggers on merged PRs - Extracts human comments (filters bots and trivial "LGTM" comments) - Runs meta-analyzer agent to identify patterns humans caught that bots missed - Creates draft PRs with specific improvements to pr-review-*.md agents Key features: - 4-criteria generalizability test to avoid repo-specific additions - Compares human vs bot comments to identify gaps - Conservative: only HIGH generalizability patterns become PRs - Outputs structured JSON for traceability Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
- Simplify workflow by passing human/bot comments and diff directly in prompt - Remove intermediate file steps (no more $RUNNER_TEMP files) - Remove artifact upload step (context is now in the prompt itself) - Update agent definition to expect inline context This matches how pr-review works with inline skill generation. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Collaborator
Author
|
Closing - created in wrong location. Will recreate from isolated clone. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds an automated system that analyzes human reviewer feedback after PRs are merged to identify generalizable improvements for the
pr-review-*subagent system.Problem
Currently, extracting learnings from human reviewer comments is manual. When a human reviewer catches something AI reviewers missed (like the "Type Definition Discipline" feedback on PR #1737), that insight could improve the AI reviewers, but there's no automated feedback loop.
Solution
This PR adds:
GitHub Actions Workflow (
.github/workflows/closed-pr-review-auto-improver.yml)pull_request_target: [closed]when PRs are mergedMeta-Analyzer Agent (
.claude/agents/closed-pr-review-auto-improver.md)pr-review-*.mdagentsArchitecture
Design Decisions
pull_request_targetpull_requestfor closed eventsTest Plan
🤖 Generated with Claude Code