Self-improving agent hierarchies - 4 plugins for quality feedback, auto-retry, skill routing, and prompt evolution #2454
bradysmith-dev
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I've built a set of 4 Paperclip plugins that add a self-improvement layer to agent hierarchies. Sharing here in case it's useful to others working on multi-agent setups.
Architecture
All 4 plugins are built with
@paperclipai/plugin-sdkand communicate through Paperclip's JSON-RPC 2.0 protocol. Each runs as an isolated Node.js child process. They're event-driven and composable - use all four together or drop individual plugins into an existing setup.The event flow:
Plugins
Performance Tracker (
@ai-corp/performance-tracker)Subscribes to
issue.completedevents, logs success/failure outcomes, calculates rolling success rates, and emitsTASK_COMPLETEDwith structured metadata. Detects degradation when success rate drops below a configurable threshold.Self-Correction (
@ai-corp/self-correction)Listens for
TASK_COMPLETEDevents from Performance Tracker. Runs a QA check on the output. If the check fails: retries up to a configurable limit, then escalates to a supervisor agent. Passes on success.Skill Router (
@ai-corp/skill-router)Listens for
issue.created. Analyzes the task description and assigns the appropriate tools and agent type before work begins. Prevents misrouting (e.g., a Worker agent receiving a task that needs architectural decisions).Prompt Evolver (
@ai-corp/prompt-evolver)Subscribes to
TASK_COMPLETED. Stores outcome data per agent. When Performance Tracker emits a degradation event, Prompt Evolver uses the accumulated outcome data to propose a rewritten prompt for that agent.Test coverage and production status
What's for sale
The plugin pack is available on Gumroad: https://bradytech.gumroad.com/l/ai-companies
Includes the 4 plugins, a pre-wired company template (3-agent hierarchy with plugins configured), and a 10-chapter implementation guide.
$49 for the pack, $149 with a Q&A session and 30 days priority support.
I'm deaf so all support and discussion is text-based. Happy to answer technical questions here in this thread.
All reactions