Skip to content

feat: add subagent-driven-prompt-tuning skill#26

Merged
b4tchkn merged 1 commit into
mainfrom
feat/subagent-driven-prompt-tuning
Apr 23, 2026
Merged

feat: add subagent-driven-prompt-tuning skill#26
b4tchkn merged 1 commit into
mainfrom
feat/subagent-driven-prompt-tuning

Conversation

@b4tchkn
Copy link
Copy Markdown
Owner

@b4tchkn b4tchkn commented Apr 23, 2026

Summary

Adds a new subagent-driven-prompt-tuning skill to the claude-code-best-practice plugin.

The skill tunes Claude Code prompts (SKILL.md, slash commands, task prompts, CLAUDE.md sections, code-gen prompts) by dispatching an unbiased subagent to execute them, then iterating based on:

  • Executor self-report: points of ambiguity, discretionary fill-ins, retries
  • Caller-side metrics: pass/fail on [critical] requirements, accuracy %, tool_uses, duration_ms

It halts only when two consecutive iterations show no new ambiguity and metric deltas fall below threshold, with an overfitting check on a hold-out scenario.

Changes

  • New: plugins/claude-code-best-practice/skills/subagent-driven-prompt-tuning/SKILL.md
  • Updated: CLAUDE.md plugin table to list all five skills under claude-code-best-practice

Attribution

Adapted from empirical-prompt-tuning in mizchi/chezmoi-dotfiles, rewritten to match this marketplace's tone and renamed to signal what is being tuned and how. Attribution is preserved in the SKILL.md body.

Test plan

  • Skill frontmatter parses (name, description, argument-hint, allowed-tools)
  • Manually invoke the skill against a small target prompt and confirm the workflow steps are followable
  • Verify the skill appears under claude-code-best-practice when the plugin is installed

…ctice

Add a new skill that tunes Claude Code prompts (SKILL.md, slash commands,
task prompts, CLAUDE.md sections) by dispatching unbiased subagents to
execute them, then iterating on both executor self-report and caller-side
metrics until improvements plateau.

Adapted from mizchi/chezmoi-dotfiles's empirical-prompt-tuning skill with
attribution, renamed to better signal what is being tuned and how.
@b4tchkn b4tchkn marked this pull request as ready for review April 23, 2026 15:37
@b4tchkn b4tchkn merged commit fed72f4 into main Apr 23, 2026
@b4tchkn b4tchkn deleted the feat/subagent-driven-prompt-tuning branch April 23, 2026 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant