Skip to content

AgentConfigScore v0.5.1

Choose a tag to compare

View all tags
@LE0-Lin LE0-Lin released this 21 Aug 06:12
· 73 commits to main since this release
v0.5.2
868416b

AgentConfigScore v0.5.1

AgentConfigScore is a regression gate for AI coding-agent instructions — think Codecov for AGENTS.md and CLAUDE.md.

Highlights

  • Block pull requests that make agent instructions worse
  • Compare baseline → candidate scores
  • Detect newly introduced errors and regressions
  • Support AGENTS.md, CLAUDE.md, Cursor, Copilot, Gemini and more
  • Reusable GitHub Action via LE0-Lin/AgentConfigScore@v0
  • Structured Action outputs for downstream workflows
  • SARIF 2.1.0 output for GitHub Code Scanning
  • Zero runtime dependencies
  • No API key or LLM required
  • Tested on Python 3.10, 3.12 and 3.13

Quick start

- uses: LE0-Lin/AgentConfigScore@v0
  with:
    max-drop: "0"
    fail-on-new-errors: "true"

Live demo

See a real intentionally failing pull request where AgentConfigScore detected an unsafe curl | bash instruction and blocked the regression:

#6

Feedback

Real-world agent configuration regressions and false-positive reports are welcome:

#8

If AgentConfigScore is useful in your repository, a ⭐ helps other maintainers discover it.

Assets 2
Loading