Skip to content

acroos/ax

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

258 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AX — Agentic Coding DX Metrics ✨

You're shipping PRs with Claude Code. But are they getting better?

AX measures what matters: cost per PR, iteration depth, CI success, and other metrics that tell you whether your AI coding workflow is actually working.


📊 What You Can Measure

🏗️ Output Quality — Is the agent producing clean, mergeable work?

Post-open commits · CI success rate · line revisit rate · review cycle time

💬 Prompt Efficiency — How efficiently are you directing the agent?

Iteration depth · token cost per PR · cache hit rate · unmerged token spend

🤖 Agent Behavior — How well does the agent operate on its own?

Sidechain rate · re-read rate · autonomy score

Every metric has a dedicated doc explaining what it measures, why it matters, and how to interpret values → full metric reference


⚙️ How It Works

AX is a managed service with three components:

Component What it does
🔧 Go CLI Parses Claude Code session data from your machine and pushes it to the server. Installs hooks so this happens automatically.
🚂 Rails API Ingests session data and GitHub webhooks, computes all metrics server-side, manages orgs and auth.
📈 Next.js Dashboard Web UI at https://ax-metrics.vercel.app for viewing metrics, comparing developers, and managing your team.

Data flows in two ways:

  1. Claude Code sessions → CLI parses local session files and pushes to the API
  2. GitHub PR events → Webhooks deliver PR, review, and CI data directly to the API

Metrics are computed server-side when PRs reach a terminal state (merged or closed).


🚀 Quick Start

1. Install the CLI

brew install acroos/tap/ax

Or build from source:

git clone https://github.com/acroos/ax.git
cd ax/cli && just build
# Binary at cli/bin/ax

2. Sign in to the dashboard

Open ax-metrics.vercel.app and sign in with GitHub. You'll get an API key on the onboarding page.

3. Connect the CLI

ax init --api-key <your-key>

That's it! This validates your key, saves config to ~/.ax/config.json, and installs a Claude Code SessionEnd hook that automatically pushes session data after each coding session. 🎉

4. Push your first data

ax push --repo .

After this, the hook handles it automatically. View your results at https://ax-metrics.vercel.app/{your-org-slug}.

👉 See the Setup Guide for the full walkthrough including GitHub App installation and team invites.


🔗 Claude Code Integration

AX is purpose-built for Claude Code workflows. It correlates Claude Code session data — messages, token usage, self-corrections — with your GitHub PRs to give you the full picture of each agent-assisted PR.


🔒 Data Collection

AX collects aggregated session metadata — token counts, cost, timestamps, tool usage counts — never conversation content, source code, or file names. Commit messages and PR metadata (titles, branch names, line-count stats) are also collected to correlate sessions with PRs.

For the full breakdown of what is and isn't collected, see the Data Collection & Privacy doc (also available at /docs/data-collection on the dashboard).


📚 Docs


🤝 Contributing

Start with CLAUDE.md — it covers project conventions, build commands, and the decision record process.

just              # List all recipes (from root)
just cli-build    # Build CLI to cli/bin/ax
just cli-test     # Run CLI tests
just test         # Run all tests (CLI + server)
just lint         # Lint all projects

License

MIT

About

Agentic coding DX metrics — measure how effectively you work with AI coding agents

Resources

Stars

Watchers

Forks

Packages

 
 
 

Contributors