feat(cli): add leaderboard subcommand with markdown output#22
Conversation
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 7ddff08527
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| p_leaderboard = subparsers.add_parser("leaderboard", | ||
| help="Output quality leaderboard as markdown from an existing DB") | ||
| p_leaderboard.add_argument("--lang", default="Python", help="Language label for the header (default: Python)") | ||
| p_leaderboard.add_argument("--output", "-o", help="Write markdown to file instead of stdout") |
There was a problem hiding this comment.
Accept --db on leaderboard parser
The new command is documented as python -m arbiter leaderboard [--db FILE], but leaderboard itself does not register a --db option, so python -m arbiter leaderboard --db /path/to.db exits with unrecognized arguments. Because this subcommand is new, users are likely to pass flags after the subcommand and will hit a hard failure instead of being able to target an existing database.
Useful? React with 👍 / 👎.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
7ddff08 to
4c3fed4
Compare
Summary
leaderboardsubcommand that reads from an existing DB and outputs quality rankings as a formatted markdown table--markdown/--mdflag togithub-topfor inline markdown output after scoring--outputflag to write markdown to file,--langfor header labelTest plan
--outputwrites to file correctlyleaderboard --helpshows expected flags--markdownflag registered ongithub-top🤖 Generated with Claude Code