Skip to content

v0.13.1

Latest

Choose a tag to compare

@sx4im sx4im released this 10 Oct 16:30
· 1 commit to main since this release
c95374b

Added

  • Support for .cursorrules and .cursor/rules/*.mdc files: evaluate Cursor rules directly as Markdown skills without renaming.
  • --domain CLI option to override automatic domain inference, capped by Unicode code points to preserve multi-byte character and emoji boundaries.
  • low_sample field in result JSON and small-sample warning in CLI, result cards, and markdown reports when evaluating fewer than 5 tasks (Standard profile 3-task runs now warn by default).

Changed

  • Replaced "double-blind" wording with "blind grading" across CLI help text, error messages, and documentation to accurately reflect single-blind grader evaluation.
  • Removed unreproducible leaderboard ranking and corpus lift percentage claims from the README, landing page, and dashboard, replacing rankings with clearly labeled example reports (illustrative output, not real runs).
  • Refined methodology documentation to clarify that false-verdict rates exceed ~11% when fewer than 5 tasks are evaluated and effects vary moderately or more (sd 0.30 or higher).

Fixed

  • Prevented automatic domain inference from using sentences from headingless skill body text as the domain.
  • Escaped Markdown formatting and user mentions (@, [, ], <, >, backticks, pipes, and newlines) in skill names and task excerpts in Markdown reports to prevent PR mention pings and table breakout.
  • Exited with a clear error when combining --markdown and --json flags instead of silently selecting JSON.

Dependencies

  • Updated dotenv to 18.0.5.