You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Added
Support for .cursorrules and .cursor/rules/*.mdc files: evaluate Cursor rules directly as Markdown skills without renaming.
--domain CLI option to override automatic domain inference, capped by Unicode code points to preserve multi-byte character and emoji boundaries.
low_sample field in result JSON and small-sample warning in CLI, result cards, and markdown reports when evaluating fewer than 5 tasks (Standard profile 3-task runs now warn by default).
Changed
Replaced "double-blind" wording with "blind grading" across CLI help text, error messages, and documentation to accurately reflect single-blind grader evaluation.
Removed unreproducible leaderboard ranking and corpus lift percentage claims from the README, landing page, and dashboard, replacing rankings with clearly labeled example reports (illustrative output, not real runs).
Refined methodology documentation to clarify that false-verdict rates exceed ~11% when fewer than 5 tasks are evaluated and effects vary moderately or more (sd 0.30 or higher).
Fixed
Prevented automatic domain inference from using sentences from headingless skill body text as the domain.
Escaped Markdown formatting and user mentions (@, [, ], <, >, backticks, pipes, and newlines) in skill names and task excerpts in Markdown reports to prevent PR mention pings and table breakout.
Exited with a clear error when combining --markdown and --json flags instead of silently selecting JSON.