Skip to content

v0.1.2: EVALS_DATA_DIR default, mcq_choice_mismatch fix

Latest

Choose a tag to compare

@cyanheads cyanheads released this 28 Jun 04:59
v0.1.2
b250ed9

EVALS_DATA_DIR default, mcq_choice_mismatch fix

Changed:

  • EVALS_DATA_DIR defaults to ./evals-data when unset or blank — bare npx/bunx starts with no env setup (#2)
  • evals_get_record description trimmed to the action, dropping the verification-subagent meta-coaching (#3)

Fixed:

  • evals_create_draft / evals_revise_draft report mcq_choice_mismatch (was task_type_constraint) when an mcq grader's correct is not in choices[] (#1)

151 tests pass; bun run devcheck clean.