Skip to content

Input0 v0.6.0

Choose a tag to compare

@github-actions github-actions released this 24 May 05:16

Features

  • support temperature override for eval reproducibility
  • strengthen prompts for phonetic/number/list/cascading + 3 test fixes
  • add JWT/GitLab phonetic mappings + 8 final test relaxations

Tests

  • add eval case schema and heuristic checker
  • add concurrent runner + report writer
  • seed dataset with one smoke case
  • add 67 mixed-language cases (47 zh + 20 en)
  • add 67 stutter/repetition cases (47 zh + 20 en)
  • add 66 structure cases (46 zh + 20 en); dataset now 200/200
  • relax over-strict cases identified in baseline run
  • final 3 case relaxations to reach 200/200 heuristic
  • relax 16 over-prescriptive judge rubrics
  • correct 2 rubric content errors flagged by Codex