Skip to content

Releases: computor-org/plot-grader

plot-grader v0.1.0

Choose a tag to compare

@krystophny krystophny released this 21 Oct 23:06
13b95b1

First public release of plot-grader, the plot-evaluation prototype for Computor.

  • Tiered grading of matplotlib submissions against a reference: order-independent checks on extracted plot data (Tier 1), looser structural matching (Tier 2), OpenCV image similarity (Tier 3), and an optional vision-language model judge over OpenAI-compatible chat or JEV endpoints (Tier 4).
  • Round-4 tolerant judge (plot_grader.tolerant_judge) with acceptance criteria in docs/criteria.md, and an HTTP judge service (plot_grader.judge_server) for the Computor test-harness hook described in docs/integration.md.
  • webjudge: a small standard-library app for blind human judging of plot pairs.
  • Evaluation scripts and records of past evaluation rounds (docs/history/).

Code only: no assignments, reference solutions or student data are included. The evaluation scripts need your own data; the test suite (uv run pytest tests webjudge/tests) does not.

License: MIT.