Repository navigation
Releases: computor-org/plot-grader
Releases · computor-org/plot-grader
Release list
plot-grader v0.1.0
First public release of plot-grader, the plot-evaluation prototype for Computor.
- Tiered grading of matplotlib submissions against a reference: order-independent checks on extracted plot data (Tier 1), looser structural matching (Tier 2), OpenCV image similarity (Tier 3), and an optional vision-language model judge over OpenAI-compatible chat or JEV endpoints (Tier 4).
- Round-4 tolerant judge (
plot_grader.tolerant_judge) with acceptance criteria indocs/criteria.md, and an HTTP judge service (plot_grader.judge_server) for the Computor test-harness hook described indocs/integration.md. webjudge: a small standard-library app for blind human judging of plot pairs.- Evaluation scripts and records of past evaluation rounds (
docs/history/).
Code only: no assignments, reference solutions or student data are included. The evaluation scripts need your own data; the test suite (uv run pytest tests webjudge/tests) does not.
License: MIT.