Releases: queso/promptdiff
Releases · queso/promptdiff
Release list
v1.2.0
v1.1.0
v1.0.0
What's Changed
- feat(compare): model-vs-model comparisons (per-arm model/runner) by @queso in #2
- docs: vision evals, endpoint options, output-file grading by @queso in #8
- feat(render): template placeholders — test production prompts directly by @queso in #16
- fix(runner): explicit budget-abort errors + budget sizing docs by @queso in #9
- ci: add Nitpick PR review by @queso in #7
- feat: small-issue batch — #4, #6, #11, #13, #14, #17 by @queso in #23
- feat(openai): real cost accounting — maxBudgetUsd enforces on OpenAI-compatible endpoints by @queso in #24
- feat(measure): single-arm characterization — pass rates, no assertions by @queso in #25
- feat(receipts): content-addressed eval receipts (--receipts) by @queso in #26
- feat(cache): opt-in baseline-arm caching keyed on content (#12) by @queso in #27
- feat(grader): json grader — path assertions over the last balanced JSON value (#19) by @queso in #28
- feat(judge): calibrated judge grader — rubric + fixtures + refuse-to-grade gate (#21) by @queso in #29
- release: v1.0.0 + release-please automation + npm publish on tag by @queso in #30
- fix: correct npm scope to @TheAITeam by @queso in #31
New Contributors
Full Changelog: https://github.com/queso/promptdiff/commits/v1.0.0