Skip to content

v0.2.0 — adapter backends

Latest
Marketplace
Latest
Marketplace

Choose a tag to compare

View all tags
@dtduc-git dtduc-git released this 19 Sep 11:48
· 1 commit to main since this release
v0.2.0
980f55d

Record any backend, not just Jev.

  • record --backend openai|anthropic|bedrock — LLM baselines through the official system-one-adapter (pip install 'jevassert[adapter]'). Bedrock uses AnthropicBedrock with the standard AWS credential chain.
  • check --input-price/--output-price — cost covers input and output tokens; defaults keep Jev pricing unchanged.
  • Reports and --json show the models actually present in the recording, not the pack's pinned version.
  • GitHub Action gains optional input-price/output-price inputs.
  • 73 tests, ruff clean; existing Jev evidence is byte-identical.

Used to record the first Jev Bench matrix (Jev 1.13.0 vs Claude Sonnet 5 vs a local 7B).

Assets 2
Loading