Skip to content

enzyme v0.7.1

Choose a tag to compare

@jshph jshph released this 04 Aug 21:56
· 3 commits to main since this release

Enzyme release notes - v0.7.1

Short version

This patch completes the Anthropic sampling-compatibility fix from v0.7.0 (issue #11). The omit list now covers all current 5-generation model ids (claude-opus-5, claude-haiku-5, claude-mythos-5 join claude-sonnet-5/claude-fable-5), and — more importantly — the client no longer depends on that list for correctness: any HTTP 400 rejecting a sampling parameter now triggers an automatic retry with sampling parameters stripped, memoized per endpoint+model for the rest of the run. Future Anthropic model ids work without waiting for an Enzyme release.

What shipped

  • Expanded sampling-omit list. claude-opus-5, claude-haiku-5, and claude-mythos-5 (plus dated variants) no longer receive temperature/top_p/top_k on Anthropic's endpoint. v0.7.0 covered opus-4-7/opus-4-8/sonnet-5/fable-5 but sent temperature to opus-5, which 400s. (c894459)
  • Reactive strip-and-retry fallback. If a completion that included sampling parameters fails with a 400 whose body names temperature/top_p/top_k, the client retries once with all sampling parameters omitted and memoizes the outcome per (base_url, model) — subsequent calls in the run omit them up front. Applies to both streaming and non-streaming paths; non-400 errors, unrelated 400s, and already-sampling-free requests are unaffected, so there is no interaction with the 402 handling or pipeline retries beyond one extra request the first time an unknown-rejecting model appears. (c95d932)
  • Models that accept sampling parameters (e.g. claude-opus-4-6 and earlier) are unchanged and keep Enzyme's configured temperature.

Verification

  • v0.7.0's shipped binary was verified against a mock of Anthropic's OpenAI-compat endpoint reproducing issue #11: opus-4-8/sonnet-5/fable-5 omit temperature and generate catalysts; opus-5 still failed (loudly, exit 1) — the gap this patch closes.
  • cargo test -p enzyme-core: 437 passed (+5 covering rejection detection, request stripping, retry eligibility incl. the no-infinite-retry case, and memoization). All 16 enzyme-cli suites green.

Upgrade / how to try it

Standard update. BYOK users on Anthropic (--use-env-llm with OPENAI_BASE_URL=https://api.anthropic.com/v1/) can use any current Claude model id; enzyme status should show catalysts after refresh.