enzyme v0.7.1
Enzyme release notes - v0.7.1
Short version
This patch completes the Anthropic sampling-compatibility fix from v0.7.0 (issue #11). The omit list now covers all current 5-generation model ids (claude-opus-5, claude-haiku-5, claude-mythos-5 join claude-sonnet-5/claude-fable-5), and — more importantly — the client no longer depends on that list for correctness: any HTTP 400 rejecting a sampling parameter now triggers an automatic retry with sampling parameters stripped, memoized per endpoint+model for the rest of the run. Future Anthropic model ids work without waiting for an Enzyme release.
What shipped
- Expanded sampling-omit list.
claude-opus-5,claude-haiku-5, andclaude-mythos-5(plus dated variants) no longer receivetemperature/top_p/top_kon Anthropic's endpoint. v0.7.0 coveredopus-4-7/opus-4-8/sonnet-5/fable-5but senttemperaturetoopus-5, which 400s. (c894459) - Reactive strip-and-retry fallback. If a completion that included sampling parameters fails with a 400 whose body names
temperature/top_p/top_k, the client retries once with all sampling parameters omitted and memoizes the outcome per(base_url, model)— subsequent calls in the run omit them up front. Applies to both streaming and non-streaming paths; non-400 errors, unrelated 400s, and already-sampling-free requests are unaffected, so there is no interaction with the 402 handling or pipeline retries beyond one extra request the first time an unknown-rejecting model appears. (c95d932) - Models that accept sampling parameters (e.g.
claude-opus-4-6and earlier) are unchanged and keep Enzyme's configured temperature.
Verification
- v0.7.0's shipped binary was verified against a mock of Anthropic's OpenAI-compat endpoint reproducing issue #11:
opus-4-8/sonnet-5/fable-5omit temperature and generate catalysts;opus-5still failed (loudly, exit 1) — the gap this patch closes. cargo test -p enzyme-core: 437 passed (+5 covering rejection detection, request stripping, retry eligibility incl. the no-infinite-retry case, and memoization). All 16 enzyme-cli suites green.
Upgrade / how to try it
Standard update. BYOK users on Anthropic (--use-env-llm with OPENAI_BASE_URL=https://api.anthropic.com/v1/) can use any current Claude model id; enzyme status should show catalysts after refresh.