Repository navigation
v0.6.0
llm-translator v0.6.0 Changelog
Release Date: November 2026
Release Type: Minor
Branch: next → master
Overview
Version 0.6.0 adds four things: POST /v1/embeddings forwarding, sampling extensions such as min_p and repetition_penalty for clients that cannot send them, strict tool use in both directions with a schema check, and a capture option that records exchanges for debugging.
capture and sampling are off until configured, and embeddings is a new route. The one change that can affect existing requests is strict: it now reaches Anthropic-protocol upstreams from Chat Completions clients, a strict tool whose schema is outside the strict subset is sent without strict and with a warning, and under unknownFields: "error" it is a 400. See the upgrade notes.
✨ Features
Embeddings pass-through (#116)
POST /v1/embeddings on the OpenAI front forwards the request to an OpenAI-protocol upstream that lists the model, and api.embeddings.send(body, { signal, headers }) does the same as a library call. The body and reply pass through unchanged, except that model becomes the upstream's name for it after aliases. Pools and failover work as for chat, apiKey and authorize apply, and errors use the OpenAI shape.
Anthropic-protocol endpoints in a pool are skipped, and a model served only by them gets a 400 embeddings_unsupported. A model no upstream lists gets a 404 model_not_found, because embeddings have no single-model fallback. Usage is not reported to onUsage yet (#121). Resolves #28.
Sampling extensions per upstream and per request (#115)
Anthropic requests have no field for min_p, repetition_penalty and similar, so there was no way to send them. The new sampling setting adds them to requests for an OpenAI-protocol upstream, for example { "min_p": 0.05, "repetition_penalty": 1.1 }, and an Anthropic client can set them per request in metadata.sampling, which wins over the setting. Fields the request already carries are kept.
seed, frequency_penalty and presence_penalty go to every OpenAI-protocol upstream, and the rest only to a driver that lists the field in info().fields. Names are the vLLM ones; the llama.cpp driver sends repetition_penalty as repeat_penalty. A field the driver does not accept follows unknownFields: dropped, or rejected with unsupported_field. metadata.sampling is removed before a request goes to a native Anthropic upstream. Resolves #60.
strict tool use end to end (#117)
strict now round trips: Chat Completions to Anthropic maps function.strict to the tool's strict, which used to be lost, and the other direction already forwarded it.
Schemas of strict tools are checked against the strict subset: objects need additionalProperties: false and every property in required, and keywords such as allOf, not, if/then/else and patternProperties are flagged. A tool whose schema is outside the subset is sent without strict, with a warning event (kind: "strict"), so the request still goes through but that tool isn't enforced (#125). With unknownFields: "error" the request fails with unsupported_content instead.
A new driver flag, info().strict, says whether a backend can enforce strict tool use. It is true for anthropic, openai and vllm (where enforcement depends on --tool-strict-level). A strict tool sent to any other backend gets a warning that it is not enforced. These flags follow what each server documents; confirming them against real servers is open in #120. Resolves #57.
Capture for debugging (#118)
The capture config option records the exchanges that pass through send and the server, for troubleshooting a new backend. Set it to a directory for one JSON file per exchange, or to a callback that receives each record. It is off by default. A record holds the client request, the request converted for the upstream and the upstream's reply. Streams keep the upstream's raw SSE text and the events sent to the client, each capped at 1,000,000 characters.
The value of any header whose name contains key, token, secret, auth, cookie or password is replaced by [redacted]. Bodies are recorded as they are, so treat the files as sensitive: they contain prompts and completions. Only the endpoint that answered is recorded, and embeddings are not captured; both are open in #122. A capture that cannot be written is reported as a warning event with kind: "capture" and never changes the reply. Resolves #53.
🔧 CI & tooling
- Corrected a
ci.ymlcomment that said type checking runs inside the coverage-badge job. It runs as its own🔎 Type Checkjob.
📚 Documentation
- NEW: docs/changelog/v0/v0.6.0.md: this changelog.
- docs/server.md covers the embeddings route, docs/settings.md the
samplingsetting, docs/events.md capture and thestrictwarning, and docs/drivers.mdinfo().strict. docs/protocol-support.md and the known limitations are updated to match. - The feature inventory totals were out of date and are recounted. FI-107 (non-standard finish reasons, shipped in v0.4.0) is marked implemented, and the partial rows that pointed at closed issues or none now link open ones: #120, #123 and #124.
🔧 Dependencies
No dependency updates.
Upgrade notes
strictnow reaches Anthropic-protocol upstreams from Chat Completions clients. A client that setsfunction.strictgets it enforced there for schemas in the strict subset, where it used to be dropped.- Strict tools outside the subset lose
strict. They are sent without it, with awarningevent (kind: "strict"). From Anthropic clients to OpenAI-protocol upstreams this is a change: those tools used to be forwarded withstrictas they were. WithunknownFields: "error"they are a 400unsupported_content, so check strict schemas before upgrading if you run with that setting. - Third-party drivers:
info().strictis optional. A driver without it gets a warning for each request that still carries a strict tool after the subset check, so set it totrueif the backend enforces strict tool use. - No other changes are needed. The new
samplingandcaptureoptions have no effect until set.
| Metric | Coverage |
|---|---|
| Statements | 100.0% |
| Branches | 100.0% |
| Functions | 100.0% |
| Lines | 100.0% |
Avg: 100.0% · 893729c · Node lts/*