v0.1.0-alpha.22 — Reasoning-model architecture cleanup + adapter-google httpOptions (additive) #50
baabakk
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Released 2026-06-19. Install:
pnpm add @llm-ports/adapter-openai@alpha @llm-ports/adapter-google@alphaTwo themes, both empirically driven by external work this week.
1. Reasoning-model architecture cleanup (adapter-openai)
Driven by ADW's 2026-06-19 instrumentation of their multi-team agentic build loop. DeepInfra-hosted
openai/gpt-oss-120bwas silently failing as a reasoning model in alpha.21 — same model file, same weights, same behavior as Cerebras'sgpt-oss-120b, but the namespace prefix broke the catalog regex (/^gpt-oss-/ianchored at^). The model wasn't recognized as reasoning → budget multiplier never applied → first call burned its budget on hidden CoT → empty visible output → loop terminated ascompleted.The fix isn't another regex. The fix is architectural.
What shipped
normalizeModelIdhelper — strips a<owner>/namespace prefix, returning the canonical name. Used at every entry point to the capability learner. Catalog patterns stay anchored at^; canonical names match regardless of which provider serves the model. The catalog stops needing per-(model × provider) regex variants forever.learnFromResponsereadsmessage.reasoning_content(DeepInfra's harmony field) in addition to the existing fields.reasoningStarvedResponseacceptsfinish_reason: "stop"in addition to"length"(DeepInfra returnsstopfor gpt-oss harmony serving). Also guards against rescuing successful tool-use.MiMo-V\d+family (distinct from MiniMax). Filed after observing mimo-parasail starvation in ADW production this morning.What's still NOT fixed
DeepInfra-served gpt-oss tool-use still doesn't execute the model's tool-call intent. With alpha.22 the budget is correct, the starvation rescue fires, but the tool-call intent often lands in
reasoning_contentrather thantool_calls. Until the adapter parses the harmony channel for tool calls — a separate research-first workstream — for tool-use workloads against gpt-oss, route to Cerebras.2. adapter-google
httpOptionspass-throughcreateGoogleAdapternow forwardsopts.httpOptionsto the underlying@google/genaiGoogleGenAIconstructor. Closes the Dramma backend-proxy plan blocker: the browser bundle can now setbaseUrlto a backend proxy that holds the realGEMINI_API_KEY, instead of inlining the key into the bundle.HttpOptionsis re-exported from@llm-ports/adapter-googleso consumers can type their override without an extra peer dep.Backwards compatibility
All changes are additive. Existing callers see no behavior change.
Tests
763 total (was 736), +29 new across the two adapters. 0 regressions in the other 6 packages.
What's NOT in this release
onValidationRetryRegistry-level emission (still type-only)These slide to alpha.23 or later. Scope discipline: alpha.21 was structured-output reliability; alpha.22 is reasoning-model handling. Each release stays themed.
Coming in alpha.23 (planned)
Full release notes.
Beta Was this translation helpful? Give feedback.
All reactions