dsh-llm-gateway-compat — OpenAI-compatible gateway dialect fixes (community plugin)

[snowshadow]

Community plugin, not an official DeepSeek package. It is not endorsed by DeepSeek.

OpenAI-compatible gateways (Bailian, DashScope compatible-mode, vLLM, custom proxies) often break DSH in two ways:

1. Streamed tool-call fragments send empty id / name after a valid first fragment → unknown tool ""
2. Reasoning requests go out as role: "developer" and max_completion_tokens → HTTP 400

This bundle does three things:

• wraps llm/stream so empty identity cannot overwrite a nonempty value
• on those two 400s, writes the official llm-pi-ai compat fields and retries the same step once
• optionally owns Chat Completions routes that default to system + max_tokens, plus extraBody / api-key headers / thinking dialects

Install

From npm (recommended — ships built lib/, no install-time build):

dsh plugin --profile web add dsh-llm-gateway-compat

Restart dsh web.

From GitHub, pin the tag. pnpm ≥10 may ask you to allow prepare:

dsh plugin --profile web add github:snowshadow/dsh-llm-gateway-compat#v0.3.0

allowBuilds:
  dsh-llm-gateway-compat: true

npm: https://www.npmjs.com/package/dsh-llm-gateway-compat
Repo: https://github.com/snowshadow/dsh-llm-gateway-compat

This does not replace an official adapter fix. It is a community mitigation for:

• Bug: streamed tool-call deltas with empty id/name overwrite valid values #1500
• [Bug] All tool calls fail with UNKNOWN_TOOL (unknown tool "") when using Bailian (DashScope) deepseek-v4-flash as provider #3464
• OpenAI 兼容网关续传分片携带空 name 时，llm-deepseek 工具调用名被清空 #3767
• [Bug] developer role rejected (HTTP 400) by custom domestic (China) OpenAI-compatible providers #2388
• [Bug] llm-pi-ai: hand-declared routes cannot disable the OpenAI "developer" system-prompt role — reasoning requests 400 on gateways that only accept "system" (e.g. Alibaba Cloud Model Studio / 阿里云百炼) #2587

---

社区插件，不是 DeepSeek 官方包，也未获 DeepSeek 背书。

OpenAI 兼容网关（百炼、DashScope compatible-mode、vLLM、自建代理）常见两类失败：流式 tool-call 空 id/name 变成 unknown tool ""；推理请求带 developer / max_completion_tokens 被 400。

这个 bundle：消毒 llm/stream、把那两种 400 写进官方 llm-pi-ai compat 并重试一次、还可以自己挂默认 system+max_tokens 的 Chat Completions 路由。

推荐安装：

dsh plugin --profile web add dsh-llm-gateway-compat

请自行 review 源码后再安装。

[ylwl1997]

Pinning empty streamed id / name so they cannot clobber a real tool identity is the right local fix for the Bailian / new-api unknown tool "" class (#3767 / #1500), and retrying those two 400s into llm-pi-ai compat is a much smaller hammer than swapping the whole adapter.

dsh plugin --profile web add dsh-llm-gateway-compat

then restart dsh web. Review the package first — it wraps llm/stream.

If you want it on the install-test catalog: https://github.com/ylwl1997/dshbase/issues/new?template=plugin-submission.yml

Current listings: https://dshbase.com/plugins/directory/

[snowshadow]

Thanks — that catalog invitation is the right next step.

Agreed on the smaller hammer: the default install only wraps llm/stream and retries those two 400s into official llm-pi-ai compat. The Chat Completions adapter under providers is optional (extraBody / api-key header / thinking dialects) and must use a route id that does not collide with llm-pi-ai.

Submitting to the install-test catalog now.

谢谢。默认安装只做 llm/stream 消毒和那两种 400 的 compat 重试；独立 Chat Completions adapter 是可选项。正在按模板提交到 dshbase 目录。

[snowshadow]

Catalog submission: ylwl1997/dshbase#73

目录收录申请已提交。

[snowshadow]

Listed as verified on dshbase:

• EN: https://dshbase.com/plugins/dsh-llm-gateway-compat/
• 中文: https://dshbase.com/zh/plugins/dsh-llm-gateway-compat/

Thank you.

已收录并标记 verified，谢谢。