Skip to content

Sonderr v1.6.1 — the model picker fix

Choose a tag to compare

@dxn111 dxn111 released this 11 Oct 07:37
· 6 commits to main since this release

The model picker fix

What happened: Sonderr's model discovery listed every catalog entry as a chat model — including safety classifiers and guard models. If you picked one (for example a Nemotron Content Safety model), every message looked unanswered: the classifier did its job and replied with its verdict — e.g. User Safety: safe — which rendered as the whole assistant message.

The fix: model discovery now filters non-chat models out of the chat picker:

  • Safety and guard classifiers (Llama Guard, Qwen3Guard, ShieldGemma, Nemotron Content Safety, Aegis)
  • Moderation, toxicity, and sentiment models
  • Embedders, rerankers, and classic encoders (BERT, CLIP)
  • Speech models (Whisper, TTS, STT) and image-generation models (DALL-E, Stable Diffusion, Flux)

Chat-tuned models stay — including chat Nemotron instruct variants. The filter is a deterministic id-based heuristic (isChatModel in server/provider.js), exported for reuse and covered by a dedicated test suite.

Updating: existing 1.6.0 installs can use the in-app one-click updater (npm package name and entrypoint unchanged), or pull the tag directly. Full v1.6 notes live in the in-app Release Center at /update and in the v1.6.0 release.