Skip to content

feat(moss): add SGLang AutoModel backend - #3579

Merged
LauraGPT merged 1 commit into
mainfrom
codex/moss-sglang-backend
Aug 30, 2026
Merged

feat(moss): add SGLang AutoModel backend#3579
LauraGPT merged 1 commit into
mainfrom
codex/moss-sglang-backend

Conversation

@LauraGPT

@LauraGPT LauraGPT commented Aug 30, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add backend="sglang" for the third-party OpenMOSS MOSS-Transcribe-Diarize model through the OpenAI-compatible transcription endpoint
  • request verbose_json with max_new_tokens and normalize validated speaker segments into FunASR text, raw_text, timestamp, and sentence_info
  • reject malformed labels, decreasing start times, and SGLang fallback S01 labels that are not backed by the raw model transcript
  • preserve legal overlapping speech and SGLang timestamp clamping
  • update bilingual guides, four deployment matrices, and the product deployment registry with the exact SGLang source pin

The model and weights remain published and maintained by OpenMOSS under Apache-2.0. FunASR provides only the ecosystem adapter and deployment contract. External vad_model and spk_model remain intentionally unsupported for this end-to-end model.

Validation

  • exact signed+DCO head: 783c24a
  • 40 model, documentation, and product-registry tests passed
  • MOSS product-page render test passed
  • Black, JSON validation, compileall, and git diff check passed
  • independent review found no remaining Critical or Important issues

Runtime evidence boundary

No live SGLang worker was claimed in this change. The available H100 host has a CUDA 12.8 driver while the pinned current SGLang Omni path requires CUDA 13. The adapter is contract-tested against the exact public API/source behavior at SGLang Omni 3f819f9cdae3d4eeec22f73306c9067a1ec2542e. The published #914 H100 benchmark remains upstream runtime evidence only, not a FunASR adapter benchmark.

Signed-off-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
@LauraGPT
LauraGPT force-pushed the codex/moss-sglang-backend branch from 81e0c14 to 783c24a Compare August 30, 2026 15:22
@LauraGPT

Copy link
Copy Markdown
Collaborator Author

CI follow-up: the first contract run failed only its Black check. I reproduced the exact formatter locally with Black 25.1.0, confirmed the diff was two mechanical line wraps, amended the signed+DCO commit, and reran Black plus all 40 focused tests and the product-page render test before pushing exact head 783c24a.

@LauraGPT
LauraGPT merged commit d5a8db7 into main Aug 30, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant