feat(moss): add SGLang AutoModel backend - #3579
Merged
Merged
Conversation
Signed-off-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
LauraGPT
force-pushed
the
codex/moss-sglang-backend
branch
from
August 30, 2026 15:22
81e0c14 to
783c24a
Compare
Collaborator
Author
|
CI follow-up: the first contract run failed only its Black check. I reproduced the exact formatter locally with Black 25.1.0, confirmed the diff was two mechanical line wraps, amended the signed+DCO commit, and reran Black plus all 40 focused tests and the product-page render test before pushing exact head 783c24a. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The model and weights remain published and maintained by OpenMOSS under Apache-2.0. FunASR provides only the ecosystem adapter and deployment contract. External vad_model and spk_model remain intentionally unsupported for this end-to-end model.
Validation
Runtime evidence boundary
No live SGLang worker was claimed in this change. The available H100 host has a CUDA 12.8 driver while the pinned current SGLang Omni path requires CUDA 13. The adapter is contract-tested against the exact public API/source behavior at SGLang Omni 3f819f9cdae3d4eeec22f73306c9067a1ec2542e. The published #914 H100 benchmark remains upstream runtime evidence only, not a FunASR adapter benchmark.