Skip to content

[Feature] support Qwen3 Embedding and Reranker #3679

Open
@mj520

Description

@mj520

Motivation

lmdeploy serve api_server /root/Qwen3-Embedding--model-name Qwen3-Embedding
run Qwen3 Embedding and Reranker ok

nomic-embed-text is not explicitly supported by lmdeploy.

Related resources

/v1/embeddings
{
"message": "Unsupported by turbomind.",
"type": "invalid_request_error",
"code": 400,
"param": null,
"object": "error"
}

Additional context

/v1/rerank Not Found

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions