Skip to content

feat(xpu): support vllm_kunlun backend - #10027

Merged
tastelikefeet merged 1 commit into
modelscope:mainfrom
loveleaves:support-vllm-kunlun
Sep 3, 2026
Merged

feat(xpu): support vllm_kunlun backend#10027
tastelikefeet merged 1 commit into
modelscope:mainfrom
loveleaves:support-vllm-kunlun

Conversation

@loveleaves

Copy link
Copy Markdown
Contributor

PR type

  • Bug Fix
  • New Feature
  • Document Updates
  • More Models or Datasets Support

PR information

Add support for the vllm_kunlun plugin (Kunlunxin XPU backend for vLLM), following the existing vllm_ascend / vllm_metax pattern:

  • swift/utils/import_utils.py: add is_vllm_kunlun_available().
  • swift/utils/__init__.py: export it (both TYPE_CHECKING and lazy import map).
  • swift/pipelines/infer/rollout.py and swift/rlhf_trainers/vllm_client.py: when vllm_kunlun is installed, use PyKunlunCommunicator as PyNcclCommunicator for weight-sync communication.

No behavior change on other backends: the new import path is only taken when vllm_kunlun is importable.

Experiment results

N/A (import-level device backend adaptation).

@loveleaves loveleaves changed the title support vllm_kunlun backend feat(xpu): support vllm_kunlun backend Sep 2, 2026
@tastelikefeet

Copy link
Copy Markdown
Collaborator

Hi, 问下是 kunlun 的官方同学吗?是否方便支持 dockerfile 呢:
https://github.com/modelscope/modelscope/tree/master/docker
这样更方便开发者使用

@tastelikefeet
tastelikefeet merged commit f7994e9 into modelscope:main Sep 3, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants