Skip to content

vllm-plugin-FL v0.3.0

Latest

Choose a tag to compare

@wbavon wbavon released this 28 Sep 09:23
f105277

vllm-plugin-FL v0.3.0

Part of FlagOS 2.2.

Compatibility line: vLLM 0.24.0.

Changes since v0.2.0 (FlagOS 2.1).

64 pull requests and 0 additional commits.

Source: v0.3.0, commit f1052770d3ff.

New Features

  • Add weak_ref_tensor C++ extension build system with CMake (#231) by @creaspoggg
  • feat(metax): adapt MetaX C550 backend for vLLM 0.20.2 (#241) by @physics31415926
  • feat: upgrade flagcx connector for support vllm0.20-0.24(cherry-pick from main branch) (#295) by @leoda1
  • feat(quantization): adapt W8A8 inference to vLLM 0.24 (#336) by @rdzhu225
  • feat(compilation): add BreakableCUDAGraphWrapper support for OOT vendor backends (vLLM 0.24.0+) (#342) by @physics31415926
  • feat(vllm-0.24): add Qwen3.5 text-only runtime compatibility (#383) by @CherryLemon
  • feat(ascend): port E2E-verified ascend support from 0.20.2 to v0.3.0-dev (vllm 0.24.0) (#387) by @tengqm
  • feat(sunrise): port attention backend to vLLM 0.24.0 (CUSTOM registration + ptpu memory_stats shim) (#391) by @tengqm
  • feat(kunlunxin): port Kunlunxin vendor backend to vLLM 0.24.0 (#401) by @tengqm
  • feat(flagcx connector): Prometheus KV-transfer metrics + port #315 from release/0.2 (#418) by @leoda1
  • feat: support custom throughput test cases (#426) by @cyber-pioneer
  • feat(cambricon): port MLU590 + neuware4.4.3 compat to main (#431) by @tengqm
  • feat(enflame): port GCU300 enablement bundle to main (#432) by @tengqm
  • feat(dispatch): support appending FlagGems blacklist entries (#439) by @CherryLemon
  • add vllm-plugin-fl for txda based on empty vllm==0.24.0. (#447) by @tsingmicro-public-e
  • feat(tsingmicro): enable vllm 0.24.0 on txda (complement #447) (#460) by @tengqm

Performance

  • perf(nvidia): add opt-in Hopper long-context routing (#384) by @CherryLemon
  • perf(vllm-0.24): batch MTP xGrammar masks (#414) by @ceci3

Hardware Support

Improvements

Documentation

CI/Infrastructure

  • Migrate CI related code from release/0.2 to main (#415) by @xmhubj
  • Enable Hygon workflow for vLLM 0.24.0 (#436) by @xmhubj
  • ci: add /rerun-failed-ci and /cancel-ci PR comment commands (#480) by @lentil1016

Bug Fixes

Other

Contributors

Thanks to the contributors to the pull requests included in this release.