v0.11.2a0
Pre-release
Pre-release
What's Changed
- fix(optimum): drop memory_budget from pooling/encoder compile config by @rebel-thkim in #825
- fix(spec-decode): enable DeepSeek MTP under device tensor by @rebel-eunik in #821
- feature: change default value of VLLM_RBLN_USE_DEVICE_TENSOR to true by @rebel-eunji in #820
Full Changelog: v0.11.2.dev0...v0.11.2a0