Releases: faresobeid/vllm
Releases · faresobeid/vllm
Release list
hisparse-c6f2044
fix(hisparse): mixed-batch row-split, DP-pad clamp, deterministic pin…
hisparse-3be36fb
feat(attention): HiSparse host-resident sparse-MLA decode for GLM-5/D…
HiSparse wheel @ 69859af (cu129, torch 2.9, cp312)
vLLM 0.24.1.dev0 + HiSparse @ 69859af. Changes vs hisparse-415211c: host-resident-only (mirror mode + validity bitmap deleted), warm_start removed after dead-even A/B, host_to_device_ratio removed (host_pool_gib now REQUIRED in hisparse_config). PD-smoke 8/8 token parity at this head.
hisparse-6771d19
feat(attention): HiSparse host-resident sparse-MLA decode for GLM-5/D…
HiSparse wheel 0.24.1.dev0+hisparse.9bb4bea.cu129
vLLM 0.24-based HiSparse wheel for GLM-5.x PD decode instances (sm90a, cp312, CUDA 12.9 toolchain / torch cu128-compatible). Built from feat/hisparse-mla-decode @ 9bb4bea — host-resident sparse-MLA decode hot-buffering with plan-once index sharing and overlapped prefetch (default on). See vllm-project#46326 for the full PR and measured results.
HiSparse decode wheel (415211c, cu129, sm90a)
hisparse-415211c fix(hisparse): skip the one-request host check under num_gpu_blocks_o…