Skip to content

Releases: faresobeid/vllm

hisparse-c6f2044

Choose a tag to compare

@faresobeid faresobeid released this 08 Jul 19:07
fix(hisparse): mixed-batch row-split, DP-pad clamp, deterministic pin…

hisparse-3be36fb

Choose a tag to compare

@faresobeid faresobeid released this 06 Jul 23:35
feat(attention): HiSparse host-resident sparse-MLA decode for GLM-5/D…

HiSparse wheel @ 69859af (cu129, torch 2.9, cp312)

Choose a tag to compare

@faresobeid faresobeid released this 05 Jul 18:30

vLLM 0.24.1.dev0 + HiSparse @ 69859af. Changes vs hisparse-415211c: host-resident-only (mirror mode + validity bitmap deleted), warm_start removed after dead-even A/B, host_to_device_ratio removed (host_pool_gib now REQUIRED in hisparse_config). PD-smoke 8/8 token parity at this head.

hisparse-6771d19

Choose a tag to compare

@faresobeid faresobeid released this 06 Jul 05:48
feat(attention): HiSparse host-resident sparse-MLA decode for GLM-5/D…

HiSparse wheel 0.24.1.dev0+hisparse.9bb4bea.cu129

Choose a tag to compare

@faresobeid faresobeid released this 03 Jul 16:12

vLLM 0.24-based HiSparse wheel for GLM-5.x PD decode instances (sm90a, cp312, CUDA 12.9 toolchain / torch cu128-compatible). Built from feat/hisparse-mla-decode @ 9bb4bea — host-resident sparse-MLA decode hot-buffering with plan-once index sharing and overlapped prefetch (default on). See vllm-project#46326 for the full PR and measured results.

HiSparse decode wheel (415211c, cu129, sm90a)

Choose a tag to compare

@faresobeid faresobeid released this 04 Jul 01:07
hisparse-415211c

fix(hisparse): skip the one-request host check under num_gpu_blocks_o…