Skip to content

AITER v0.1.16.post3

Latest

Choose a tag to compare

@sunway513 sunway513 released this 26 Jun 17:18

AITER v0.1.16.post3

Post-release on top of v0.1.16.post2. Adds the aiter Triton unified-attention fp16 fix needed for the vLLM AITER upgrade.

ABI: all wheels built with pytorch/manylinux2_28-builder (AlmaLinux 8 + devtoolset, glibc 2.28) and pass the auditwheel symbol-floor gate, so they load in Ubuntu 22 / vLLM ROCm containers.

post2 → post3 delta (this release)

  • remove kv cache assert for old arch for upstream compatibility (#3943) — Triton unified-attention fix that unblocks the fp16 kv cache path for upstream (vLLM) compatibility. Touches aiter/ops/triton/attention/unified_attention.py only.

Wheels

manylinux 2.28, gfx942;gfx950, Python 3.10 + 3.12, ROCm 7.0 / 7.1 / 7.2 (6 wheels).