Skip to content

v1.0.9.post5

Choose a tag to compare

View all tags
@Andrewxu313 Andrewxu313 released this 29 Apr 06:27
· 250 commits to main since this release
v1.0.9.post5
15677fc

BatchGen v1.0.9.post5

  • Packages GLM-5 DSA Hadamard kernels into batchgen_kernels as AOT extensions to remove the production runtime-JIT failure surface.
  • Bumps batchgen_kernels to 0.3.1.post3 and requires it from BatchGen.
  • Builds the internal H20 batchgen_kernels wheel with explicit sm90a arch selection.
  • Reuses unchanged dependency wheels from v1.0.9.post4.

Validated on two-node H20 GLM-5-FP8 after clearing test conda envs and Torch extension caches: installed post5 wheels in the persistent batchgen env, launched the server, submitted a batch, and confirmed DSA/Hadamard imports came from packaged site-packages .so files with no DSA/Hadamard Torch extension cache entries.

Assets 8
Loading