Skip to content

OrbitQuant 0.3.1

Choose a tag to compare

View all tags
@iamwavecut iamwavecut released this 10 Jul 23:19
v0.3.1
97dbe29

OrbitQuant 0.3.1 improves packed Metal/MPS inference while preserving the compact weight path.

  • Aligned FP16/BF16 projections with two or more rows use the padded SIMD-group MMA path; one-row projections retain the faster packed matvec
  • Full 4096-coordinate RPBH activation blocks use a measured 512-thread Metal path
  • Optimized execution continues to consume packed low-bit weights without materializing a complete FP16/BF16 matrix
  • Metal operator and activation benchmarks are documented in docs/kernel-audit.md and the kernel card
  • The FLUX.2 Klein 9B BF16/SDNQ/OrbitQuant comparison matrix now covers all ten stress prompts

The Python package is available from PyPI as orbitquant==0.3.1. The standalone native kernel remains a local ABI3 build; Kernel Hub publication is outside this release.

Assets 2
Loading