Skip to content

OrbitQuant 0.3.0

Choose a tag to compare

View all tags
@iamwavecut iamwavecut released this 10 Jul 22:03
v0.3.0
54ee5fd

OrbitQuant 0.3.0 adds the optimized packed W4A4 CUDA runtime.

  • Native CUDA token norm, RPBH/FWHT, and activation codebook assignment
  • Bounded packed-W4 decode with CUTLASS INT8 tensor-core matmul and fused epilogue
  • Direct packed A4/W4 CUDA MMA fallback with SM89 tile selection
  • No full BF16/FP16 weight materialization in the optimized path
  • Verified RTX 4090, L40S, and Metal/MPS package paths
  • Explicit dequant_bf16 exact-centroid reference mode remains available

See docs/kernel-audit.md for measured scope, local ABI3 build instructions, and claim boundaries.

Assets 2
Loading