First standalone TurboQuant release extracted and matured beyond the original
GoSX implementation.
Highlights:
- Hadamard rotation is the default fast path for MSE and IP quantizers.
- Zero-allocation caller-owned APIs for hot quantize, dequantize, and prepared
query scoring paths. - SIMD-accelerated CPU kernels for dot products and grouped QJL projection.
- Portable serialization and stricter public API validation.
- Experimental WebGPU scorer for
js/wasmand native CUDA scorer behind
-tags cuda. - KV cache page APIs, checkpointable session primitives, and the first native
OpenAI-compatibletqserveruntime surface. - GoSX is expected to pin
github.com/odvcencio/turboquant v0.1.0and can
keep a localreplaceduring active co-development until the tag is pushed.