Skip to content

Native kernel variants v1

Choose a tag to compare

@iamwavecut iamwavecut released this 13 Jul 23:41

Prebuilt orbitquant_packed_matmul variant wheels consumed by the OrbitQuant runtime provisioner (orbitquant.kernels.provision, orbitquant >= 0.6.0).

The runtime derives the variant name for the current process (torch minor + CUDA version for CUDA, the torch stable ABI for CPU, plus OS/architecture), looks it up in manifest.json, downloads the wheel, verifies its sha256, and caches it under ~/.cache/orbitquant/kernels. The wheels are also directly pip-installable.

Do not delete individual assets: the runtime resolves them through manifest.json. Assets are refreshed by the build-kernels.yml workflow.