Skip to content

v1.3.0

Choose a tag to compare

@automatosx automatosx released this 06 Aug 21:57
· 44 commits to main since this release

AXQuant v1.3.0

AXQuant 1.3.0 strengthens evidence-led post-training quantization on Apple Silicon. It adds
measured interaction and kernel-latency signals to planning, formalizes MTP A/B admissibility,
and keeps all new performance choices fail-closed when the required evidence is absent.

Highlights

  • Measured interaction selection. refine-select --interaction uses development-role
    measurements only and rejects formal-holdout or incomplete dataset provenance.
  • Kernel-latency-aware planning. benchmark-kernels records host-scoped decode/prefill
    latency, while plan --latency-table uses it only to break quality near-ties. Plans without a
    table retain their prior deterministic behavior.
  • Formal MTP evidence. MTP on/off comparisons must bind the same frozen host, controls,
    datasets, seeds, checkpoint, and zero-fallback execution before they can authorize a claim.
  • Opt-in quantized Qwen 3.6 MTP sidecar. quantize-mtp-sidecar preserves the existing
    byte-preserved default and requires a recorded passing AX Engine capability check before it can
    emit the portable-affine sidecar.
  • Measured KV serving-quality reports. The new report binds an exact executed per-layer KV
    plan to short- and long-context retention against BF16 KV.

Safety and compatibility

  • Experimental 2/3-bit assignments are limited to robust MLP/expert projections; attention and
    protected roles retain 4-bit-or-higher candidates.
  • Converted-checkpoint verification now accepts only documented MLX output identity transforms
    and remains fail-closed on membership, precision, parameter-count, metadata, or shape drift.
  • Qwen3-ASR and Qwen3-VL paths have stricter normalization, backend, and media-generation smoke
    checks.
  • Existing serialized plans preserve their recorded hardware-profile semantics. Re-plan to opt
    into the new ax-engine-apple-silicon-affine-dwq-v3 defaults and gptq-act method.

Installation

Download the wheel below and install it with:

python -m pip install axquant-1.3.0-py3-none-any.whl

Or install the immutable tag directly:

python -m pip install "axquant @ git+https://github.com/defai-digital/axquant.git@v1.3.0"

Verification

Download SHA256SUMS.txt alongside the wheel or sdist and verify it with:

shasum -a 256 -c SHA256SUMS.txt

The tag points to commit d35b19453f9077e00d0654f2e22de8a257b696fa.

Availability

PyPI publishing remains intentionally gated until the project’s Trusted Publisher is configured.
The release assets below are the canonical v1.3.0 distributions.

For the complete change list, see CHANGELOG.md.