Skip to content

History / FP8 and NVFP4

Revisions

  • Sync wiki with main through 73cda73 Covers merged PRs #3459, #3469, #3479, #3480, #3481: - #3479 auto GPU peer access: new P2P section (env vars, probe diagnostics, benchmark script) in Memory-Offload-and-Multi-GPU - #3480 AVX512 CPU kernels now trainable: Kernel-Backends-Reference, AWQ, Inference-Backends (AUTO prefers trainable CPU kernels) - #3459/#3481 W4A staging: FP8-and-NVFP4 documents per-forward E4M3 operand, NVFP4 layout revalidation, format-2 bookkeeping - #3481 hf_pack_layer zero-point bookkeeping: HuggingFace-Integration, Packing-Formats-and-Compatibility (per-field v1/v2 shifts) - #3469 lazy kernel registry: Developer-Guide

    @Qubitium Qubitium committed Nov 2, 2026
  • Sync wiki with main through 17d4a42 Cover #3463: w4a_triton now imports Gluon lazily so the module loads on any Triton build; the grouped FP8 GEMM requires the Gluon mma_v2 API (first shipped in Triton 3.6.0) and fp8_linear_prepacked raises native_fp8_gemm_error() naming required/installed versions. Pure W4A-NVFP4 packing needs no Gluon; a mixed recipe's FP8 attention lane reports the same floor at run time. Re-pin touched pages' source links to revision 17d4a42.

    @Qubitium Qubitium committed Oct 29, 2026
  • Rename Checkpoint-Formats page to Packing-Formats; add Complementary configs nav group - Checkpoint-Formats-and-Compatibility -> Packing-Formats-and-Compatibility (page file renamed; every inbound link retargeted and retitled). - Sidebar + Home: move Rotations/Smoothing/Norm Tuning and EoRA out of Quantization methods into a new Complementary configs group, with deep links to MSEConfig (mse=) and SmootherConfig in QuantizeConfig-Reference. These configs attach to multiple lifecycles rather than being methods.

    @Qubitium Qubitium committed Oct 29, 2026
  • Rename project references: GPTQModel -> GPT-QModel

    @Qubitium Qubitium committed Oct 28, 2026
  • Sync wiki with main through c1976918

    @Qubitium Qubitium committed Oct 27, 2026
  • Add workflow SVGs and refresh documentation navigation and accuracy

    @Qubitium Qubitium committed Oct 26, 2026
  • Full documentation site: concepts, all quant methods, config reference, lifecycle, backends, internals

    @Qubitium Qubitium committed Oct 26, 2026