Skip to content

feat(KERNEL-QUANT-CIQ-GEMM-ROCM): land the W1 keep-quant providers on kROCM #2781

Description

@ghazni101

Row: GFX1100-TG200

Lands the ROCm keep-quant GEMM infrastructure: the kROCM provider for OpId::kMatmulBTQuant and OpId::kMatmulBTQuantGrouped. The provider does the dequant-in-kernel dot product on-device, keeping the weight in its block-quantized form through the GEMM rather than expanding to bf16 at load time.

VT_GGUF_KEEP_QUANT=0 restores load-time expansion. Gates on gfx1100 / ROCm 7.14.0: test_rocm_quant_dot 132,094 assertions green across all ten encodings (decode through prefill shapes, broadcast and per-row grouped arms over a poisoned output buffer).

This is the foundation PR for the GFX1100-TG200 decode campaign. Most lever PRs depend on the keep-quant GEMM infrastructure it introduces.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions