Skip to content

ONNX Runtime WebGPU Plugin EP v0.2.1

Choose a tag to compare

View all tags
@edgchen1 edgchen1 released this 30 Jul 01:36
plugin-ep-webgpu/v0.2.1
7f4a15b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Highlights

  • Major performance work for attention-heavy LLMs.

    • FlashAttention decode kernels were fused and extended for any sequence length (#28389).
    • FlashAttention prefill shared-memory path was generalized (#28520).
    • Dynamic max_k_step was enabled for NVIDIA (#28511).
    • QKV bias support was added for FlashAttention in MultiHeadAttention (#28380).
    • M4 Max-specific FlashAttention optimization landed (#27780).

  • Qwen3 and Gemma 4 model-path improvements.

    • QKV and MLP fusions for Qwen3-style models (#28280).
    • Q/K RMSNorm fusion into GroupQueryAttention for Qwen3-style models (#28484).
    • Opset 24 and KV-shared decoder layer support for Gemma 4 (#28501).
    • GroupQueryAttention now supports optional present-key/value outputs (#28242).

  • LinearAttention and quantized-path optimizations.

    • LinearAttention subgroup optimizations and larger tile_v with subgroup support (#28412, #28519).
    • GatherBlockQuantized gained 2-bit support (#28530).

  • Reliability and hardening fixes.

    • Fixes for out-of-bounds read risks in GatherBlockQuantized and Pad (#28718, #28721).
    • Fix for past_state == present_state buffer handling (#28753).
    • Fixes in QMoE numerical stability and SkipSimplifiedLayerNormalization bias behavior (#28434, #28427).
    • ConvTranspose weight shape validation improvement (#28524).

  • Graph-capture and buffer-management improvements.

    • Per-graph buffer manager and session-level buffer pool updates for graph capture reuse (#28260, #28761).

Note: This section was AI-generated. It may have inaccuracies.

Contributors

Thanks to everyone who contributed to the WebGPU EP (human contributors, alphabetical):

@apsonawane, @daijh, @edgchen1, @feich-ms, @GopalakrishnanN, @guschmue, @hariharans29, @HectorSVC, @jchen10, @qjia7, @tianleiwu, @xiaofeihan1, @xenova, @yuslepukhin.

Note: This list was compiled on a best-effort basis from PRs that touched WebGPU EP-specific paths and
intentionally includes human contributors only, so it may not capture every contribution. If yours was
missed, the omission is unintentional. Your work is no less appreciated.

Assets 2
Loading