Skip to content

Releases: namgyu-youn/onnxruntime

Release list

Benchmark artifacts for onnxruntime#28352 (ONNX Attention vs GQA decode)

Benchmark artifacts for onnxruntime#28352 (ONNX Attention vs GQA decode) Latest
Latest

Choose a tag to compare

View all tags
@namgyu-youn namgyu-youn released this 13 Jul 10:49
bench-28352-artifacts
361184e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Raw measurement artifacts for the decode benchmark recipe in microsoft#28352 (script: microsoft#29684). RTX PRO 6000 (SM120), driver 580.95.05, ORT nightly 1.29.0.dev20260708001 (2cd570577f), 2026-07-13.

Download attn_vs_gqa_results_*.tar.gz below (the Source code links are auto-generated by GitHub and unrelated). Contents:

  • sweep*.csv (5): decode-latency sweeps — main fp16/bf16 (sweep.csv), fp16 repeat run (sweep_repeat.csv), attention-only, 4D-cache, and snug-buffer variants
  • *.log (13): environment/provenance, sanity (cross-arm output parity + GQA backend debug info), and per-run sweep/profile logs
  • nsys_*.nsys-rep + .sqlite (8 each): Nsight Systems captures per arm at S_past=2048 fp16, plus buffer-size/layout follow-ups
  • kernels_*.txt (5): per-kernel GPU-time attribution tables parsed from the captures
Assets 3
Loading