What's Changed
- cherry-pick: #4129 and #4162 by @jimmyzho in #4245
- revert: #3975 and #4129 (mamba checkpointing ssu 2-split + doc) by @jimmyzho in #4246
- cherry-pick: #4185 (for issue 4090) by @jimmyzho in #4247
- cherry-pick: #4152 ([perf] Optimize TRT-LLM routing for high-expert, high-top-k workloads) by @jimmyzho in #4251
- test: skip NVFP4-KV decode tests on SM107 by @Vinnie6167 in #4257
- artifacts: add DEEPGEMM_RUBIN artifact path and checksum by @jimmyzho in #4258
- deep_gemm: arch-based split for DEEPGEMM_RUBIN cubins by @jimmyzho in #4261
- cherry-pick: #4180 ([feat] Add SITU trtllmgen MOE) + conflict resolution by @jimmyzho in #4252
- chore: bump version to 0.6.16rc5 by @jimmyzho in #4264
Full Changelog: v0.6.16rc4...v0.6.16rc5
Contributors
Vinnie6167 and jimmyzho