Skip to content

v1.1.1

Choose a tag to compare

View all tags
@jhchouuu jhchouuu released this 24 Apr 08:12
· 380 commits to main since this release
v1.1.1
b8af93f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Highlights

  • Profiler Support — New profiler integration for EP intranode dispatch/combine with JIT kernel support and proper packaging
  • EP Auto-Tuning — New tuning config system that stores benchmark-derived optimal launch parameters (block_num, warp_per_block, etc.) in JSON files, auto-loaded at runtime based on GPU arch, EP size, token count, and hidden dim. Enable with MORI_EP_LAUNCH_CONFIG_MODE=AUTO, with fallback to hardcoded defaults
  • AINIC Environment Auto-Detection Tool — Two new scripts for AINIC (ionic) NIC setup and validation:
    • env_check.sh — 6-step validation (firmware, QoS/DSCP/PFC, DCQCN, intra/inter-node BW & latency). Usage: ./tools/env_check.sh [peer_ip] (omit peer_ip for intra-node checks only)
    • env_setup.sh — configures DCQCN and exports MORI_RDMA_SL/MORI_RDMA_TC. Usage: source tools/env_setup.sh [mori|dcqcn|all]
  • SGLang EPLB Support — New call_local_expert_count API for SGLang Expert-Parallel Load Balancing, exposing per-rank local expert counts via op.local_expert_count

What's Changed

EP (Expert Parallelism)

  • Add profiler support to intranode dispatch/combine (#285)
  • Add tuning config system for dispatch/combine (#242)
  • Add sgl EPLB support (#254)
  • Fix EP index overflow (#260)

IO / RDMA

  • Improve RDMA flush diagnostics and log hygiene (#277)
  • Disable auto XGMI backend for cross-process IPC transfers (#267)
  • Avoid QPN collisions in multi-NIC setups (#261)

Shmem

  • Add FlyDSL integration for mori shmem device API (#280)

Profiler

  • Fix profile mode detection and doc corrections (#281)
  • Fix profile mode for JIT kernel (#265)
  • Enable JAX gfx950 CI tests and wrap profiler macros (#282)
  • Include tools/profiler in JIT sources (#270)

UMBP

  • Release GIL for all UMBPClient methods to fix distributed-mode scheduler starvation (#262)

Packaging & Build

  • Only pull SPDK submodule when BUILD_UMBP=ON (#283)

Tools

  • Auto detect ionic env problem for AINIC platforms (#278)

CI & Benchmark

  • Add MI355X-AINIC platform with podman, fix build for non-mlx5 NICs (#263)
  • Add MI300X_BNXT platform with Thor2 NIC support (#291)
  • Switch intranode tests to MI355X-AINIC-TW (#288)
  • Add shmem benchmark tests (#272, #290)

Doc

  • Update arch image & add UMBP description (#287)
Assets 4
Loading