Skip to content

MoRI v1.2.1

Latest
Latest

Choose a tag to compare

View all tags
@jhchouuu jhchouuu released this 26 Jun 05:37
v1.2.1
e31d426
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

MoRI v1.2.1

Maintenance and feature release on top of v1.2.0, with cached routing replay for training, EP/UMBP/IO performance work, broader hardware/topology robustness, rocm7.14 compatibility support and a number of RDMA correctness fixes.

Features

  • feat(ep): add AccumNum=9 vec8 intranode combine for shared-expert fusion (#396)
  • feat(umbp): pluggable master eviction strategy (#399)
  • feat(ep): optimize warp id allocation under dispatch LL kernel (#408)
  • feat(umbp): improve BatchRoutePut placement with select-algo and node-affinity knobs (#382)
  • feat(io): add rail affinity for RDMA endpoint connection (#370)
  • feat(rdma): load libibverbs at runtime via dlopen instead of linking (#373)
  • feat(ep): add cached routing replay for training dispatch/combine (#335)

Performance

  • perf(umbp): optimize PoolClient BatchPut/BatchGet (#403)
  • perf(umbp): DRAM parallel copy (#392)
  • feat(io/rdma): reuse thread-local scratch buffers on batch hot path (#389)

Bug Fixes

  • fix(io): RDMA QP load imbalance (#420)
  • fix(io): RDMA chunking for oversized multi-SGE WRs (#409)
  • fix(shmem): public RDMA quiet returned before the caller's WQEs completed (#404)
  • fix(jit): reuse the already-loaded libamdhip64 to avoid HIP 709 on framework streams (#402)
  • fix: detect same physical node by MORI_NODE_ID/boot_id, with hostname fallback (#387)
  • fix(topo): recognize VGA (0x0300) and 3D (0x0302) PCI classes as GPU (#381)
  • fix(topology): avoid infinite loop on PCI bridge with subordinate bus 0xff (#378)
  • fix(umbp): qp-per-transfer default value & add logs (#384)
  • fix: mori bug on ROCm 7.1.4 (#414)
  • fix: tool bug when tested in 7.1.4 docker (#418)

Refactor

  • refactor(core,application): include hygiene + host/device separation (#405)
  • refactor(bnxt): collapsed-CQ drain, drop outstandingWqe, fix per-lane PSN (#395)

Tests

  • test(umbp): use kernel-assigned ports in distributed tests to fix shared-CI flakiness (#417)
  • test(umbp): align distributed tests with current API and regroup CMake (#380)
  • test(io): add --target-dev-offset to MORI-IO benchmark (#379)

CI

  • ci: add CodeQL SAST workflow and fix all high-severity findings (#385)

Tools

  • tools: add Broadcom (bnxt) support to env_check.sh and env_setup.sh (#386)

Docs

  • docs: add mori sglang news (#423)

Full changelog: v1.2.0...v1.2.1

Assets 2
Loading