Skip to content

v0.3.0

Choose a tag to compare

@jiejingzhangamd jiejingzhangamd released this 11 Sep 23:52
079efc7

What's Changed

  • fix: unblock long-context requests in the rust router, and kvd bug by @xiaobochen-amd in #120
  • feat(server): resize pools over the admin API, and two things it needed to work by @weilei0120 in #122
  • feat(router): continue a streaming generation on another worker when its own goes away by @weilei0120 in #119
  • remove brust-qos to accommodate slurm changes in Crusoe by @limou102 in #125
  • feat(agent_sys): add env_mgr layered environment manager by @dorado269 in #123
  • fix(router): decode nats kv events with the per-worker decoder by @weilei0120 in #126
  • fix for crusoe: fall back across SLURM account quotas by @limou102 in #127
  • enable merge queue by @limou102 in #129
  • Revert "enable merge queue (#129)" by @limou102 in #131
  • fix ci nodeprobe by @limou102 in #135
  • feat(agent_sys): task_graph — task-management substrate for the agent loop by @dorado269 in #124
  • feat(glm5.2-fp8-gfx942): all four operator combos, the agentic benchmark, and a driver-matched image base by @llying-001 in #136
  • router/engine: close the kv-aware chain-anchor loop and support hybrid SSM decode legs by @weilei0120 in #133
  • SLA-based planner by @limou102 in #139
  • ci: fix the SLURM account fallback that never fell back by @limou102 in #146
  • feat(tests): expand and harden gfx942 E2E coverage by @llying-001 in #141
  • ci: cap SLURM scheduling retries by @limou102 in #153
  • router: seven silent kv-aware fallbacks, a parity harness that finds the eighth, and the GLM-5.3-Flash engine recipe by @weilei0120 in #143
  • ci: attach Spur E2E steps to holders by @limou102 in #159
  • feat(image): upgrade gfx950 SGLang image to v0.5.18 by @llying-001 in #152
  • Recover PD engine crashes and NATS JetStream filestore failures by @weilei0120 in #162
  • feat(projection): add InferaSim, a workload-driven serving simulator and projector- #137 by @araina-amd in #138
  • Fix flaky e2e-mixed (vllm) GLM-5.1-FP8, and unblock CI lint by @limou102 in #165
  • GLM-5.3 (glm_moe_dsa): mixed, 1P1D, and a Kubernetes recipe — plus overlay support for SGLang bases by @dorado269 in #163

New Contributors

Full Changelog: v0.2.10...v0.3.0