Repository navigation
v0.3.0
What's Changed
- fix: unblock long-context requests in the rust router, and kvd bug by @xiaobochen-amd in #120
- feat(server): resize pools over the admin API, and two things it needed to work by @weilei0120 in #122
- feat(router): continue a streaming generation on another worker when its own goes away by @weilei0120 in #119
- remove brust-qos to accommodate slurm changes in Crusoe by @limou102 in #125
- feat(agent_sys): add env_mgr layered environment manager by @dorado269 in #123
- fix(router): decode nats kv events with the per-worker decoder by @weilei0120 in #126
- fix for crusoe: fall back across SLURM account quotas by @limou102 in #127
- enable merge queue by @limou102 in #129
- Revert "enable merge queue (#129)" by @limou102 in #131
- fix ci nodeprobe by @limou102 in #135
- feat(agent_sys): task_graph — task-management substrate for the agent loop by @dorado269 in #124
- feat(glm5.2-fp8-gfx942): all four operator combos, the agentic benchmark, and a driver-matched image base by @llying-001 in #136
- router/engine: close the kv-aware chain-anchor loop and support hybrid SSM decode legs by @weilei0120 in #133
- SLA-based planner by @limou102 in #139
- ci: fix the SLURM account fallback that never fell back by @limou102 in #146
- feat(tests): expand and harden gfx942 E2E coverage by @llying-001 in #141
- ci: cap SLURM scheduling retries by @limou102 in #153
- router: seven silent kv-aware fallbacks, a parity harness that finds the eighth, and the GLM-5.3-Flash engine recipe by @weilei0120 in #143
- ci: attach Spur E2E steps to holders by @limou102 in #159
- feat(image): upgrade gfx950 SGLang image to v0.5.18 by @llying-001 in #152
- Recover PD engine crashes and NATS JetStream filestore failures by @weilei0120 in #162
- feat(projection): add InferaSim, a workload-driven serving simulator and projector- #137 by @araina-amd in #138
- Fix flaky
e2e-mixed (vllm)GLM-5.1-FP8, and unblock CI lint by @limou102 in #165 - GLM-5.3 (glm_moe_dsa): mixed, 1P1D, and a Kubernetes recipe — plus overlay support for SGLang bases by @dorado269 in #163
New Contributors
- @araina-amd made their first contribution in #138
Full Changelog: v0.2.10...v0.3.0