v1.6.beta5
Pre-release
Pre-release
What's Changed
- Use uv in ci by @podkidyshev in #835
- Bump tornado from 6.5.4 to 6.5.5 by @dependabot[bot] in #833
- Add SGLang workload by @amaslenn in #834
- Merge common part of vLLM and SGLang by @amaslenn in #836
- NIXL update: filepath and device_list by @podkidyshev in #829
- Agents caching by @podkidyshev in #837
- Add support for x2 nodes serving for vLLM and SGLang by @amaslenn in #839
Full Changelog: v1.6.beta4...v1.6.beta5