This repository was archived by the owner on Mar 13, 2025. It is now read-only.

Repository navigation

v0.1.0

Yard1 released this 03 Jul 21:31

· 201 commits to master since this release

bbfe3c5

What's Changed

Ray Serve-native continuous batching support through Hugging Face text-generation-inference models
Fixed exceptions when frontend is deployed with non-default port

Note: This update breaks existing APIs and requires changes to model config YAMLs

Full Changelog: v0.0.3...v0.1.0

Assets 2