Skip to content

1.0.0

Pre-release
Pre-release

Choose a tag to compare

@helloxz helloxz released this 12 Mar 06:16
· 2 commits to main since this release

Support load balancing for multiple large model interfaces
Provide a unified API interface
Compatible with OpenAI
Support streaming transmission
Support IP affinity algorithm