v4.0.0
What's Changed
- Track streaming and non-streaming latency as separate EWMAs by @dannyboland in https://github.com/dannyboland/llmrouter/pull/30
Full Changelog: https://github.com/dannyboland/llmrouter/compare/v3.5.0...v4.0.0
Full Changelog: https://github.com/dannyboland/llmrouter/compare/v3.5.0...v4.0.0