This repository was archived by the owner on Sep 3, 2025. It is now read-only.
Releases: friendliai/LLMServingPerfEvaluator
Releases Β· friendliai/LLMServingPerfEvaluator
Release v0.0.5 π
- Update
friendli-clientversion >= 1.5.3 - Fix logic for normal distribution dummy dataset
Release v0.0.4 π
- Handle
aiohttp.ClientOSErrorwhen evaluating vLLM on high RPS. - Handle invalid unicode by replacing REPLACEMENT CHARACTER(U+FFFD).
- Hofix for generating dummy dataset.
Release v0.0.3 π
- Update vLLM & Friendli comparision example
Full Changelog: v0.0.2...v0.0.3
Release v0.0.2 π
- support gRPC request for Friendli engine.