Skip to content
This repository was archived by the owner on Sep 3, 2025. It is now read-only.

Releases: friendliai/LLMServingPerfEvaluator

Release v0.0.5 πŸš€

28 Aug 09:09

Choose a tag to compare

  • Update friendli-client version >= 1.5.3
  • Fix logic for normal distribution dummy dataset

Release v0.0.4 πŸš€

19 Jul 06:04

Choose a tag to compare

  • Handle aiohttp.ClientOSError when evaluating vLLM on high RPS.
  • Handle invalid unicode by replacing REPLACEMENT CHARACTER(U+FFFD).
  • Hofix for generating dummy dataset.

Release v0.0.3 πŸš€

27 Jun 04:33

Choose a tag to compare

  • Update vLLM & Friendli comparision example

Full Changelog: v0.0.2...v0.0.3

Release v0.0.2 πŸš€

19 Jun 08:17

Choose a tag to compare

  • support gRPC request for Friendli engine.

Release v0.0.1 πŸš€

22 May 10:50

Choose a tag to compare