Skip to content

Releases: France-Travail/benchmark_llm_serving

Benchmark_llm_serving v1.0.3

01 Aug 14:07

Choose a tag to compare

Improvements

PR #5 : Add support for mistral backend
PR #5 : Added compatibility with vLLM 0.5.3.post1

Benchmark_llm_serving v1.0.2

03 Jul 13:18

Choose a tag to compare

Improvements:

PR #1 : Readmes are now automatically generated when launching the bench_suite and less useful data are compressed (zip format)

Project:
PR #2 : git-lfs has been removed from the repo