Skip to content

Happy_vLLM 1.2.2

Choose a tag to compare

View all tags
@maxDavid40 maxDavid40 released this 24 Mar 15:41
· 9 commits to release since this release
v1.2.2
9f1b278

Improvements

#68 : Update vLLM to 0.8.1 ( with a new endpoint /v1/audio/transcriptions)

Breaking changes

  • Use V1 engine with vLLM by default
Assets 2
Loading