Skip to content
This repository was archived by the owner on Sep 28, 2026. It is now read-only.

v2.8.0

Choose a tag to compare

View all tags
@jmansdorfer jmansdorfer released this 27 Mar 18:48
v2.8.0
7f97c57
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Major Changes

  • None

New Features

  • Adds support for streaming in /completions endpoint.
  • Adds support for new /documents endpoint, which currently allows for the extraction of data contained in documents.
  • Adds support for new /audio endpoint, which currently allows for the transcription of audio files.
  • Adds support for tool calling in /chat/completions using the new tools, tool_choice, and parallel_tool_calls parameters.
  • Adds support for new parameters added in new model server, including stop tokens, frequency_penalty, presence_penalty, and logit_bias.

Bug Fixes and Patches

  • None
Assets 2
Loading