Skip to content

aime-api-server-0.8.1

Choose a tag to compare

View all tags
@kinred kinred released this 27 Jun 09:13
· 284 commits to main since this release
v0.8.1
073afb3

Changes

Version 0.8.1

  • New input parameter type 'json', for submitting escaped raw JSON data to endpoint, added
  • Llama3 (llama3_chat) instruct chat example endpoint added
  • Mixtral 8x7B, 8x22B (mixtral_chat) instruct chat example endpoint added
  • Improved authentication mechanism
  • improved benchmark tool to benchmark instruct chat models throughput
Assets 2
Loading