Skip to content

Gaias 0.1.1

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 15 Aug 13:20
· 61 commits to main since this release

Major features:

  • Provide /health endpoint to respond to the health status of LlamaEdge API Server instance.
  • Provide /retrieve/info endpoint to push the server info of LlamaEdge API Server to the target server specified by --target-url CLI option
  • Work as a proxy to forward the LLM requests to the backed LlamaEdge API Server instance specified by --server-socket-addr CLI option