Gaias 0.1.1
Pre-release
Pre-release
Major features:
- Provide
/healthendpoint to respond to the health status of LlamaEdge API Server instance. - Provide
/retrieve/infoendpoint to push the server info of LlamaEdge API Server to the target server specified by--target-urlCLI option - Work as a proxy to forward the LLM requests to the backed LlamaEdge API Server instance specified by
--server-socket-addrCLI option